Nov 04 03:16:22.784985 ip-10-0-133-235 systemd[1]: Starting Kubernetes Kubelet...
Nov 04 03:16:23.198075 ip-10-0-133-235 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 03:16:23.198075 ip-10-0-133-235 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 04 03:16:23.198075 ip-10-0-133-235 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 03:16:23.198075 ip-10-0-133-235 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 03:16:23.205114 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205014    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 03:16:23.205114 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205109    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 03:16:23.205114 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205114    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 03:16:23.205114 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205118    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 03:16:23.205114 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205122    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 03:16:23.205114 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205125    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 03:16:23.205114 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205128    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 03:16:23.205114 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205131    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205133    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205136    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205139    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205141    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205144    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205147    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205150    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205153    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205155    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205158    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205161    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205163    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205166    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205168    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205171    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205173    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205181    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205184    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205186    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 03:16:23.205410 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205189    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205191    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205194    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205196    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205199    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205204    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205207    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205210    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205215    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205218    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205221    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205224    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205228    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205231    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205234    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205237    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205239    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205242    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205245    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 03:16:23.205898 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205248    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205250    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205253    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205256    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205258    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205261    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205263    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205266    2579 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205269    2579 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205272    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205274    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205277    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205280    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205283    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205286    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205288    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205291    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205294    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205296    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205299    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 03:16:23.206386 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205301    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205304    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205306    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205309    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205311    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205314    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205316    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205320    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205323    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205326    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205328    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205331    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205335    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205339    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205342    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205345    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205347    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205351    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205354    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 03:16:23.206885 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205357    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205360    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205362    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205365    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205368    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205370    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205373    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205375    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205378    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205380    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205383    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205385    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205388    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205391    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205393    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205396    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205399    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205401    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205403    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 03:16:23.207340 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205408    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.205411    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206270    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206278    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206282    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206285    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206288    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206292    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206296    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206299    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206302    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206305    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206308    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206311    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206314    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206317    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206319    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206323    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206325    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 03:16:23.207815 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206328    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206331    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206333    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206337    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206340    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206343    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206346    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206349    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206352    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206354    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206357    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206359    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206362    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206365    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206368    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206371    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206374    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206377    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206379    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 03:16:23.208285 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206382    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206385    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206387    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206390    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206393    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206395    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206398    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206401    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206404    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206407    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206409    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206412    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206414    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206417    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206419    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206422    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206424    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206427    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206429    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 03:16:23.208767 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206432    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206435    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206437    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206439    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206442    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206444    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206447    2579 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206450    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206453    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206456    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206459    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206462    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206465    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206467    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206470    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206472    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206475    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206478    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206480    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206482    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 03:16:23.209238 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206485    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206488    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206491    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206493    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206495    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206498    2579 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206501    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206504    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206506    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206509    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206511    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206514    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206516    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206518    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206521    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206523    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206526    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206528    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206531    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206534    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 03:16:23.209763 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206537    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206540    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206542    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206545    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206547    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206550    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206552    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206555    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206558    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206560    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.206565    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207140    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207153    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207158    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207161    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207164    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207166    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207169    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207171    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207174    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 03:16:23.210266 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207178    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207182    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207185    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207192    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207195    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207197    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207200    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207203    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207205    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207208    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207211    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207214    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207216    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207219    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207221    2579 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207224    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207227    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207229    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207232    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207235    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 03:16:23.210760 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207237    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207240    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207243    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207245    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207247    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207250    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207253    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207256    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207258    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207261    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207263    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207266    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207268    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207271    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207273    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207277    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207280    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207284    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207287    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 03:16:23.211229 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207290    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207293    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207297    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207299    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207303    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207306    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207308    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207311    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207313    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207316    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207318    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207321    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207323    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207326    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207328    2579 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207331    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207333    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207336    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207339    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207341    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 03:16:23.211736 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207344    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207347    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207350    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207352    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207355    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207357    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207360    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207362    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207366    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207368    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207370    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207374    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207377    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207379    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207381    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207384    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207387    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207390    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207392    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 03:16:23.212207 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207395    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207397    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207400    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207402    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207405    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207407    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207410    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207412    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207415    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207417    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207420    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207422    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207425    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207427    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207433    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207436    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207438    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207441    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.207443    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208415    2579 flags.go:64] FLAG: --address="0.0.0.0"
Nov 04 03:16:23.212662 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208427    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208435    2579 flags.go:64] FLAG: --anonymous-auth="true"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208441    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208446    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208450    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208454    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208461    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208464    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208467    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208471    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208475    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208478    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208481    2579 flags.go:64] FLAG: --cgroup-root=""
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208484    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208487    2579 flags.go:64] FLAG: --client-ca-file=""
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208490    2579 flags.go:64] FLAG: --cloud-provider="external"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208493    2579 flags.go:64] FLAG: --cluster-dns="[]"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208497    2579 flags.go:64] FLAG: --cluster-domain=""
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208500    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208504    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208507    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208510    2579 flags.go:64] FLAG: --container-log-max-files="5"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208514    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 04 03:16:23.213196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208517    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208520    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208523    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208526    2579 flags.go:64] FLAG: --contention-profiling="false"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208530    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208533    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208536    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208539    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208544    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208547    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208550    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208558    2579 flags.go:64] FLAG: --enable-load-reader="false"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208562    2579 flags.go:64] FLAG: --enable-server="true"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208564    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208570    2579 flags.go:64] FLAG: --event-burst="100"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208575    2579 flags.go:64] FLAG: --event-qps="50"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208578    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208581    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208584    2579 flags.go:64] FLAG: --eviction-hard=""
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208589    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208592    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208595    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208598    2579 flags.go:64] FLAG: --eviction-soft=""
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208601    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208604    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 04 03:16:23.213752 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208608    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208610    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208614    2579 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208616    2579 flags.go:64] FLAG: --fail-swap-on="true"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208619    2579 flags.go:64] FLAG: --feature-gates=""
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208624    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208627    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208630    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208634    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208637    2579 flags.go:64] FLAG: --healthz-port="10248"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208640    2579 flags.go:64] FLAG: --help="false"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208643    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208647    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208651    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208654    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208657    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208661    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208664    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208667    2579 flags.go:64] FLAG: --image-service-endpoint=""
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208670    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208673    2579 flags.go:64] FLAG: --kube-api-burst="100"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208689    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208694    2579 flags.go:64] FLAG: --kube-api-qps="50"
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208697    2579 flags.go:64] FLAG: --kube-reserved=""
Nov 04 03:16:23.214377 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208700    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208703    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208706    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208709    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208712    2579 flags.go:64] FLAG: --lock-file=""
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208715    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208718    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208721    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208727    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208730    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208732    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208736    2579 flags.go:64] FLAG: --logging-format="text"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208739    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208742    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208745    2579 flags.go:64] FLAG: --manifest-url=""
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208748    2579 flags.go:64] FLAG: --manifest-url-header=""
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208752    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208756    2579 flags.go:64] FLAG: --max-open-files="1000000"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208760    2579 flags.go:64] FLAG: --max-pods="110"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208763    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208766    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208770    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208773    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208777    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208780    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 04 03:16:23.214988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208784    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208792    2579 flags.go:64] FLAG: --node-status-max-images="50"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208795    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208798    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208801    2579 flags.go:64] FLAG: --pod-cidr=""
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208806    2579 flags.go:64] FLAG: --pod-manifest-path=""
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208809    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208812    2579 flags.go:64] FLAG: --pods-per-core="0"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208815    2579 flags.go:64] FLAG: --port="10250"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208818    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208821    2579 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0ba3612a1b2fc9019"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208824    2579 flags.go:64] FLAG: --qos-reserved=""
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208827    2579 flags.go:64] FLAG: --read-only-port="10255"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208830    2579 flags.go:64] FLAG: --register-node="true"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208833    2579 flags.go:64] FLAG: --register-with-taints=""
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208837    2579 flags.go:64] FLAG: --registry-burst="10"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208840    2579 flags.go:64] FLAG: --registry-qps="5"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208843    2579 flags.go:64] FLAG: --reserved-cpus=""
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208846    2579 flags.go:64] FLAG: --reserved-memory=""
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208850    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208860    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208864    2579 flags.go:64] FLAG: --rotate-certificates="false"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208866    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208869    2579 flags.go:64] FLAG: --runonce="false"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208872    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208876    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208879    2579 flags.go:64] FLAG: --seccomp-default="false"
Nov 04 03:16:23.215636 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208881    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208884    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208888    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208891    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208895    2579 flags.go:64] FLAG: --storage-driver-password="root"
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208899    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208902    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208905    2579 flags.go:64] FLAG: --storage-driver-user="root"
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208907    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208911    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208915    2579 flags.go:64] FLAG: --system-cgroups=""
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208918    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208923    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208926    2579 flags.go:64] FLAG: --tls-cert-file=""
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208929    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208933    2579 flags.go:64] FLAG: --tls-min-version=""
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208936    2579 flags.go:64] FLAG: --tls-private-key-file=""
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208939    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208942    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208944    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208948    2579 flags.go:64] FLAG: --v="2"
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208952    2579 flags.go:64] FLAG: --version="false"
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208956    2579 flags.go:64] FLAG: --vmodule=""
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208960    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.208964    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 04 03:16:23.216848 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209147    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209151    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209155    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209158    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209161    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209165    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209168    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209171    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209174    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209176    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209179    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209182    2579 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209187    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209190    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209192    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209195    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209198    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209201    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209204    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 03:16:23.218003 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209207    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209209    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209212    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209215    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209217    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209220    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209222    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209225    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209228    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209231    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209234    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209236    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209239    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209242    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209245    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209247    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209250    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209252    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209255    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209257    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 03:16:23.218710 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209260    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209263    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209266    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209268    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209271    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209275    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209278    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209280    2579 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209283    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209285    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209289    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209292    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209295    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209298    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209300    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209302    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209305    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209308    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209310    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209313    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 03:16:23.219239 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209315    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209317    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209320    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209322    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209325    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209327    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209330    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209332    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209335    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209337    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209339    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209343    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209347    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209350    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209352    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209355    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209357    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209361    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209364    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209366    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 03:16:23.220126 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209369    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209371    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209374    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209377    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209379    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209382    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209385    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209387    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209390    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209392    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209395    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209397    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209399    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209402    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209405    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209407    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209410    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209412    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209415    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 03:16:23.221174 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209417    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 03:16:23.221833 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209420    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 03:16:23.221833 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209422    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 03:16:23.221833 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209426    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 03:16:23.221833 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209430    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 03:16:23.221833 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209433    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 03:16:23.221833 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209436    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 03:16:23.221833 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209438    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 03:16:23.221833 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.209465    2579 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 03:16:23.221833 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209502    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 03:16:23.221833 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209508    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 03:16:23.221833 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209516    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 03:16:23.221833 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209519    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 03:16:23.221833 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209523    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 03:16:23.221833 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209525    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 03:16:23.221833 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209528    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209530    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209533    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209535    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209538    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209541    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209543    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209546    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209548    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209550    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209553    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209555    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209558    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209560    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209563    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209565    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209568    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209570    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209573    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 03:16:23.222198 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209575    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 03:16:23.223000 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209578    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 03:16:23.223000 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209580    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 03:16:23.223000 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209583    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 03:16:23.223000 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209585    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 03:16:23.223000 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209588    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 03:16:23.223000 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209592    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 03:16:23.223000 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209595    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 03:16:23.223000 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209600    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 03:16:23.223000 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209603    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 03:16:23.223000 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209606    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 03:16:23.223000 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209609    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 03:16:23.223000 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209612    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 03:16:23.223000 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209614    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 03:16:23.223000 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209617    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 03:16:23.223000 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209619    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 03:16:23.223000 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209622    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 03:16:23.223000 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209624    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 03:16:23.223000 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209627    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209629    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209631    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209634    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209636    2579 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209639    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209641    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209644    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209646    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209649    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209651    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209654    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209656    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209658    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209661    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209664    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209666    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209669    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209671    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209674    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 03:16:23.223908 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209690    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209693    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209697    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209700    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209703    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209706    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209709    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209711    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209715    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209718    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209720    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209723    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209725    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209728    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209731    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209733    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209736    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209738    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209741    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209743    2579 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 03:16:23.224397 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209746    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209749    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209751    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209754    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209757    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209760    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209762    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209765    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209767    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209770    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209785    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209790    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209793    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209796    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209800    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209803    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209806    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209808    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209811    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209814    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 03:16:23.224932 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209818    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209821    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.209823    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.218235    2579 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.218257    2579 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.219147    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.219162    2579 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219285    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219295    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219300    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219305    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219311    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219316    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219321    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219326    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219331    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219336    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219341    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219345    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 03:16:23.225446 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219350    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219355    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219360    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219366    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219370    2579 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219376    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219381    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219386    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219391    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219395    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219400    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219412    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219417    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219422    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219428    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219433    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219438    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219443    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219448    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 03:16:23.225934 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219453    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219458    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219463    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219468    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219472    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219477    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219482    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219486    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219491    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219496    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219501    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219506    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219510    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219515    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219519    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219524    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219529    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219534    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219539    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219543    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 03:16:23.226395 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219549    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219553    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219558    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219563    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219568    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219573    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219578    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219583    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219588    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219593    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219598    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219602    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219607    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219613    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219617    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219622    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219627    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219632    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219637    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219641    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 03:16:23.226893 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219646    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219651    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219656    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219661    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219666    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219673    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219698    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219704    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219709    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219713    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219719    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219724    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219729    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219734    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219739    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219744    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219748    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219753    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219758    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 03:16:23.227357 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219763    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 03:16:23.228154 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219768    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 03:16:23.228154 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219773    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 03:16:23.228154 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219778    2579 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 03:16:23.228154 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219783    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 03:16:23.228154 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219788    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 03:16:23.228154 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219793    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 03:16:23.228154 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219798    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 03:16:23.228154 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219802    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 03:16:23.228154 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219810    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 03:16:23.228154 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219816    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 03:16:23.228154 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219821    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 03:16:23.228154 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219826    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 03:16:23.228154 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219831    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 03:16:23.228154 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219835    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 03:16:23.228154 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.219840    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 03:16:23.228154 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.219883    2579 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220120    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220129    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220134    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220138    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220143    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220147    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220152    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220157    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220162    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220167    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220172    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220177    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220182    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220187    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220191    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220201    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220206    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220211    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220216    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 03:16:23.228811 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220221    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220226    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220231    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220236    2579 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220240    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220245    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220249    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220255    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220259    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220264    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220269    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220273    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220278    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220283    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220287    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220292    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220297    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220302    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220306    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220311    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 03:16:23.229433 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220316    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220321    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220325    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220330    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220335    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220340    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220345    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220350    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220354    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220360    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220365    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220369    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220374    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220379    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220383    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220388    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220393    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220397    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220402    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220407    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 03:16:23.229946 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220413    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220418    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220422    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220427    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220432    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220437    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220441    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220446    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220450    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220455    2579 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220460    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220464    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220471    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220479    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220486    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220492    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220497    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220502    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220507    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 03:16:23.230421 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220512    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220519    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220525    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220531    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220536    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220541    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220546    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220550    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220554    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220559    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220564    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220569    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220573    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220578    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220583    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220588    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220592    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220597    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220602    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 03:16:23.230884 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220607    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 03:16:23.231652 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220612    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 03:16:23.231652 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220617    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 03:16:23.231652 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220621    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 03:16:23.231652 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220626    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 03:16:23.231652 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220633    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 03:16:23.231652 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220638    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 03:16:23.231652 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220642    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 03:16:23.231652 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220647    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 03:16:23.231652 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.220707    2579 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 03:16:23.231652 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220760    2579 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 03:16:23.231652 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220768    2579 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 03:16:23.231652 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220774    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 03:16:23.231652 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220779    2579 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 03:16:23.231652 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220784    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 03:16:23.231652 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220788    2579 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 03:16:23.231652 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220793    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220799    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220803    2579 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220808    2579 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220812    2579 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220817    2579 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220821    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220826    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220831    2579 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220835    2579 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220840    2579 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220845    2579 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220850    2579 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220865    2579 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220872    2579 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220877    2579 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220882    2579 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220887    2579 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220893    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 03:16:23.232089 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220898    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220903    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220912    2579 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220919    2579 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220925    2579 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220931    2579 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220936    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220940    2579 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220946    2579 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220951    2579 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220956    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220960    2579 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220965    2579 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220970    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220975    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220980    2579 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220986    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220990    2579 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.220995    2579 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 03:16:23.232563 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221000    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221005    2579 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221010    2579 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221015    2579 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221020    2579 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221025    2579 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221030    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221034    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221039    2579 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221043    2579 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221048    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221052    2579 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221057    2579 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221062    2579 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221066    2579 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221073    2579 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221078    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221082    2579 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221087    2579 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221092    2579 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 03:16:23.233136 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221097    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221102    2579 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221106    2579 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221112    2579 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221116    2579 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221121    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221126    2579 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221130    2579 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221134    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221140    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221145    2579 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221150    2579 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221154    2579 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221159    2579 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221164    2579 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221168    2579 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221173    2579 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221177    2579 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221181    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221185    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 03:16:23.233888 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221190    2579 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221194    2579 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221199    2579 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221203    2579 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221208    2579 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221213    2579 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221217    2579 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221224    2579 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221229    2579 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221234    2579 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221238    2579 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221243    2579 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221248    2579 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221253    2579 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221258    2579 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221266    2579 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221271    2579 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221275    2579 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221280    2579 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221285    2579 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 03:16:23.234673 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221289    2579 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 03:16:23.235859 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:23.221294    2579 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 03:16:23.235859 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.221384    2579 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 04 03:16:23.235859 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.224404    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 04 03:16:23.235859 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.225368    2579 server.go:1014] "Starting client certificate rotation"
Nov 04 03:16:23.235859 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.225464    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 03:16:23.235859 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.225501    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 03:16:23.235859 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.229066    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 03:16:23.235859 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.234598    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 03:16:23.245766 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.245743    2579 log.go:25] "Validated CRI v1 runtime API"
Nov 04 03:16:23.249779 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.249753    2579 log.go:25] "Validated CRI v1 image API"
Nov 04 03:16:23.250722 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.250699    2579 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 04 03:16:23.256517 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.256490    2579 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a275f15c-bdd6-46fa-877b-0103afde48b8:/dev/nvme0n1p3 bf299efb-074f-4c5d-9319-a1e0c15b2530:/dev/nvme0n1p4]
Nov 04 03:16:23.256616 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.256516    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 04 03:16:23.262091 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.261956    2579 manager.go:217] Machine: {Timestamp:2026-11-04 03:16:23.260457914 +0000 UTC m=+0.367245612 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3002768 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2468c3e2e5d5cc54c30da3843aceab SystemUUID:ec2468c3-e2e5-d5cc-54c3-0da3843aceab BootID:45a119ba-dc46-43f9-bb80-eb1b17d63a22 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:30:3c:11:3e:13 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:30:3c:11:3e:13 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:68:46:1f:26:dd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 04 03:16:23.262091 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.262085    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 04 03:16:23.262301 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.262216    2579 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 04 03:16:23.265416 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.265388    2579 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 04 03:16:23.265569 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.265418    2579 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-235.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 04 03:16:23.265621 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.265572    2579 topology_manager.go:143] "Creating topology manager with none policy"
Nov 04 03:16:23.265621 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.265579    2579 container_manager_linux.go:311] "Creating device plugin manager"
Nov 04 03:16:23.265621 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.265612    2579 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 03:16:23.265720 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.265630    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 03:16:23.266849 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.266837    2579 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 04 03:16:23.271187 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.271174    2579 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 04 03:16:23.271320 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.271310    2579 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 04 03:16:23.272160 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.272148    2579 kubelet.go:493] "Attempting to sync node with API server"
Nov 04 03:16:23.272206 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.272167    2579 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 04 03:16:23.272206 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.272186    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 04 03:16:23.272206 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.272200    2579 kubelet.go:405] "Adding apiserver pod source"
Nov 04 03:16:23.272310 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.272212    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 04 03:16:23.272798 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.272785    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 03:16:23.276645 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.276621    2579 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 04 03:16:23.284196 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.284179    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 03:16:23.285128 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.285113    2579 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 04 03:16:23.285193 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.285154    2579 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 04 03:16:23.285362 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.285349    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 04 03:16:23.285421 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.285370    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 04 03:16:23.285421 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.285381    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 04 03:16:23.285421 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.285391    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 04 03:16:23.285421 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.285402    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 04 03:16:23.285421 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.285411    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 04 03:16:23.286065 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.286052    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 04 03:16:23.286124 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.286068    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 04 03:16:23.286124 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.286081    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 04 03:16:23.286124 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.286091    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 04 03:16:23.286124 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.286106    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 04 03:16:23.286124 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.286122    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 04 03:16:23.286961 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.286950    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 04 03:16:23.287019 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.286965    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 04 03:16:23.290917 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.290896    2579 server.go:1263] "Started kubelet"
Nov 04 03:16:23.291001 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.290974    2579 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 04 03:16:23.291075 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.291007    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 04 03:16:23.291123 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.291108    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 04 03:16:23.291765 ip-10-0-133-235 systemd[1]: Started Kubernetes Kubelet.
Nov 04 03:16:23.293804 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.293788    2579 server.go:317] "Adding debug handlers to kubelet server"
Nov 04 03:16:23.295082 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.295065    2579 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 04 03:16:23.296948 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:23.296932    2579 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 04 03:16:23.300643 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.300625    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 04 03:16:23.301864 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.301849    2579 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 04 03:16:23.301994 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:23.301969    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-235.us-west-1.compute.internal\" not found"
Nov 04 03:16:23.302637 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.302620    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 04 03:16:23.302723 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.302621    2579 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 04 03:16:23.302723 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.302664    2579 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 04 03:16:23.302828 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.302803    2579 reconstruct.go:97] "Volume reconstruction finished"
Nov 04 03:16:23.302828 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.302813    2579 reconciler.go:29] "Reconciler: start to sync state"
Nov 04 03:16:23.302909 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.302896    2579 factory.go:55] Registering systemd factory
Nov 04 03:16:23.302938 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.302914    2579 factory.go:223] Registration of the systemd container factory successfully
Nov 04 03:16:23.303134 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.303123    2579 factory.go:153] Registering CRI-O factory
Nov 04 03:16:23.303167 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.303137    2579 factory.go:223] Registration of the crio container factory successfully
Nov 04 03:16:23.303201 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.303183    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 04 03:16:23.303233 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.303204    2579 factory.go:103] Registering Raw factory
Nov 04 03:16:23.303233 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.303216    2579 manager.go:1199] Started watching for new ooms in manager
Nov 04 03:16:23.304409 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.304388    2579 manager.go:319] Starting recovery of all containers
Nov 04 03:16:23.317867 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.317845    2579 manager.go:324] Recovery completed
Nov 04 03:16:23.322302 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.322288    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 03:16:23.324166 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.324147    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 03:16:23.324218 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.324187    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 03:16:23.324218 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.324202    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 03:16:23.324801 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.324785    2579 cpu_manager.go:226] "Starting" policy="none"
Nov 04 03:16:23.324801 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.324798    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 03:16:23.324937 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.324798    2579 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 04 03:16:23.324937 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.324838    2579 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 04 03:16:23.325580 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.325565    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 03:16:23.325624 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.325595    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 03:16:23.325624 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.325609    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 03:16:23.327034 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.327018    2579 policy_none.go:50] "Start"
Nov 04 03:16:23.327120 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.327037    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 04 03:16:23.327120 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.327050    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 04 03:16:23.329173 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.329160    2579 policy_none.go:44] "Start"
Nov 04 03:16:23.388214 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.374612    2579 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 04 03:16:23.388214 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.385409    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 04 03:16:23.388214 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.386931    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 04 03:16:23.388214 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.386955    2579 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 04 03:16:23.388214 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.386976    2579 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 04 03:16:23.388214 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:23.387009    2579 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 04 03:16:23.391194 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.391173    2579 manager.go:341] "Starting Device Plugin manager"
Nov 04 03:16:23.391303 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:23.391209    2579 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 04 03:16:23.391303 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.391220    2579 server.go:87] "Starting device plugin registration server"
Nov 04 03:16:23.391521 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.391505    2579 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 04 03:16:23.391592 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.391524    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 04 03:16:23.391641 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.391615    2579 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 04 03:16:23.392042 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.391826    2579 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 04 03:16:23.392042 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.391839    2579 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 04 03:16:23.392390 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:23.392370    2579 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 04 03:16:23.392482 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:23.392467    2579 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-235.us-west-1.compute.internal\" not found"
Nov 04 03:16:23.434282 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.434254    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-235.us-west-1.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 04 03:16:23.434282 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:23.434268    2579 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-235.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Nov 04 03:16:23.435440 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:23.434254    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-235.us-west-1.compute.internal.18e4b933b294d2ca  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-235.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-235.us-west-1.compute.internal,},FirstTimestamp:2026-11-04 03:16:23.290868426 +0000 UTC m=+0.397656124,LastTimestamp:2026-11-04 03:16:23.290868426 +0000 UTC m=+0.397656124,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-235.us-west-1.compute.internal,}"
Nov 04 03:16:23.484883 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:23.484781    2579 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Nov 04 03:16:23.485033 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:23.484900    2579 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-235.us-west-1.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Nov 04 03:16:23.487130 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.487110    2579 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal"]
Nov 04 03:16:23.487187 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.487176    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 03:16:23.488129 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.488109    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 03:16:23.488190 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.488140    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 03:16:23.488190 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.488153    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 03:16:23.490358 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.490341    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 03:16:23.490501 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.490486    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:23.490553 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.490544    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 03:16:23.491186 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.491165    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 03:16:23.491276 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.491199    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 03:16:23.491276 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.491210    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 03:16:23.491276 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.491257    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 03:16:23.491374 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.491279    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 03:16:23.491374 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.491288    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 03:16:23.492016 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.492002    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 03:16:23.492703 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.492675    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 03:16:23.492773 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.492714    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 03:16:23.492773 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.492728    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 03:16:23.492773 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.492749    2579 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:23.493316 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.493301    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:23.493401 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.493327    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 03:16:23.494060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.494044    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 03:16:23.494123 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.494076    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 03:16:23.494123 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.494089    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 03:16:23.503872 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.503852    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c765b34c16910e2f80f9fa5e61a7a31-config\") pod \"kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal\" (UID: \"3c765b34c16910e2f80f9fa5e61a7a31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:23.503961 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.503879    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a2b94a5dc0a9815239ea671208b14be-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal\" (UID: \"6a2b94a5dc0a9815239ea671208b14be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:23.503961 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.503895    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a2b94a5dc0a9815239ea671208b14be-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal\" (UID: \"6a2b94a5dc0a9815239ea671208b14be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:23.506191 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.506168    2579 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 04 03:16:23.506251 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.506235    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5wrw2"
Nov 04 03:16:23.527800 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:23.527776    2579 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-235.us-west-1.compute.internal\" not found" node="ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:23.530553 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:23.530533    2579 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-235.us-west-1.compute.internal\" not found" node="ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:23.533840 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:23.533822    2579 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Nov 04 03:16:23.599793 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.599761    2579 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 03:16:23.605052 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.605031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a2b94a5dc0a9815239ea671208b14be-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal\" (UID: \"6a2b94a5dc0a9815239ea671208b14be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:23.605177 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.605059    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c765b34c16910e2f80f9fa5e61a7a31-config\") pod \"kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal\" (UID: \"3c765b34c16910e2f80f9fa5e61a7a31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:23.605177 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.605076    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a2b94a5dc0a9815239ea671208b14be-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal\" (UID: \"6a2b94a5dc0a9815239ea671208b14be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:23.605177 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.605103    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a2b94a5dc0a9815239ea671208b14be-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal\" (UID: \"6a2b94a5dc0a9815239ea671208b14be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:23.605177 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.605121    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a2b94a5dc0a9815239ea671208b14be-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal\" (UID: \"6a2b94a5dc0a9815239ea671208b14be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:23.605177 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.605141    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c765b34c16910e2f80f9fa5e61a7a31-config\") pod \"kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal\" (UID: \"3c765b34c16910e2f80f9fa5e61a7a31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:23.606663 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.606646    2579 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:23.606773 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:23.606666    2579 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-235.us-west-1.compute.internal\": node \"ip-10-0-133-235.us-west-1.compute.internal\" not found"
Nov 04 03:16:23.726420 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:23.726388    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-235.us-west-1.compute.internal\" not found"
Nov 04 03:16:23.826872 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:23.826795    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-235.us-west-1.compute.internal\" not found"
Nov 04 03:16:23.832967 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.832944    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:23.835130 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:23.835108    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:23.927787 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:23.927743    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-235.us-west-1.compute.internal\" not found"
Nov 04 03:16:24.028638 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:24.028599    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-235.us-west-1.compute.internal\" not found"
Nov 04 03:16:24.129705 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:24.129590    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-235.us-west-1.compute.internal\" not found"
Nov 04 03:16:24.225733 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:24.225654    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 04 03:16:24.226255 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:24.225890    2579 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 04 03:16:24.226255 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:24.225926    2579 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a0eed642b5924453b9c4f38476315c56-78f2aa2176e6b7a4.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-133-235.us-west-1.compute.internal.18e4b933b490f020\": read tcp 10.0.133.235:41634->3.18.82.172:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-133-235.us-west-1.compute.internal.18e4b933b490f020  default   4992 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-235.us-west-1.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-235.us-west-1.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-235.us-west-1.compute.internal,},FirstTimestamp:2026-11-04 03:16:23 +0000 UTC,LastTimestamp:2026-11-04 03:16:23.491185791 +0000 UTC m=+0.597973493,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-235.us-west-1.compute.internal,}"
Nov 04 03:16:24.229824 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:24.229803    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-235.us-west-1.compute.internal\" not found"
Nov 04 03:16:24.330731 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:24.330697    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-235.us-west-1.compute.internal\" not found"
Nov 04 03:16:24.431387 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:24.431297    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-235.us-west-1.compute.internal\" not found"
Nov 04 03:16:24.512234 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:24.512184    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 03:11:23 +0000 UTC" deadline="2028-06-26 10:36:33.83731419 +0000 UTC"
Nov 04 03:16:24.512234 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:24.512222    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14407h20m9.32509742s"
Nov 04 03:16:24.532090 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:24.532058    2579 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-235.us-west-1.compute.internal\" not found"
Nov 04 03:16:24.562803 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:24.562761    2579 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 03:16:24.563958 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:24.563941    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 03:16:24.564074 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:24.563977    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 03:16:24.564074 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:24.563993    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 03:16:24.597617 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:24.597580    2579 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 03:16:24.602661 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:24.602639    2579 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:24.662988 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:24.662793    2579 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 03:16:24.665024 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:24.665005    2579 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:16:24.730177 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:24.730086    2579 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 03:16:24.803982 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:24.803947    2579 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 03:16:24.982642 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:24.982566    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a2b94a5dc0a9815239ea671208b14be.slice/crio-eb28565ca200c8937d612a2816a916638b53e2d3daf1800beff39a79e6a522f4 WatchSource:0}: Error finding container eb28565ca200c8937d612a2816a916638b53e2d3daf1800beff39a79e6a522f4: Status 404 returned error can't find the container with id eb28565ca200c8937d612a2816a916638b53e2d3daf1800beff39a79e6a522f4
Nov 04 03:16:24.983047 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:24.983031    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c765b34c16910e2f80f9fa5e61a7a31.slice/crio-9fe0d4940364b1c26e3afe098b975d364a29bf80655ed90f1712bdff270cba59 WatchSource:0}: Error finding container 9fe0d4940364b1c26e3afe098b975d364a29bf80655ed90f1712bdff270cba59: Status 404 returned error can't find the container with id 9fe0d4940364b1c26e3afe098b975d364a29bf80655ed90f1712bdff270cba59
Nov 04 03:16:24.988464 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:24.988443    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 03:16:25.187353 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.187310    2579 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 03:16:25.274136 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.274034    2579 apiserver.go:52] "Watching apiserver"
Nov 04 03:16:25.303478 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.303434    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 04 03:16:25.387294 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.387248    2579 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 04 03:16:25.387635 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.387614    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal","openshift-cluster-node-tuning-operator/tuned-q6lv4","openshift-multus/multus-additional-cni-plugins-zntz9","openshift-dns/node-resolver-qcx8j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal","openshift-network-diagnostics/network-check-target-mbsd5","openshift-network-operator/iptables-alerter-v8qgg","kube-system/global-pull-secret-syncer-tnstt","kube-system/konnectivity-agent-c45lh","openshift-image-registry/node-ca-kjnsg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t","openshift-multus/multus-kk42g","openshift-multus/network-metrics-daemon-2qtd2","openshift-ovn-kubernetes/ovnkube-node-lft9z"]
Nov 04 03:16:25.391782 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.391754    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c45lh"
Nov 04 03:16:25.394114 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.394088    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.396607 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.396586    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.399184 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.399046    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:25.399240 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:25.399147    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qtd2" podUID="9f281309-4b53-40fd-a044-03576371eff8"
Nov 04 03:16:25.401515 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.401492    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.403866 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.403849    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.407216 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.407188    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v8qgg"
Nov 04 03:16:25.410156 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.410133    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:25.410282 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:25.410212    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnstt" podUID="ebbc4d63-f22e-4763-89c4-e521051fd3f1"
Nov 04 03:16:25.413324 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.413303    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kjnsg"
Nov 04 03:16:25.415718 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.415701    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-cni-bin\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.415718 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.415712    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:25.415876 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.415727    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2zr8\" (UniqueName: \"kubernetes.io/projected/baffc706-950b-4f9d-9fb2-b6d1735e7db4-kube-api-access-f2zr8\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.415876 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.415750    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-log-socket\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.415876 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.415793    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/baffc706-950b-4f9d-9fb2-b6d1735e7db4-ovnkube-config\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.415876 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:25.415801    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbsd5" podUID="31c980c0-089e-4671-bfa2-f1fcaeb70291"
Nov 04 03:16:25.416043 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.415883    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-cni-dir\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.416043 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.415914    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-conf-dir\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.416043 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.415931    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-run-multus-certs\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.416043 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416005    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-etc-openvswitch\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.416043 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416037    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:25.416279 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416065    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-cnibin\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.416279 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416123    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-kubernetes\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.416279 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416167    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-sysctl-d\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.416279 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416185    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-run-ovn-kubernetes\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.416279 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416225    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgnv5\" (UniqueName: \"kubernetes.io/projected/9f281309-4b53-40fd-a044-03576371eff8-kube-api-access-pgnv5\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:25.416522 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416288    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-daemon-config\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.416522 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416345    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.416522 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416372    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-sysconfig\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.416522 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-slash\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.416522 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416422    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dklb5\" (UniqueName: \"kubernetes.io/projected/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-kube-api-access-dklb5\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.416522 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416449    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-run-ovn\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.416522 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416494    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/baffc706-950b-4f9d-9fb2-b6d1735e7db4-env-overrides\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.416816 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416522    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-var-lib-kubelet\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.416816 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416546    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-hostroot\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.416816 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416571    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-sys-fs\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.416816 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416628    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-node-log\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.416816 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416644    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-cni-netd\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.416816 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416659    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.416816 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416676    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-run-netns\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.416816 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416711    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-var-lib-cni-bin\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.416816 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416727    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktsxx\" (UniqueName: \"kubernetes.io/projected/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-kube-api-access-ktsxx\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.416816 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416749    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ed2535b3-99cd-4eb4-9475-8fa24337d022-konnectivity-ca\") pod \"konnectivity-agent-c45lh\" (UID: \"ed2535b3-99cd-4eb4-9475-8fa24337d022\") " pod="kube-system/konnectivity-agent-c45lh"
Nov 04 03:16:25.417220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416830    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-kubelet\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.417220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416867    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-run-netns\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.417220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416912    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-run-k8s-cni-cncf-io\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.417220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416941    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-socket-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.417220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.416967    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-modprobe-d\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.417220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417010    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-sysctl-conf\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.417220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417048    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-var-lib-kubelet\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.417220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417075    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-host\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.417220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417102    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdksf\" (UniqueName: \"kubernetes.io/projected/4977c0d1-54d6-4b30-8a86-1c3830ff0896-kube-api-access-xdksf\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.417220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417123    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-etc-selinux\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.417220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417146    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-tuned\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.417220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417172    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-var-lib-openvswitch\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.417220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417197    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-var-lib-cni-multus\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.417220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417219    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-systemd\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.417743 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417297    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-sys\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.417743 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417330    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/baffc706-950b-4f9d-9fb2-b6d1735e7db4-ovnkube-script-lib\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.417743 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417364    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-system-cni-dir\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.417743 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417380    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-cni-binary-copy\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.417743 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417395    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-device-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.417743 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417413    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-lib-modules\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.417743 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417431    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-run\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.417743 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417446    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-run-systemd\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.417743 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417482    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4977c0d1-54d6-4b30-8a86-1c3830ff0896-tmp\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.417743 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417512    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-run-openvswitch\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.417743 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417535    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-socket-dir-parent\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.417743 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417551    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-registration-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.417743 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417568    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ed2535b3-99cd-4eb4-9475-8fa24337d022-agent-certs\") pod \"konnectivity-agent-c45lh\" (UID: \"ed2535b3-99cd-4eb4-9475-8fa24337d022\") " pod="kube-system/konnectivity-agent-c45lh"
Nov 04 03:16:25.417743 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417583    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/baffc706-950b-4f9d-9fb2-b6d1735e7db4-ovn-node-metrics-cert\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.417743 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417598    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-etc-kubernetes\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.417743 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.417642    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-systemd-units\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.418259 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.418080    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qcx8j"
Nov 04 03:16:25.420576 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.420516    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal" event={"ID":"3c765b34c16910e2f80f9fa5e61a7a31","Type":"ContainerStarted","Data":"9fe0d4940364b1c26e3afe098b975d364a29bf80655ed90f1712bdff270cba59"}
Nov 04 03:16:25.420669 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.420594    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal" event={"ID":"6a2b94a5dc0a9815239ea671208b14be","Type":"ContainerStarted","Data":"eb28565ca200c8937d612a2816a916638b53e2d3daf1800beff39a79e6a522f4"}
Nov 04 03:16:25.420669 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.420603    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.449339 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.449223    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 04 03:16:25.449339 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.449267    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 04 03:16:25.449339 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.449314    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-8nk47\""
Nov 04 03:16:25.450677 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.450651    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 04 03:16:25.450818 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.450801    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 04 03:16:25.450914 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.450897    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qhl58\""
Nov 04 03:16:25.500787 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.500749    2579 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 04 03:16:25.500957 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.500837    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-6dzm9"
Nov 04 03:16:25.503597 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.503571    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 04 03:16:25.518832 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.518803    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-var-lib-kubelet\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.518959 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.518834    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-host\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.518959 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.518855    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdksf\" (UniqueName: \"kubernetes.io/projected/4977c0d1-54d6-4b30-8a86-1c3830ff0896-kube-api-access-xdksf\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.518959 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.518871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-etc-selinux\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.518959 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.518891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-tuned\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.518959 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.518925    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-host\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.518959 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.518950    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-var-lib-kubelet\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.519220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.518990    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-var-lib-openvswitch\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.519220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519018    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-var-lib-cni-multus\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.519220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519028    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-etc-selinux\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.519220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519053    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqgnm\" (UniqueName: \"kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm\") pod \"network-check-target-mbsd5\" (UID: \"31c980c0-089e-4671-bfa2-f1fcaeb70291\") " pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:25.519220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519054    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-var-lib-cni-multus\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.519220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519068    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-var-lib-openvswitch\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.519220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519085    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-systemd\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.519220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-sys\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.519220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519111    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-systemd\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.519220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519134    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-sys\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.519220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519134    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/baffc706-950b-4f9d-9fb2-b6d1735e7db4-ovnkube-script-lib\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.519220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519194    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-system-cni-dir\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.519220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519220    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-cni-binary-copy\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.519220 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519221    2579 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 04 03:16:25.519831 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519246    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-device-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.519831 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519246    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-system-cni-dir\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.519831 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519310    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-lib-modules\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.519831 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519377    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-device-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.519831 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519385    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-run\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.519831 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519407    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-run-systemd\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.519831 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519424    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4977c0d1-54d6-4b30-8a86-1c3830ff0896-tmp\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.519831 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519442    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-run-openvswitch\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.519831 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519459    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-socket-dir-parent\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.519831 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519474    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-lib-modules\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.519831 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519500    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-run\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.519831 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519518    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-run-openvswitch\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.519831 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519521    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-socket-dir-parent\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.519831 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519540    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-run-systemd\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.519831 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519535    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-registration-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.519831 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519571    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-registration-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.519831 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519590    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54f9dc0b-7a1d-4be7-a624-fcf314049385-cni-binary-copy\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.520609 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519620    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54f9dc0b-7a1d-4be7-a624-fcf314049385-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.520609 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519643    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/54f9dc0b-7a1d-4be7-a624-fcf314049385-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.520609 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519677    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ed2535b3-99cd-4eb4-9475-8fa24337d022-agent-certs\") pod \"konnectivity-agent-c45lh\" (UID: \"ed2535b3-99cd-4eb4-9475-8fa24337d022\") " pod="kube-system/konnectivity-agent-c45lh"
Nov 04 03:16:25.520609 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/baffc706-950b-4f9d-9fb2-b6d1735e7db4-ovn-node-metrics-cert\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.520609 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519855    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-etc-kubernetes\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.520609 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519882    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1162ece-d405-4175-a6c9-c45407f6c714-host\") pod \"node-ca-kjnsg\" (UID: \"a1162ece-d405-4175-a6c9-c45407f6c714\") " pod="openshift-image-registry/node-ca-kjnsg"
Nov 04 03:16:25.520609 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519907    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54f9dc0b-7a1d-4be7-a624-fcf314049385-system-cni-dir\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.520609 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519934    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/02e0dd3b-a707-46be-9aee-330b572db5fe-hosts-file\") pod \"node-resolver-qcx8j\" (UID: \"02e0dd3b-a707-46be-9aee-330b572db5fe\") " pod="openshift-dns/node-resolver-qcx8j"
Nov 04 03:16:25.520609 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519950    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-etc-kubernetes\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.520609 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.519997    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:25.520609 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520036    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-systemd-units\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.520609 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520078    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-cni-bin\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.520609 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520100    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2zr8\" (UniqueName: \"kubernetes.io/projected/baffc706-950b-4f9d-9fb2-b6d1735e7db4-kube-api-access-f2zr8\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.520609 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520127    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-log-socket\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.520609 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520134    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-systemd-units\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.520609 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520145    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-cni-bin\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.520609 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520158    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-log-socket\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.521413 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520254    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/baffc706-950b-4f9d-9fb2-b6d1735e7db4-ovnkube-config\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.521413 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520290    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-cni-dir\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.521413 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520319    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-conf-dir\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.521413 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520352    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-run-multus-certs\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.521413 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520384    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmq4p\" (UniqueName: \"kubernetes.io/projected/a1162ece-d405-4175-a6c9-c45407f6c714-kube-api-access-nmq4p\") pod \"node-ca-kjnsg\" (UID: \"a1162ece-d405-4175-a6c9-c45407f6c714\") " pod="openshift-image-registry/node-ca-kjnsg"
Nov 04 03:16:25.521413 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520415    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-etc-openvswitch\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.521413 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520419    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-conf-dir\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.521413 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520448    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:25.521413 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520458    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-run-multus-certs\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.521413 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520482    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-cnibin\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.521413 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520516    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54f9dc0b-7a1d-4be7-a624-fcf314049385-cnibin\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.521413 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520547    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98748f47-73db-4d89-b237-41ddf5bfe4bf-host-slash\") pod \"iptables-alerter-v8qgg\" (UID: \"98748f47-73db-4d89-b237-41ddf5bfe4bf\") " pod="openshift-network-operator/iptables-alerter-v8qgg"
Nov 04 03:16:25.521413 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520575    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-kubernetes\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.521413 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520605    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-sysctl-d\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.521413 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-run-ovn-kubernetes\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.521413 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520663    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgnv5\" (UniqueName: \"kubernetes.io/projected/9f281309-4b53-40fd-a044-03576371eff8-kube-api-access-pgnv5\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:25.521413 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520827    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-cni-dir\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.522209 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520850    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-etc-openvswitch\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.522209 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.520971    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-daemon-config\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.522209 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521067    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-cnibin\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.522209 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521098    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-run-ovn-kubernetes\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.522209 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521111    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pccrq\" (UniqueName: \"kubernetes.io/projected/98748f47-73db-4d89-b237-41ddf5bfe4bf-kube-api-access-pccrq\") pod \"iptables-alerter-v8qgg\" (UID: \"98748f47-73db-4d89-b237-41ddf5bfe4bf\") " pod="openshift-network-operator/iptables-alerter-v8qgg"
Nov 04 03:16:25.522209 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521122    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-sysctl-d\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.522209 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521165    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebbc4d63-f22e-4763-89c4-e521051fd3f1-kubelet-config\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:25.522209 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521205    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.522209 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521241    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-sysconfig\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.522209 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:25.521282    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 03:16:25.522209 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-slash\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.522209 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521335    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dklb5\" (UniqueName: \"kubernetes.io/projected/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-kube-api-access-dklb5\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.522209 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521373    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmpdn\" (UniqueName: \"kubernetes.io/projected/54f9dc0b-7a1d-4be7-a624-fcf314049385-kube-api-access-wmpdn\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.522209 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521374    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-kubernetes\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.522209 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521405    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-sysconfig\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.522209 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:25.521434    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs podName:9f281309-4b53-40fd-a044-03576371eff8 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:26.021395264 +0000 UTC m=+3.128182956 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs") pod "network-metrics-daemon-2qtd2" (UID: "9f281309-4b53-40fd-a044-03576371eff8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 03:16:25.522209 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521468    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-run-ovn\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.523060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521492    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.523060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521495    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/baffc706-950b-4f9d-9fb2-b6d1735e7db4-env-overrides\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.523060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521508    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-slash\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.523060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521539    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-run-ovn\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.523060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521577    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-var-lib-kubelet\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.523060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521703    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-var-lib-kubelet\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.523060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521706    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-hostroot\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.523060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521758    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-sys-fs\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.523060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521789    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-node-log\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.523060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521807    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-hostroot\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.523060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521841    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-node-log\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.523060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521849    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-cni-netd\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.523060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521919    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-sys-fs\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.523060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521969    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-cni-netd\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.523060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.521968    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.523060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522010    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.523060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522016    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-run-netns\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.523060 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522064    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-run-netns\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.523727 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-var-lib-cni-bin\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.523727 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522136    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktsxx\" (UniqueName: \"kubernetes.io/projected/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-kube-api-access-ktsxx\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.523727 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522159    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-var-lib-cni-bin\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.523727 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522168    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/54f9dc0b-7a1d-4be7-a624-fcf314049385-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.523727 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522279    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02e0dd3b-a707-46be-9aee-330b572db5fe-tmp-dir\") pod \"node-resolver-qcx8j\" (UID: \"02e0dd3b-a707-46be-9aee-330b572db5fe\") " pod="openshift-dns/node-resolver-qcx8j"
Nov 04 03:16:25.523727 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522339    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ed2535b3-99cd-4eb4-9475-8fa24337d022-konnectivity-ca\") pod \"konnectivity-agent-c45lh\" (UID: \"ed2535b3-99cd-4eb4-9475-8fa24337d022\") " pod="kube-system/konnectivity-agent-c45lh"
Nov 04 03:16:25.523727 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522396    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-kubelet\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.523727 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522428    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-run-netns\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.523727 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522460    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-run-k8s-cni-cncf-io\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.523727 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522490    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-socket-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.523727 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522519    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1162ece-d405-4175-a6c9-c45407f6c714-serviceca\") pod \"node-ca-kjnsg\" (UID: \"a1162ece-d405-4175-a6c9-c45407f6c714\") " pod="openshift-image-registry/node-ca-kjnsg"
Nov 04 03:16:25.523727 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522515    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-kubelet\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.523727 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522550    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebbc4d63-f22e-4763-89c4-e521051fd3f1-dbus\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:25.523727 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522648    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-run-k8s-cni-cncf-io\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.523727 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522670    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvpq9\" (UniqueName: \"kubernetes.io/projected/02e0dd3b-a707-46be-9aee-330b572db5fe-kube-api-access-hvpq9\") pod \"node-resolver-qcx8j\" (UID: \"02e0dd3b-a707-46be-9aee-330b572db5fe\") " pod="openshift-dns/node-resolver-qcx8j"
Nov 04 03:16:25.523727 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522753    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/98748f47-73db-4d89-b237-41ddf5bfe4bf-iptables-alerter-script\") pod \"iptables-alerter-v8qgg\" (UID: \"98748f47-73db-4d89-b237-41ddf5bfe4bf\") " pod="openshift-network-operator/iptables-alerter-v8qgg"
Nov 04 03:16:25.523727 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522740    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-run-netns\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.524273 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522791    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-modprobe-d\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.524273 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522836    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-socket-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.524273 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522894    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-modprobe-d\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.524273 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.522906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-sysctl-conf\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.524273 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.523008    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-sysctl-conf\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.524273 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.523208    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ed2535b3-99cd-4eb4-9475-8fa24337d022-konnectivity-ca\") pod \"konnectivity-agent-c45lh\" (UID: \"ed2535b3-99cd-4eb4-9475-8fa24337d022\") " pod="kube-system/konnectivity-agent-c45lh"
Nov 04 03:16:25.524273 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.523313    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-tuned\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.524273 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.523359    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4977c0d1-54d6-4b30-8a86-1c3830ff0896-tmp\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.524273 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.523702    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ed2535b3-99cd-4eb4-9475-8fa24337d022-agent-certs\") pod \"konnectivity-agent-c45lh\" (UID: \"ed2535b3-99cd-4eb4-9475-8fa24337d022\") " pod="kube-system/konnectivity-agent-c45lh"
Nov 04 03:16:25.558021 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.557978    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 04 03:16:25.558021 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.558000    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 04 03:16:25.558021 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.558021    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 04 03:16:25.558285 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.558066    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 04 03:16:25.558285 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.558098    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 04 03:16:25.558285 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.558135    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 04 03:16:25.558285 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.558156    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 04 03:16:25.558285 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.558172    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 04 03:16:25.558285 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.558202    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 04 03:16:25.558493 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.558307    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9c548\""
Nov 04 03:16:25.558493 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.558304    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ztc7x\""
Nov 04 03:16:25.558574 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.558558    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 04 03:16:25.558625 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.558559    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-cj8mj\""
Nov 04 03:16:25.559886 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.559463    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5q5qr\""
Nov 04 03:16:25.559886 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.559525    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 04 03:16:25.559886 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.559564    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 04 03:16:25.559886 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.559667    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7jn7l\""
Nov 04 03:16:25.559886 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.559682    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 04 03:16:25.559886 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.559826    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 04 03:16:25.559886 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.559842    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 04 03:16:25.560334 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.559945    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 04 03:16:25.560334 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.560139    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 04 03:16:25.560334 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.560198    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-cni-binary-copy\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.562700 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.562643    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/baffc706-950b-4f9d-9fb2-b6d1735e7db4-env-overrides\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.562817 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.562776    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-daemon-config\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.562817 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.562805    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/baffc706-950b-4f9d-9fb2-b6d1735e7db4-ovnkube-config\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.563375 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.563353    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/baffc706-950b-4f9d-9fb2-b6d1735e7db4-ovn-node-metrics-cert\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.571102 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.571080    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 04 03:16:25.571222 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.571083    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 04 03:16:25.571222 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.571106    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5pzz6\""
Nov 04 03:16:25.612644 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.612611    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 04 03:16:25.612644 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.612637    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 04 03:16:25.612865 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.612624    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 04 03:16:25.612865 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.612731    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 04 03:16:25.612974 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.612914    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s72nt\""
Nov 04 03:16:25.615773 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.615722    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgnv5\" (UniqueName: \"kubernetes.io/projected/9f281309-4b53-40fd-a044-03576371eff8-kube-api-access-pgnv5\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:25.615875 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.615786    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdksf\" (UniqueName: \"kubernetes.io/projected/4977c0d1-54d6-4b30-8a86-1c3830ff0896-kube-api-access-xdksf\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.615875 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.615855    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dklb5\" (UniqueName: \"kubernetes.io/projected/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-kube-api-access-dklb5\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.616097 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.616080    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktsxx\" (UniqueName: \"kubernetes.io/projected/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-kube-api-access-ktsxx\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.616135 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.616082    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2zr8\" (UniqueName: \"kubernetes.io/projected/baffc706-950b-4f9d-9fb2-b6d1735e7db4-kube-api-access-f2zr8\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.620215 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.620195    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/baffc706-950b-4f9d-9fb2-b6d1735e7db4-ovnkube-script-lib\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.623183 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623159    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pccrq\" (UniqueName: \"kubernetes.io/projected/98748f47-73db-4d89-b237-41ddf5bfe4bf-kube-api-access-pccrq\") pod \"iptables-alerter-v8qgg\" (UID: \"98748f47-73db-4d89-b237-41ddf5bfe4bf\") " pod="openshift-network-operator/iptables-alerter-v8qgg"
Nov 04 03:16:25.623235 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebbc4d63-f22e-4763-89c4-e521051fd3f1-kubelet-config\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:25.623235 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623227    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmpdn\" (UniqueName: \"kubernetes.io/projected/54f9dc0b-7a1d-4be7-a624-fcf314049385-kube-api-access-wmpdn\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.623304 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623263    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/54f9dc0b-7a1d-4be7-a624-fcf314049385-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.623304 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623278    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebbc4d63-f22e-4763-89c4-e521051fd3f1-kubelet-config\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:25.623304 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623286    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02e0dd3b-a707-46be-9aee-330b572db5fe-tmp-dir\") pod \"node-resolver-qcx8j\" (UID: \"02e0dd3b-a707-46be-9aee-330b572db5fe\") " pod="openshift-dns/node-resolver-qcx8j"
Nov 04 03:16:25.623413 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623325    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1162ece-d405-4175-a6c9-c45407f6c714-serviceca\") pod \"node-ca-kjnsg\" (UID: \"a1162ece-d405-4175-a6c9-c45407f6c714\") " pod="openshift-image-registry/node-ca-kjnsg"
Nov 04 03:16:25.623491 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623464    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebbc4d63-f22e-4763-89c4-e521051fd3f1-dbus\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:25.623555 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623518    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvpq9\" (UniqueName: \"kubernetes.io/projected/02e0dd3b-a707-46be-9aee-330b572db5fe-kube-api-access-hvpq9\") pod \"node-resolver-qcx8j\" (UID: \"02e0dd3b-a707-46be-9aee-330b572db5fe\") " pod="openshift-dns/node-resolver-qcx8j"
Nov 04 03:16:25.623604 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/98748f47-73db-4d89-b237-41ddf5bfe4bf-iptables-alerter-script\") pod \"iptables-alerter-v8qgg\" (UID: \"98748f47-73db-4d89-b237-41ddf5bfe4bf\") " pod="openshift-network-operator/iptables-alerter-v8qgg"
Nov 04 03:16:25.623604 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623572    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebbc4d63-f22e-4763-89c4-e521051fd3f1-dbus\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:25.623700 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623609    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02e0dd3b-a707-46be-9aee-330b572db5fe-tmp-dir\") pod \"node-resolver-qcx8j\" (UID: \"02e0dd3b-a707-46be-9aee-330b572db5fe\") " pod="openshift-dns/node-resolver-qcx8j"
Nov 04 03:16:25.623700 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623611    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqgnm\" (UniqueName: \"kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm\") pod \"network-check-target-mbsd5\" (UID: \"31c980c0-089e-4671-bfa2-f1fcaeb70291\") " pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:25.623700 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623681    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54f9dc0b-7a1d-4be7-a624-fcf314049385-cni-binary-copy\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.623894 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623709    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54f9dc0b-7a1d-4be7-a624-fcf314049385-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.623894 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623709    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1162ece-d405-4175-a6c9-c45407f6c714-serviceca\") pod \"node-ca-kjnsg\" (UID: \"a1162ece-d405-4175-a6c9-c45407f6c714\") " pod="openshift-image-registry/node-ca-kjnsg"
Nov 04 03:16:25.623894 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623756    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/54f9dc0b-7a1d-4be7-a624-fcf314049385-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.623894 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623790    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1162ece-d405-4175-a6c9-c45407f6c714-host\") pod \"node-ca-kjnsg\" (UID: \"a1162ece-d405-4175-a6c9-c45407f6c714\") " pod="openshift-image-registry/node-ca-kjnsg"
Nov 04 03:16:25.623894 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623816    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54f9dc0b-7a1d-4be7-a624-fcf314049385-system-cni-dir\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.623894 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623841    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/02e0dd3b-a707-46be-9aee-330b572db5fe-hosts-file\") pod \"node-resolver-qcx8j\" (UID: \"02e0dd3b-a707-46be-9aee-330b572db5fe\") " pod="openshift-dns/node-resolver-qcx8j"
Nov 04 03:16:25.623894 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623868    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:25.623894 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623880    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54f9dc0b-7a1d-4be7-a624-fcf314049385-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.624147 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623903    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmq4p\" (UniqueName: \"kubernetes.io/projected/a1162ece-d405-4175-a6c9-c45407f6c714-kube-api-access-nmq4p\") pod \"node-ca-kjnsg\" (UID: \"a1162ece-d405-4175-a6c9-c45407f6c714\") " pod="openshift-image-registry/node-ca-kjnsg"
Nov 04 03:16:25.624147 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623906    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54f9dc0b-7a1d-4be7-a624-fcf314049385-system-cni-dir\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.624147 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623927    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1162ece-d405-4175-a6c9-c45407f6c714-host\") pod \"node-ca-kjnsg\" (UID: \"a1162ece-d405-4175-a6c9-c45407f6c714\") " pod="openshift-image-registry/node-ca-kjnsg"
Nov 04 03:16:25.624147 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623961    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54f9dc0b-7a1d-4be7-a624-fcf314049385-cnibin\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.624147 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623968    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/02e0dd3b-a707-46be-9aee-330b572db5fe-hosts-file\") pod \"node-resolver-qcx8j\" (UID: \"02e0dd3b-a707-46be-9aee-330b572db5fe\") " pod="openshift-dns/node-resolver-qcx8j"
Nov 04 03:16:25.624147 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.623978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98748f47-73db-4d89-b237-41ddf5bfe4bf-host-slash\") pod \"iptables-alerter-v8qgg\" (UID: \"98748f47-73db-4d89-b237-41ddf5bfe4bf\") " pod="openshift-network-operator/iptables-alerter-v8qgg"
Nov 04 03:16:25.624147 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:25.623993    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 03:16:25.624147 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.624026    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98748f47-73db-4d89-b237-41ddf5bfe4bf-host-slash\") pod \"iptables-alerter-v8qgg\" (UID: \"98748f47-73db-4d89-b237-41ddf5bfe4bf\") " pod="openshift-network-operator/iptables-alerter-v8qgg"
Nov 04 03:16:25.624147 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:25.624039    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret podName:ebbc4d63-f22e-4763-89c4-e521051fd3f1 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:26.124024454 +0000 UTC m=+3.230812141 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret") pod "global-pull-secret-syncer-tnstt" (UID: "ebbc4d63-f22e-4763-89c4-e521051fd3f1") : object "kube-system"/"original-pull-secret" not registered
Nov 04 03:16:25.624147 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.624071    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54f9dc0b-7a1d-4be7-a624-fcf314049385-cnibin\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.624708 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.624675    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/54f9dc0b-7a1d-4be7-a624-fcf314049385-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.624934 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.624912    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/98748f47-73db-4d89-b237-41ddf5bfe4bf-iptables-alerter-script\") pod \"iptables-alerter-v8qgg\" (UID: \"98748f47-73db-4d89-b237-41ddf5bfe4bf\") " pod="openshift-network-operator/iptables-alerter-v8qgg"
Nov 04 03:16:25.624999 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.624934    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54f9dc0b-7a1d-4be7-a624-fcf314049385-cni-binary-copy\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.624999 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.624957    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/54f9dc0b-7a1d-4be7-a624-fcf314049385-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.690538 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.690503    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmpdn\" (UniqueName: \"kubernetes.io/projected/54f9dc0b-7a1d-4be7-a624-fcf314049385-kube-api-access-wmpdn\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.690538 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.690526    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvpq9\" (UniqueName: \"kubernetes.io/projected/02e0dd3b-a707-46be-9aee-330b572db5fe-kube-api-access-hvpq9\") pod \"node-resolver-qcx8j\" (UID: \"02e0dd3b-a707-46be-9aee-330b572db5fe\") " pod="openshift-dns/node-resolver-qcx8j"
Nov 04 03:16:25.692119 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.692092    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmq4p\" (UniqueName: \"kubernetes.io/projected/a1162ece-d405-4175-a6c9-c45407f6c714-kube-api-access-nmq4p\") pod \"node-ca-kjnsg\" (UID: \"a1162ece-d405-4175-a6c9-c45407f6c714\") " pod="openshift-image-registry/node-ca-kjnsg"
Nov 04 03:16:25.694097 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:25.694074    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 03:16:25.694225 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:25.694104    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 03:16:25.694225 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:25.694119    2579 projected.go:196] Error preparing data for projected volume kube-api-access-fqgnm for pod openshift-network-diagnostics/network-check-target-mbsd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 03:16:25.694225 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:25.694203    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm podName:31c980c0-089e-4671-bfa2-f1fcaeb70291 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:26.194178228 +0000 UTC m=+3.300965932 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fqgnm" (UniqueName: "kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm") pod "network-check-target-mbsd5" (UID: "31c980c0-089e-4671-bfa2-f1fcaeb70291") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 03:16:25.696010 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.695988    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pccrq\" (UniqueName: \"kubernetes.io/projected/98748f47-73db-4d89-b237-41ddf5bfe4bf-kube-api-access-pccrq\") pod \"iptables-alerter-v8qgg\" (UID: \"98748f47-73db-4d89-b237-41ddf5bfe4bf\") " pod="openshift-network-operator/iptables-alerter-v8qgg"
Nov 04 03:16:25.702564 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.702537    2579 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 03:16:25.708026 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.707995    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-c45lh"
Nov 04 03:16:25.712433 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.712414    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:16:25.719899 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:25.719875    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded2535b3_99cd_4eb4_9475_8fa24337d022.slice/crio-4a908224acefb3caf00a4fe16cc98d92a4d73bedc08583a9fac0ee53eeecf114 WatchSource:0}: Error finding container 4a908224acefb3caf00a4fe16cc98d92a4d73bedc08583a9fac0ee53eeecf114: Status 404 returned error can't find the container with id 4a908224acefb3caf00a4fe16cc98d92a4d73bedc08583a9fac0ee53eeecf114
Nov 04 03:16:25.722787 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:25.722745    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4977c0d1_54d6_4b30_8a86_1c3830ff0896.slice/crio-a82fa7ab5e64b1ac5b4ad9e323ce414fe9661461904034d482ff92c1412b021f WatchSource:0}: Error finding container a82fa7ab5e64b1ac5b4ad9e323ce414fe9661461904034d482ff92c1412b021f: Status 404 returned error can't find the container with id a82fa7ab5e64b1ac5b4ad9e323ce414fe9661461904034d482ff92c1412b021f
Nov 04 03:16:25.731733 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.731705    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kk42g"
Nov 04 03:16:25.741109 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.741077    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:16:25.741569 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:25.741545    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8182d407_8f91_473a_b0d9_52a9fa1f7cf1.slice/crio-5bda71248aeacb970a728ca0455ccbcfd0131fca70d2654c2d695221fcff5ab2 WatchSource:0}: Error finding container 5bda71248aeacb970a728ca0455ccbcfd0131fca70d2654c2d695221fcff5ab2: Status 404 returned error can't find the container with id 5bda71248aeacb970a728ca0455ccbcfd0131fca70d2654c2d695221fcff5ab2
Nov 04 03:16:25.743247 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.743232    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v8qgg"
Nov 04 03:16:25.746311 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.746293    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:25.747573 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.747558    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kjnsg"
Nov 04 03:16:25.751591 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.751572    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qcx8j"
Nov 04 03:16:25.753788 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:25.753763    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb8fd5b_13a9_4ee5_89c8_07cc20365113.slice/crio-d663c9a8a4f9f7150616dc0ebd79b95f2c3782542169613128ee4b06c835cedf WatchSource:0}: Error finding container d663c9a8a4f9f7150616dc0ebd79b95f2c3782542169613128ee4b06c835cedf: Status 404 returned error can't find the container with id d663c9a8a4f9f7150616dc0ebd79b95f2c3782542169613128ee4b06c835cedf
Nov 04 03:16:25.754532 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:25.754502    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98748f47_73db_4d89_b237_41ddf5bfe4bf.slice/crio-8bfbb09b49fdf6683414f5407d7e98fd2145f95c75781686d2ee2c5a8cd56a8b WatchSource:0}: Error finding container 8bfbb09b49fdf6683414f5407d7e98fd2145f95c75781686d2ee2c5a8cd56a8b: Status 404 returned error can't find the container with id 8bfbb09b49fdf6683414f5407d7e98fd2145f95c75781686d2ee2c5a8cd56a8b
Nov 04 03:16:25.758683 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:25.758610    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbaffc706_950b_4f9d_9fb2_b6d1735e7db4.slice/crio-75c575d1cde6b5e7d0a0c978817e541a5d2d1b5b887db81019630f8f09371128 WatchSource:0}: Error finding container 75c575d1cde6b5e7d0a0c978817e541a5d2d1b5b887db81019630f8f09371128: Status 404 returned error can't find the container with id 75c575d1cde6b5e7d0a0c978817e541a5d2d1b5b887db81019630f8f09371128
Nov 04 03:16:25.762096 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:25.762073    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1162ece_d405_4175_a6c9_c45407f6c714.slice/crio-c45e332dc2d6610aa8bda6016c75af61b64b668c52a473693d84673720fe09c2 WatchSource:0}: Error finding container c45e332dc2d6610aa8bda6016c75af61b64b668c52a473693d84673720fe09c2: Status 404 returned error can't find the container with id c45e332dc2d6610aa8bda6016c75af61b64b668c52a473693d84673720fe09c2
Nov 04 03:16:25.764300 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:25.764268    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02e0dd3b_a707_46be_9aee_330b572db5fe.slice/crio-86794ea5ffb1372cc4de3f73b971900f7e575adf24cfb7782c943f44ef7c7c0b WatchSource:0}: Error finding container 86794ea5ffb1372cc4de3f73b971900f7e575adf24cfb7782c943f44ef7c7c0b: Status 404 returned error can't find the container with id 86794ea5ffb1372cc4de3f73b971900f7e575adf24cfb7782c943f44ef7c7c0b
Nov 04 03:16:25.769938 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:25.769919    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:16:25.780338 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:25.780315    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54f9dc0b_7a1d_4be7_a624_fcf314049385.slice/crio-0cc31d863fc95ce28e1bed9fb552029961e2c17741f8efb7cc3466ddabcfe6d2 WatchSource:0}: Error finding container 0cc31d863fc95ce28e1bed9fb552029961e2c17741f8efb7cc3466ddabcfe6d2: Status 404 returned error can't find the container with id 0cc31d863fc95ce28e1bed9fb552029961e2c17741f8efb7cc3466ddabcfe6d2
Nov 04 03:16:26.026614 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:26.026580    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:26.026798 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:26.026752    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 03:16:26.026858 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:26.026833    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs podName:9f281309-4b53-40fd-a044-03576371eff8 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:27.026812262 +0000 UTC m=+4.133600001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs") pod "network-metrics-daemon-2qtd2" (UID: "9f281309-4b53-40fd-a044-03576371eff8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 03:16:26.127424 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:26.127329    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:26.127602 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:26.127552    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 03:16:26.127663 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:26.127614    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret podName:ebbc4d63-f22e-4763-89c4-e521051fd3f1 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:27.12759973 +0000 UTC m=+4.234387432 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret") pod "global-pull-secret-syncer-tnstt" (UID: "ebbc4d63-f22e-4763-89c4-e521051fd3f1") : object "kube-system"/"original-pull-secret" not registered
Nov 04 03:16:26.228103 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:26.228066    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqgnm\" (UniqueName: \"kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm\") pod \"network-check-target-mbsd5\" (UID: \"31c980c0-089e-4671-bfa2-f1fcaeb70291\") " pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:26.228311 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:26.228244    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 03:16:26.228311 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:26.228269    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 03:16:26.228311 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:26.228285    2579 projected.go:196] Error preparing data for projected volume kube-api-access-fqgnm for pod openshift-network-diagnostics/network-check-target-mbsd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 03:16:26.228465 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:26.228351    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm podName:31c980c0-089e-4671-bfa2-f1fcaeb70291 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:27.2283318 +0000 UTC m=+4.335119492 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fqgnm" (UniqueName: "kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm") pod "network-check-target-mbsd5" (UID: "31c980c0-089e-4671-bfa2-f1fcaeb70291") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 03:16:26.397962 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:26.397863    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t" event={"ID":"3bb8fd5b-13a9-4ee5-89c8-07cc20365113","Type":"ContainerStarted","Data":"d663c9a8a4f9f7150616dc0ebd79b95f2c3782542169613128ee4b06c835cedf"}
Nov 04 03:16:26.399484 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:26.399443    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kk42g" event={"ID":"8182d407-8f91-473a-b0d9-52a9fa1f7cf1","Type":"ContainerStarted","Data":"5bda71248aeacb970a728ca0455ccbcfd0131fca70d2654c2d695221fcff5ab2"}
Nov 04 03:16:26.401217 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:26.401181    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q6lv4" event={"ID":"4977c0d1-54d6-4b30-8a86-1c3830ff0896","Type":"ContainerStarted","Data":"a82fa7ab5e64b1ac5b4ad9e323ce414fe9661461904034d482ff92c1412b021f"}
Nov 04 03:16:26.402800 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:26.402766    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c45lh" event={"ID":"ed2535b3-99cd-4eb4-9475-8fa24337d022","Type":"ContainerStarted","Data":"4a908224acefb3caf00a4fe16cc98d92a4d73bedc08583a9fac0ee53eeecf114"}
Nov 04 03:16:26.404094 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:26.404071    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kjnsg" event={"ID":"a1162ece-d405-4175-a6c9-c45407f6c714","Type":"ContainerStarted","Data":"c45e332dc2d6610aa8bda6016c75af61b64b668c52a473693d84673720fe09c2"}
Nov 04 03:16:26.405632 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:26.405603    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v8qgg" event={"ID":"98748f47-73db-4d89-b237-41ddf5bfe4bf","Type":"ContainerStarted","Data":"8bfbb09b49fdf6683414f5407d7e98fd2145f95c75781686d2ee2c5a8cd56a8b"}
Nov 04 03:16:26.407034 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:26.407005    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zntz9" event={"ID":"54f9dc0b-7a1d-4be7-a624-fcf314049385","Type":"ContainerStarted","Data":"0cc31d863fc95ce28e1bed9fb552029961e2c17741f8efb7cc3466ddabcfe6d2"}
Nov 04 03:16:26.408382 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:26.408356    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qcx8j" event={"ID":"02e0dd3b-a707-46be-9aee-330b572db5fe","Type":"ContainerStarted","Data":"86794ea5ffb1372cc4de3f73b971900f7e575adf24cfb7782c943f44ef7c7c0b"}
Nov 04 03:16:26.409738 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:26.409708    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z" event={"ID":"baffc706-950b-4f9d-9fb2-b6d1735e7db4","Type":"ContainerStarted","Data":"75c575d1cde6b5e7d0a0c978817e541a5d2d1b5b887db81019630f8f09371128"}
Nov 04 03:16:26.503869 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:26.503798    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 03:11:25 +0000 UTC" deadline="2028-07-09 16:06:28.33293043 +0000 UTC"
Nov 04 03:16:26.503869 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:26.503866    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14724h50m1.829069549s"
Nov 04 03:16:27.036445 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:27.036380    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:27.036645 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:27.036557    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 03:16:27.036645 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:27.036631    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs podName:9f281309-4b53-40fd-a044-03576371eff8 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:29.036610458 +0000 UTC m=+6.143398171 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs") pod "network-metrics-daemon-2qtd2" (UID: "9f281309-4b53-40fd-a044-03576371eff8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 03:16:27.137838 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:27.137477    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:27.137838 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:27.137646    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 03:16:27.137838 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:27.137741    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret podName:ebbc4d63-f22e-4763-89c4-e521051fd3f1 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:29.137700065 +0000 UTC m=+6.244487755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret") pod "global-pull-secret-syncer-tnstt" (UID: "ebbc4d63-f22e-4763-89c4-e521051fd3f1") : object "kube-system"/"original-pull-secret" not registered
Nov 04 03:16:27.238246 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:27.238199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqgnm\" (UniqueName: \"kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm\") pod \"network-check-target-mbsd5\" (UID: \"31c980c0-089e-4671-bfa2-f1fcaeb70291\") " pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:27.238459 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:27.238390    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 03:16:27.238459 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:27.238415    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 03:16:27.238459 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:27.238429    2579 projected.go:196] Error preparing data for projected volume kube-api-access-fqgnm for pod openshift-network-diagnostics/network-check-target-mbsd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 03:16:27.238626 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:27.238493    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm podName:31c980c0-089e-4671-bfa2-f1fcaeb70291 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:29.238473723 +0000 UTC m=+6.345261416 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fqgnm" (UniqueName: "kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm") pod "network-check-target-mbsd5" (UID: "31c980c0-089e-4671-bfa2-f1fcaeb70291") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 03:16:27.387924 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:27.387841    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:27.388097 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:27.388005    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qtd2" podUID="9f281309-4b53-40fd-a044-03576371eff8"
Nov 04 03:16:27.388169 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:27.388103    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:27.388234 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:27.388187    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnstt" podUID="ebbc4d63-f22e-4763-89c4-e521051fd3f1"
Nov 04 03:16:27.390741 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:27.390707    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:27.390882 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:27.390847    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbsd5" podUID="31c980c0-089e-4671-bfa2-f1fcaeb70291"
Nov 04 03:16:27.504572 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:27.504520    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 03:11:25 +0000 UTC" deadline="2028-06-24 20:08:56.880038086 +0000 UTC"
Nov 04 03:16:27.504572 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:27.504567    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14368h52m29.375476262s"
Nov 04 03:16:29.054628 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:29.054358    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:29.055157 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:29.054516    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 03:16:29.055157 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:29.054755    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs podName:9f281309-4b53-40fd-a044-03576371eff8 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:33.054733574 +0000 UTC m=+10.161521277 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs") pod "network-metrics-daemon-2qtd2" (UID: "9f281309-4b53-40fd-a044-03576371eff8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 03:16:29.155326 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:29.155017    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:29.155326 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:29.155211    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 03:16:29.155326 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:29.155271    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret podName:ebbc4d63-f22e-4763-89c4-e521051fd3f1 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:33.155255864 +0000 UTC m=+10.262043551 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret") pod "global-pull-secret-syncer-tnstt" (UID: "ebbc4d63-f22e-4763-89c4-e521051fd3f1") : object "kube-system"/"original-pull-secret" not registered
Nov 04 03:16:29.255487 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:29.255446    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqgnm\" (UniqueName: \"kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm\") pod \"network-check-target-mbsd5\" (UID: \"31c980c0-089e-4671-bfa2-f1fcaeb70291\") " pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:29.255782 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:29.255713    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 03:16:29.255782 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:29.255744    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 03:16:29.255782 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:29.255759    2579 projected.go:196] Error preparing data for projected volume kube-api-access-fqgnm for pod openshift-network-diagnostics/network-check-target-mbsd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 03:16:29.256008 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:29.255833    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm podName:31c980c0-089e-4671-bfa2-f1fcaeb70291 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:33.255812287 +0000 UTC m=+10.362599999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fqgnm" (UniqueName: "kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm") pod "network-check-target-mbsd5" (UID: "31c980c0-089e-4671-bfa2-f1fcaeb70291") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 03:16:29.391494 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:29.391412    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:29.391657 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:29.391585    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qtd2" podUID="9f281309-4b53-40fd-a044-03576371eff8"
Nov 04 03:16:29.391745 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:29.391711    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:29.391836 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:29.391804    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnstt" podUID="ebbc4d63-f22e-4763-89c4-e521051fd3f1"
Nov 04 03:16:29.391887 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:29.391870    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:29.391952 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:29.391934    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbsd5" podUID="31c980c0-089e-4671-bfa2-f1fcaeb70291"
Nov 04 03:16:29.456003 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:29.455785    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal" event={"ID":"3c765b34c16910e2f80f9fa5e61a7a31","Type":"ContainerStarted","Data":"b984b8b4a916dcddcfc3f59d833bd9b0aafc55f340be75d4147f54a7a22f895a"}
Nov 04 03:16:29.465155 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:29.465118    2579 generic.go:356] "Generic (PLEG): container finished" podID="6a2b94a5dc0a9815239ea671208b14be" containerID="045e5b85f3552fffcb016d88a5024e8269fa816bc5612ce02f347ec15028c2ca" exitCode=0
Nov 04 03:16:29.465275 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:29.465172    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal" event={"ID":"6a2b94a5dc0a9815239ea671208b14be","Type":"ContainerDied","Data":"045e5b85f3552fffcb016d88a5024e8269fa816bc5612ce02f347ec15028c2ca"}
Nov 04 03:16:29.687165 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:29.687076    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal" podStartSLOduration=5.687057921 podStartE2EDuration="5.687057921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 03:16:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:16:29.571460969 +0000 UTC m=+6.678248676" watchObservedRunningTime="2026-11-04 03:16:29.687057921 +0000 UTC m=+6.793845627"
Nov 04 03:16:30.473643 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:30.472804    2579 generic.go:356] "Generic (PLEG): container finished" podID="54f9dc0b-7a1d-4be7-a624-fcf314049385" containerID="780afb9b6ae2aa69d18b61448d4ff46ef831efdf8570b36cf2059ab15e392b70" exitCode=0
Nov 04 03:16:30.473643 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:30.472907    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zntz9" event={"ID":"54f9dc0b-7a1d-4be7-a624-fcf314049385","Type":"ContainerDied","Data":"780afb9b6ae2aa69d18b61448d4ff46ef831efdf8570b36cf2059ab15e392b70"}
Nov 04 03:16:30.480434 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:30.480364    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal" event={"ID":"6a2b94a5dc0a9815239ea671208b14be","Type":"ContainerStarted","Data":"3d1afef336443f04a4d6bbbd53bf52a1ada2c85b43ffc4768ac4c0710566255c"}
Nov 04 03:16:31.389896 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:31.389862    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:31.389896 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:31.389889    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:31.389896 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:31.389893    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:31.390197 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:31.390014    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnstt" podUID="ebbc4d63-f22e-4763-89c4-e521051fd3f1"
Nov 04 03:16:31.390301 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:31.390276    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbsd5" podUID="31c980c0-089e-4671-bfa2-f1fcaeb70291"
Nov 04 03:16:31.390376 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:31.390360    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qtd2" podUID="9f281309-4b53-40fd-a044-03576371eff8"
Nov 04 03:16:31.489328 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:31.489251    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-c45lh" event={"ID":"ed2535b3-99cd-4eb4-9475-8fa24337d022","Type":"ContainerStarted","Data":"bbdae5e659e6517159b81eb381d59cdad3267465854267d2d73cf6b18244c447"}
Nov 04 03:16:31.604755 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:31.604649    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal" podStartSLOduration=6.60462935 podStartE2EDuration="6.60462935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 03:16:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:16:30.814554693 +0000 UTC m=+7.921342396" watchObservedRunningTime="2026-11-04 03:16:31.60462935 +0000 UTC m=+8.711417058"
Nov 04 03:16:31.604955 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:31.604916    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-c45lh" podStartSLOduration=3.883236223 podStartE2EDuration="8.604906756s" totalImagesPullingTime="4.721670533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:16:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:16:31.604058577 +0000 UTC m=+8.710846285" watchObservedRunningTime="2026-11-04 03:16:31.604906756 +0000 UTC m=+8.711694464"
Nov 04 03:16:32.476798 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:32.476721    2579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-c45lh"
Nov 04 03:16:32.477295 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:32.477268    2579 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-c45lh"
Nov 04 03:16:32.495401 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:32.495368    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t" event={"ID":"3bb8fd5b-13a9-4ee5-89c8-07cc20365113","Type":"ContainerStarted","Data":"b1baceedad1c2ea30d585d11be76d1c5c99d43aa2a320c8a9a28ced9f97472aa"}
Nov 04 03:16:32.498787 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:32.498753    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kjnsg" event={"ID":"a1162ece-d405-4175-a6c9-c45407f6c714","Type":"ContainerStarted","Data":"3d77dd336450c6b40ecabf57c5d210598be5a0894ce660d5c386c792d99f492c"}
Nov 04 03:16:32.707392 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:32.707329    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kjnsg" podStartSLOduration=2.850763026 podStartE2EDuration="8.707314814s" totalImagesPullingTime="5.856551788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 03:16:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:16:32.706939596 +0000 UTC m=+9.813727303" watchObservedRunningTime="2026-11-04 03:16:32.707314814 +0000 UTC m=+9.814102521"
Nov 04 03:16:33.090064 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:33.090020    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:33.090381 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:33.090247    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 03:16:33.090381 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:33.090326    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs podName:9f281309-4b53-40fd-a044-03576371eff8 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:41.090307268 +0000 UTC m=+18.197094975 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs") pod "network-metrics-daemon-2qtd2" (UID: "9f281309-4b53-40fd-a044-03576371eff8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 03:16:33.190853 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:33.190813    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:33.191082 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:33.191026    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 03:16:33.191165 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:33.191090    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret podName:ebbc4d63-f22e-4763-89c4-e521051fd3f1 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:41.191075137 +0000 UTC m=+18.297862822 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret") pod "global-pull-secret-syncer-tnstt" (UID: "ebbc4d63-f22e-4763-89c4-e521051fd3f1") : object "kube-system"/"original-pull-secret" not registered
Nov 04 03:16:33.292117 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:33.292076    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqgnm\" (UniqueName: \"kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm\") pod \"network-check-target-mbsd5\" (UID: \"31c980c0-089e-4671-bfa2-f1fcaeb70291\") " pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:33.292335 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:33.292314    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 03:16:33.292393 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:33.292342    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 03:16:33.292393 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:33.292356    2579 projected.go:196] Error preparing data for projected volume kube-api-access-fqgnm for pod openshift-network-diagnostics/network-check-target-mbsd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 03:16:33.292455 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:33.292415    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm podName:31c980c0-089e-4671-bfa2-f1fcaeb70291 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:41.292398558 +0000 UTC m=+18.399186263 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fqgnm" (UniqueName: "kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm") pod "network-check-target-mbsd5" (UID: "31c980c0-089e-4671-bfa2-f1fcaeb70291") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 03:16:33.391414 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:33.391348    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:33.391545 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:33.391480    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbsd5" podUID="31c980c0-089e-4671-bfa2-f1fcaeb70291"
Nov 04 03:16:33.391585 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:33.391554    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:33.391659 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:33.391641    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qtd2" podUID="9f281309-4b53-40fd-a044-03576371eff8"
Nov 04 03:16:33.391737 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:33.391725    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:33.391821 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:33.391805    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnstt" podUID="ebbc4d63-f22e-4763-89c4-e521051fd3f1"
Nov 04 03:16:33.508354 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:33.508315    2579 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 03:16:34.445774 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:34.445676    2579 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 04 03:16:34.520951 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:34.520917    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t" event={"ID":"3bb8fd5b-13a9-4ee5-89c8-07cc20365113","Type":"ContainerStarted","Data":"09afe2540135870a0a3e22aa78fbb0e49455bf7644bad4ff109d88f5dd573652"}
Nov 04 03:16:35.387429 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:35.387391    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:35.387605 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:35.387536    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnstt" podUID="ebbc4d63-f22e-4763-89c4-e521051fd3f1"
Nov 04 03:16:35.387661 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:35.387621    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:35.387733 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:35.387715    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbsd5" podUID="31c980c0-089e-4671-bfa2-f1fcaeb70291"
Nov 04 03:16:35.387991 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:35.387852    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:35.387991 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:35.387961    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qtd2" podUID="9f281309-4b53-40fd-a044-03576371eff8"
Nov 04 03:16:35.400428 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:35.400323    2579 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T03:16:34.445768364Z","UUID":"01c60a7b-1de6-4237-be45-9ba788453d21","Handler":null,"Name":"","Endpoint":""}
Nov 04 03:16:35.401937 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:35.401901    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 04 03:16:35.401937 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:35.401935    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 04 03:16:35.526631 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:35.526592    2579 generic.go:356] "Generic (PLEG): container finished" podID="54f9dc0b-7a1d-4be7-a624-fcf314049385" containerID="08d94cca452388950ea36067fce8106296f6f63d7ef54e1846d86c93b01273e2" exitCode=0
Nov 04 03:16:35.527091 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:35.526696    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zntz9" event={"ID":"54f9dc0b-7a1d-4be7-a624-fcf314049385","Type":"ContainerDied","Data":"08d94cca452388950ea36067fce8106296f6f63d7ef54e1846d86c93b01273e2"}
Nov 04 03:16:35.531000 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:35.530974    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qcx8j" event={"ID":"02e0dd3b-a707-46be-9aee-330b572db5fe","Type":"ContainerStarted","Data":"1028055e12578ea772491cfcdbdc2079d65e99138f10e42f3db4f40612f20bbc"}
Nov 04 03:16:35.533288 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:35.533262    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kk42g" event={"ID":"8182d407-8f91-473a-b0d9-52a9fa1f7cf1","Type":"ContainerStarted","Data":"310f322056d5f53e6369c1378bb9833170e84ded0517a41e367e9780609576bf"}
Nov 04 03:16:35.768009 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:35.767945    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-qcx8j" podStartSLOduration=3.063434595 podStartE2EDuration="11.767924556s" totalImagesPullingTime="8.704489961s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 03:16:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:16:35.767055808 +0000 UTC m=+12.873843515" watchObservedRunningTime="2026-11-04 03:16:35.767924556 +0000 UTC m=+12.874712264"
Nov 04 03:16:35.886720 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:35.885673    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-kk42g" podStartSLOduration=4.142229367 podStartE2EDuration="12.885651399s" totalImagesPullingTime="8.743422032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 03:16:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:16:35.885390572 +0000 UTC m=+12.992178291" watchObservedRunningTime="2026-11-04 03:16:35.885651399 +0000 UTC m=+12.992439107"
Nov 04 03:16:36.537915 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:36.537585    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v8qgg" event={"ID":"98748f47-73db-4d89-b237-41ddf5bfe4bf","Type":"ContainerStarted","Data":"0a2e6c671163a8f98ec99a6bb558558260f593e4ee597bf157bad325e41861de"}
Nov 04 03:16:36.541350 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:36.540474    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t" event={"ID":"3bb8fd5b-13a9-4ee5-89c8-07cc20365113","Type":"ContainerStarted","Data":"9dde44c27133e63d2069d63fa262db6b92cc38b2ba9e3c55b54d0567a30d8ea0"}
Nov 04 03:16:36.655630 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:36.655516    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v8qgg" podStartSLOduration=3.649455773 podStartE2EDuration="12.655500274s" totalImagesPullingTime="9.006044501s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 03:16:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:16:36.654982322 +0000 UTC m=+13.761770029" watchObservedRunningTime="2026-11-04 03:16:36.655500274 +0000 UTC m=+13.762288003"
Nov 04 03:16:37.387375 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:37.387290    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:37.387533 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:37.387299    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:37.387533 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:37.387433    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qtd2" podUID="9f281309-4b53-40fd-a044-03576371eff8"
Nov 04 03:16:37.387533 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:37.387300    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:37.387669 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:37.387553    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnstt" podUID="ebbc4d63-f22e-4763-89c4-e521051fd3f1"
Nov 04 03:16:37.387736 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:37.387695    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbsd5" podUID="31c980c0-089e-4671-bfa2-f1fcaeb70291"
Nov 04 03:16:37.544828 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:37.544794    2579 generic.go:356] "Generic (PLEG): container finished" podID="54f9dc0b-7a1d-4be7-a624-fcf314049385" containerID="9e0088a1c3697aaa233eff434f874ff88c5868929f8b879596a1783c70aba2cf" exitCode=0
Nov 04 03:16:37.545412 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:37.544886    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zntz9" event={"ID":"54f9dc0b-7a1d-4be7-a624-fcf314049385","Type":"ContainerDied","Data":"9e0088a1c3697aaa233eff434f874ff88c5868929f8b879596a1783c70aba2cf"}
Nov 04 03:16:37.546599 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:37.546529    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q6lv4" event={"ID":"4977c0d1-54d6-4b30-8a86-1c3830ff0896","Type":"ContainerStarted","Data":"f9f373c44a9edddacdb5773988bdb6f73b881f53769fda373ebe612fe99d6c2f"}
Nov 04 03:16:37.667245 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:37.667145    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t" podStartSLOduration=4.826707024 podStartE2EDuration="14.667129169s" totalImagesPullingTime="9.840422145s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 03:16:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:16:36.776186506 +0000 UTC m=+13.882974214" watchObservedRunningTime="2026-11-04 03:16:37.667129169 +0000 UTC m=+14.773916935"
Nov 04 03:16:37.784598 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:37.784548    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q6lv4" podStartSLOduration=3.3787774 podStartE2EDuration="14.784533039s" totalImagesPullingTime="11.405755639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 03:16:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:16:37.784494968 +0000 UTC m=+14.891282676" watchObservedRunningTime="2026-11-04 03:16:37.784533039 +0000 UTC m=+14.891320746"
Nov 04 03:16:39.388387 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:39.388244    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:39.388387 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:39.388282    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:39.388387 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:39.388259    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:39.389254 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:39.388401    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qtd2" podUID="9f281309-4b53-40fd-a044-03576371eff8"
Nov 04 03:16:39.389254 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:39.388511    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnstt" podUID="ebbc4d63-f22e-4763-89c4-e521051fd3f1"
Nov 04 03:16:39.389254 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:39.388580    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbsd5" podUID="31c980c0-089e-4671-bfa2-f1fcaeb70291"
Nov 04 03:16:39.554132 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:39.554098    2579 generic.go:356] "Generic (PLEG): container finished" podID="54f9dc0b-7a1d-4be7-a624-fcf314049385" containerID="8de357627aa23b295f8edd1a5065e52c25a7e67425b7524a56945e431bb30927" exitCode=0
Nov 04 03:16:39.554305 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:39.554165    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zntz9" event={"ID":"54f9dc0b-7a1d-4be7-a624-fcf314049385","Type":"ContainerDied","Data":"8de357627aa23b295f8edd1a5065e52c25a7e67425b7524a56945e431bb30927"}
Nov 04 03:16:41.158250 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:41.158070    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:41.158717 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:41.158223    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 03:16:41.158717 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:41.158318    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs podName:9f281309-4b53-40fd-a044-03576371eff8 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:57.158304069 +0000 UTC m=+34.265091767 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs") pod "network-metrics-daemon-2qtd2" (UID: "9f281309-4b53-40fd-a044-03576371eff8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 03:16:41.259128 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:41.259068    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:41.259323 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:41.259255    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 03:16:41.259323 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:41.259318    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret podName:ebbc4d63-f22e-4763-89c4-e521051fd3f1 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:57.259300954 +0000 UTC m=+34.366088658 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret") pod "global-pull-secret-syncer-tnstt" (UID: "ebbc4d63-f22e-4763-89c4-e521051fd3f1") : object "kube-system"/"original-pull-secret" not registered
Nov 04 03:16:41.359723 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:41.359600    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqgnm\" (UniqueName: \"kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm\") pod \"network-check-target-mbsd5\" (UID: \"31c980c0-089e-4671-bfa2-f1fcaeb70291\") " pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:41.359838 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:41.359811    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 03:16:41.359838 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:41.359831    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 03:16:41.359916 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:41.359840    2579 projected.go:196] Error preparing data for projected volume kube-api-access-fqgnm for pod openshift-network-diagnostics/network-check-target-mbsd5: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 03:16:41.359962 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:41.359909    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm podName:31c980c0-089e-4671-bfa2-f1fcaeb70291 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:57.359894382 +0000 UTC m=+34.466682076 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fqgnm" (UniqueName: "kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm") pod "network-check-target-mbsd5" (UID: "31c980c0-089e-4671-bfa2-f1fcaeb70291") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 03:16:41.387974 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:41.387948    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:41.388088 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:41.387951    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:41.388151 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:41.388082    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:41.388151 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:41.388057    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnstt" podUID="ebbc4d63-f22e-4763-89c4-e521051fd3f1"
Nov 04 03:16:41.388255 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:41.388146    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qtd2" podUID="9f281309-4b53-40fd-a044-03576371eff8"
Nov 04 03:16:41.388309 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:41.388256    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbsd5" podUID="31c980c0-089e-4671-bfa2-f1fcaeb70291"
Nov 04 03:16:41.565668 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:41.565624    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z" event={"ID":"baffc706-950b-4f9d-9fb2-b6d1735e7db4","Type":"ContainerStarted","Data":"84597062b3b38d8c5349a52f5f9fb2a30017eb6da9ea2121ad0e1c817d6f879f"}
Nov 04 03:16:41.565850 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:41.565742    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z" event={"ID":"baffc706-950b-4f9d-9fb2-b6d1735e7db4","Type":"ContainerStarted","Data":"56683810fb44930a66e0d2131cef15fbc70af64812161429d35e322e1f96c9ac"}
Nov 04 03:16:41.565850 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:41.565793    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z" event={"ID":"baffc706-950b-4f9d-9fb2-b6d1735e7db4","Type":"ContainerStarted","Data":"04b62abee0817e3bdb7f077a27256250bfdef546462399822618fe6e22ff88e7"}
Nov 04 03:16:41.565850 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:41.565839    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z" event={"ID":"baffc706-950b-4f9d-9fb2-b6d1735e7db4","Type":"ContainerStarted","Data":"68081ccb71d0d8f64abc4a2a44bd366f5db6a260604d26e3a9698f1275d18d1a"}
Nov 04 03:16:41.566030 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:41.565887    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z" event={"ID":"baffc706-950b-4f9d-9fb2-b6d1735e7db4","Type":"ContainerStarted","Data":"404c7d51ecfef11c42cb0d29d0ee523e2c2a796789ea312092b64aae284081d9"}
Nov 04 03:16:41.566030 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:41.565934    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z" event={"ID":"baffc706-950b-4f9d-9fb2-b6d1735e7db4","Type":"ContainerStarted","Data":"1980126c051c82a1aebf66333316f3982e1d5c0c7fd64b6bd170ecfc279191f2"}
Nov 04 03:16:42.570254 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:42.570070    2579 generic.go:356] "Generic (PLEG): container finished" podID="54f9dc0b-7a1d-4be7-a624-fcf314049385" containerID="86e4ea065bb378b2ee8ab36831b611ae43573e6a138f3bf7e48b5736d8a11900" exitCode=0
Nov 04 03:16:42.570254 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:42.570164    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zntz9" event={"ID":"54f9dc0b-7a1d-4be7-a624-fcf314049385","Type":"ContainerDied","Data":"86e4ea065bb378b2ee8ab36831b611ae43573e6a138f3bf7e48b5736d8a11900"}
Nov 04 03:16:43.388348 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:43.388310    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:43.388531 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:43.388408    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qtd2" podUID="9f281309-4b53-40fd-a044-03576371eff8"
Nov 04 03:16:43.388531 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:43.388498    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:43.388626 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:43.388607    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnstt" podUID="ebbc4d63-f22e-4763-89c4-e521051fd3f1"
Nov 04 03:16:43.388669 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:43.388654    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:43.388764 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:43.388746    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbsd5" podUID="31c980c0-089e-4671-bfa2-f1fcaeb70291"
Nov 04 03:16:43.575363 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:43.575333    2579 generic.go:356] "Generic (PLEG): container finished" podID="54f9dc0b-7a1d-4be7-a624-fcf314049385" containerID="faa4d9054d072a7a50aba8c2cd572a1301f6d9397406bb3ce74cf84907173562" exitCode=0
Nov 04 03:16:43.575705 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:43.575396    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zntz9" event={"ID":"54f9dc0b-7a1d-4be7-a624-fcf314049385","Type":"ContainerDied","Data":"faa4d9054d072a7a50aba8c2cd572a1301f6d9397406bb3ce74cf84907173562"}
Nov 04 03:16:44.582513 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:44.582467    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zntz9" event={"ID":"54f9dc0b-7a1d-4be7-a624-fcf314049385","Type":"ContainerStarted","Data":"d8df678a361e20bc20e886163b34cfab0c2470e6a6d8b18fef4f036e6fdcb023"}
Nov 04 03:16:44.585777 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:44.585749    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z" event={"ID":"baffc706-950b-4f9d-9fb2-b6d1735e7db4","Type":"ContainerStarted","Data":"0a9ae1e640e96afd3865768b8cf79b091061daec66d0e6b8db36c2607f2e839d"}
Nov 04 03:16:44.705705 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:44.705627    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zntz9" podStartSLOduration=7.57751646 podStartE2EDuration="20.705612075s" totalImagesPullingTime="13.128095615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 03:16:24 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:16:44.705271218 +0000 UTC m=+21.812058925" watchObservedRunningTime="2026-11-04 03:16:44.705612075 +0000 UTC m=+21.812399782"
Nov 04 03:16:45.387840 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:45.387809    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:45.388000 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:45.387843    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:45.388000 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:45.387913    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnstt" podUID="ebbc4d63-f22e-4763-89c4-e521051fd3f1"
Nov 04 03:16:45.388000 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:45.387997    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:45.388249 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:45.388092    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbsd5" podUID="31c980c0-089e-4671-bfa2-f1fcaeb70291"
Nov 04 03:16:45.388249 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:45.388188    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qtd2" podUID="9f281309-4b53-40fd-a044-03576371eff8"
Nov 04 03:16:46.552667 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:46.552622    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-c45lh"
Nov 04 03:16:46.553532 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:46.552830    2579 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 03:16:46.553532 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:46.553367    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c45lh"
Nov 04 03:16:46.593286 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:46.593247    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z" event={"ID":"baffc706-950b-4f9d-9fb2-b6d1735e7db4","Type":"ContainerStarted","Data":"fac033d43eebdfa55c18acbe715ab8582d8434ef7c2f1080b5b030cd57a0fbcf"}
Nov 04 03:16:46.875858 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:46.875752    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z" podStartSLOduration=8.525670787 podStartE2EDuration="23.87573612s" totalImagesPullingTime="15.350065333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 03:16:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:16:46.846748484 +0000 UTC m=+23.953536192" watchObservedRunningTime="2026-11-04 03:16:46.87573612 +0000 UTC m=+23.982523826"
Nov 04 03:16:47.388009 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:47.387985    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:47.388184 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:47.388004    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:47.388184 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:47.388102    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qtd2" podUID="9f281309-4b53-40fd-a044-03576371eff8"
Nov 04 03:16:47.388294 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:47.388201    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbsd5" podUID="31c980c0-089e-4671-bfa2-f1fcaeb70291"
Nov 04 03:16:47.388294 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:47.388237    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:47.388380 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:47.388319    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnstt" podUID="ebbc4d63-f22e-4763-89c4-e521051fd3f1"
Nov 04 03:16:47.596303 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:47.596275    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:47.596820 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:47.596367    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:47.596820 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:47.596408    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:47.612417 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:47.612392    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:47.612557 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:47.612523    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:16:48.354894 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:48.354580    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tnstt"]
Nov 04 03:16:48.355092 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:48.354910    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:48.355092 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:48.355030    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnstt" podUID="ebbc4d63-f22e-4763-89c4-e521051fd3f1"
Nov 04 03:16:48.355283 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:48.355259    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mbsd5"]
Nov 04 03:16:48.355387 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:48.355357    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:48.355474 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:48.355454    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbsd5" podUID="31c980c0-089e-4671-bfa2-f1fcaeb70291"
Nov 04 03:16:48.357067 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:48.357033    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2qtd2"]
Nov 04 03:16:48.357165 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:48.357113    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:48.357202 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:48.357189    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qtd2" podUID="9f281309-4b53-40fd-a044-03576371eff8"
Nov 04 03:16:50.387357 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:50.387326    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:50.387357 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:50.387349    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:50.387749 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:50.387448    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:50.387749 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:50.387457    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbsd5" podUID="31c980c0-089e-4671-bfa2-f1fcaeb70291"
Nov 04 03:16:50.387749 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:50.387555    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qtd2" podUID="9f281309-4b53-40fd-a044-03576371eff8"
Nov 04 03:16:50.387749 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:50.387627    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnstt" podUID="ebbc4d63-f22e-4763-89c4-e521051fd3f1"
Nov 04 03:16:52.387455 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:52.387415    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:52.387851 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:52.387428    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:52.387851 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:52.387548    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnstt" podUID="ebbc4d63-f22e-4763-89c4-e521051fd3f1"
Nov 04 03:16:52.387851 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:52.387438    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:52.387851 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:52.387613    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbsd5" podUID="31c980c0-089e-4671-bfa2-f1fcaeb70291"
Nov 04 03:16:52.387851 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:52.387721    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qtd2" podUID="9f281309-4b53-40fd-a044-03576371eff8"
Nov 04 03:16:54.387237 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.387198    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:54.387612 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.387205    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:54.387612 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:54.387313    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tnstt" podUID="ebbc4d63-f22e-4763-89c4-e521051fd3f1"
Nov 04 03:16:54.387612 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.387215    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:54.387612 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:54.387383    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mbsd5" podUID="31c980c0-089e-4671-bfa2-f1fcaeb70291"
Nov 04 03:16:54.387612 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:54.387448    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2qtd2" podUID="9f281309-4b53-40fd-a044-03576371eff8"
Nov 04 03:16:54.689392 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.689362    2579 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeReady"
Nov 04 03:16:54.689560 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.689514    2579 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 04 03:16:54.784907 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.784874    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-45mbz"]
Nov 04 03:16:54.786724 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.786708    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-45mbz"
Nov 04 03:16:54.787873 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.787840    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9k7j4"]
Nov 04 03:16:54.789285 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.789266    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9k7j4"
Nov 04 03:16:54.839786 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.839744    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 04 03:16:54.840003 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.839838    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 04 03:16:54.840003 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.839952    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n89nd\""
Nov 04 03:16:54.841635 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.841620    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 04 03:16:54.841807 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.841793    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-2qrjk\""
Nov 04 03:16:54.841894 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.841854    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 04 03:16:54.841938 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.841890    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 04 03:16:54.852653 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.852620    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9k7j4"]
Nov 04 03:16:54.855603 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.855581    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-45mbz"]
Nov 04 03:16:54.953451 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.953352    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69164241-41f2-49ca-aae0-660e932012df-tmp-dir\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:16:54.953451 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.953438    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/69164241-41f2-49ca-aae0-660e932012df-config-volume\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:16:54.953663 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.953466    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:16:54.953663 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.953504    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7hq6\" (UniqueName: \"kubernetes.io/projected/69164241-41f2-49ca-aae0-660e932012df-kube-api-access-n7hq6\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:16:54.953663 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.953577    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2tw9\" (UniqueName: \"kubernetes.io/projected/51469efe-bf3a-47fe-8a90-f50da95851de-kube-api-access-q2tw9\") pod \"ingress-canary-9k7j4\" (UID: \"51469efe-bf3a-47fe-8a90-f50da95851de\") " pod="openshift-ingress-canary/ingress-canary-9k7j4"
Nov 04 03:16:54.953663 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:54.953602    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51469efe-bf3a-47fe-8a90-f50da95851de-cert\") pod \"ingress-canary-9k7j4\" (UID: \"51469efe-bf3a-47fe-8a90-f50da95851de\") " pod="openshift-ingress-canary/ingress-canary-9k7j4"
Nov 04 03:16:55.054615 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:55.054571    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/69164241-41f2-49ca-aae0-660e932012df-config-volume\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:16:55.054615 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:55.054615    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:16:55.054897 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:55.054639    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7hq6\" (UniqueName: \"kubernetes.io/projected/69164241-41f2-49ca-aae0-660e932012df-kube-api-access-n7hq6\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:16:55.054897 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:55.054664    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2tw9\" (UniqueName: \"kubernetes.io/projected/51469efe-bf3a-47fe-8a90-f50da95851de-kube-api-access-q2tw9\") pod \"ingress-canary-9k7j4\" (UID: \"51469efe-bf3a-47fe-8a90-f50da95851de\") " pod="openshift-ingress-canary/ingress-canary-9k7j4"
Nov 04 03:16:55.054897 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:55.054713    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51469efe-bf3a-47fe-8a90-f50da95851de-cert\") pod \"ingress-canary-9k7j4\" (UID: \"51469efe-bf3a-47fe-8a90-f50da95851de\") " pod="openshift-ingress-canary/ingress-canary-9k7j4"
Nov 04 03:16:55.054897 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:55.054754    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 03:16:55.054897 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:55.054777    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69164241-41f2-49ca-aae0-660e932012df-tmp-dir\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:16:55.054897 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:55.054823    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls podName:69164241-41f2-49ca-aae0-660e932012df nodeName:}" failed. No retries permitted until 2026-11-04 03:16:55.554803084 +0000 UTC m=+32.661590769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls") pod "dns-default-45mbz" (UID: "69164241-41f2-49ca-aae0-660e932012df") : secret "dns-default-metrics-tls" not found
Nov 04 03:16:55.055207 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:55.055128    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69164241-41f2-49ca-aae0-660e932012df-tmp-dir\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:16:55.055321 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:55.055297    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/69164241-41f2-49ca-aae0-660e932012df-config-volume\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:16:55.058484 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:55.058457    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51469efe-bf3a-47fe-8a90-f50da95851de-cert\") pod \"ingress-canary-9k7j4\" (UID: \"51469efe-bf3a-47fe-8a90-f50da95851de\") " pod="openshift-ingress-canary/ingress-canary-9k7j4"
Nov 04 03:16:55.118548 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:55.118517    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7hq6\" (UniqueName: \"kubernetes.io/projected/69164241-41f2-49ca-aae0-660e932012df-kube-api-access-n7hq6\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:16:55.118723 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:55.118580    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2tw9\" (UniqueName: \"kubernetes.io/projected/51469efe-bf3a-47fe-8a90-f50da95851de-kube-api-access-q2tw9\") pod \"ingress-canary-9k7j4\" (UID: \"51469efe-bf3a-47fe-8a90-f50da95851de\") " pod="openshift-ingress-canary/ingress-canary-9k7j4"
Nov 04 03:16:55.402894 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:55.402810    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9k7j4"
Nov 04 03:16:55.559229 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:55.559191    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:16:55.559408 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:55.559342    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 03:16:55.559447 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:55.559418    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls podName:69164241-41f2-49ca-aae0-660e932012df nodeName:}" failed. No retries permitted until 2026-11-04 03:16:56.559401981 +0000 UTC m=+33.666189680 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls") pod "dns-default-45mbz" (UID: "69164241-41f2-49ca-aae0-660e932012df") : secret "dns-default-metrics-tls" not found
Nov 04 03:16:55.782705 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:55.782606    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9k7j4"]
Nov 04 03:16:55.786194 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:55.786165    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51469efe_bf3a_47fe_8a90_f50da95851de.slice/crio-f46b6676bd807ecafd0e0bd6b46fd767202533ee2dcca1497106595fc01aa54c WatchSource:0}: Error finding container f46b6676bd807ecafd0e0bd6b46fd767202533ee2dcca1497106595fc01aa54c: Status 404 returned error can't find the container with id f46b6676bd807ecafd0e0bd6b46fd767202533ee2dcca1497106595fc01aa54c
Nov 04 03:16:56.387899 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:56.387859    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:56.388040 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:56.387911    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:56.388040 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:56.387862    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:56.441025 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:56.440995    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 03:16:56.441025 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:56.440995    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 03:16:56.491480 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:56.491448    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 03:16:56.491666 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:56.491493    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-f24jt\""
Nov 04 03:16:56.491666 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:56.491502    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x9qdq\""
Nov 04 03:16:56.491666 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:56.491586    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 03:16:56.491666 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:56.491597    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-kfskp\""
Nov 04 03:16:56.568214 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:56.568176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:16:56.568380 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:56.568321    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 03:16:56.568435 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:56.568397    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls podName:69164241-41f2-49ca-aae0-660e932012df nodeName:}" failed. No retries permitted until 2026-11-04 03:16:58.568380456 +0000 UTC m=+35.675168146 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls") pod "dns-default-45mbz" (UID: "69164241-41f2-49ca-aae0-660e932012df") : secret "dns-default-metrics-tls" not found
Nov 04 03:16:56.616389 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:56.616358    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9k7j4" event={"ID":"51469efe-bf3a-47fe-8a90-f50da95851de","Type":"ContainerStarted","Data":"f46b6676bd807ecafd0e0bd6b46fd767202533ee2dcca1497106595fc01aa54c"}
Nov 04 03:16:57.173273 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:57.173231    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:16:57.173529 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:57.173340    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 04 03:16:57.173529 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:57.173410    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs podName:9f281309-4b53-40fd-a044-03576371eff8 nodeName:}" failed. No retries permitted until 2026-11-04 03:17:29.173393517 +0000 UTC m=+66.280181202 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs") pod "network-metrics-daemon-2qtd2" (UID: "9f281309-4b53-40fd-a044-03576371eff8") : secret "metrics-daemon-secret" not found
Nov 04 03:16:57.273588 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:57.273551    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:57.276095 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:57.276076    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:57.311949 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:57.311911    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:16:57.374252 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:57.374218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqgnm\" (UniqueName: \"kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm\") pod \"network-check-target-mbsd5\" (UID: \"31c980c0-089e-4671-bfa2-f1fcaeb70291\") " pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:57.376921 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:57.376895    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqgnm\" (UniqueName: \"kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm\") pod \"network-check-target-mbsd5\" (UID: \"31c980c0-089e-4671-bfa2-f1fcaeb70291\") " pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:57.601581 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:57.601495    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:16:57.685797 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:57.685715    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tnstt"]
Nov 04 03:16:57.689789 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:57.689761    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebbc4d63_f22e_4763_89c4_e521051fd3f1.slice/crio-024481a502bda5318b221264deddd56fe239196e97e17dce22d7f26d206bbfa5 WatchSource:0}: Error finding container 024481a502bda5318b221264deddd56fe239196e97e17dce22d7f26d206bbfa5: Status 404 returned error can't find the container with id 024481a502bda5318b221264deddd56fe239196e97e17dce22d7f26d206bbfa5
Nov 04 03:16:57.972470 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:57.972442    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mbsd5"]
Nov 04 03:16:57.975425 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:57.975388    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31c980c0_089e_4671_bfa2_f1fcaeb70291.slice/crio-333b5aeb9f5a616b6cc237efe03d1ac13f51363301a47f57b830446d15dd46c0 WatchSource:0}: Error finding container 333b5aeb9f5a616b6cc237efe03d1ac13f51363301a47f57b830446d15dd46c0: Status 404 returned error can't find the container with id 333b5aeb9f5a616b6cc237efe03d1ac13f51363301a47f57b830446d15dd46c0
Nov 04 03:16:58.584993 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:58.584956    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:16:58.585175 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:58.585157    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 03:16:58.585255 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:58.585243    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls podName:69164241-41f2-49ca-aae0-660e932012df nodeName:}" failed. No retries permitted until 2026-11-04 03:17:02.585219533 +0000 UTC m=+39.692007222 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls") pod "dns-default-45mbz" (UID: "69164241-41f2-49ca-aae0-660e932012df") : secret "dns-default-metrics-tls" not found
Nov 04 03:16:58.621978 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:58.621942    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mbsd5" event={"ID":"31c980c0-089e-4671-bfa2-f1fcaeb70291","Type":"ContainerStarted","Data":"333b5aeb9f5a616b6cc237efe03d1ac13f51363301a47f57b830446d15dd46c0"}
Nov 04 03:16:58.623127 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:58.623101    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tnstt" event={"ID":"ebbc4d63-f22e-4763-89c4-e521051fd3f1","Type":"ContainerStarted","Data":"024481a502bda5318b221264deddd56fe239196e97e17dce22d7f26d206bbfa5"}
Nov 04 03:16:58.820309 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:58.820276    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-9dc9l"]
Nov 04 03:16:58.842236 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:58.842161    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:16:58.896978 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:58.895208    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 04 03:16:58.896978 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:58.895278    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 04 03:16:58.896978 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:58.895356    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 04 03:16:58.947447 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:58.945857    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 04 03:16:58.947447 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:58.946140    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xmpr4\""
Nov 04 03:16:58.947707 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:58.947579    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9dc9l"]
Nov 04 03:16:58.988561 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:58.988527    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-data-volume\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:16:58.988762 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:58.988653    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-crio-socket\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:16:58.988762 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:58.988704    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzcjs\" (UniqueName: \"kubernetes.io/projected/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-api-access-zzcjs\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:16:58.988886 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:58.988808    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:16:58.988886 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:58.988849    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:16:59.075612 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.074727    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-8d87g-rnfgg"]
Nov 04 03:16:59.089938 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.089902    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:16:59.090133 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.089987    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-data-volume\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:16:59.090133 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.090031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-crio-socket\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:16:59.090133 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.090058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzcjs\" (UniqueName: \"kubernetes.io/projected/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-api-access-zzcjs\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:16:59.090133 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.090094    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:16:59.090325 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:59.090195    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 03:16:59.090325 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:59.090272    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-rbac-proxy-cm podName:4e405c69-f5d0-4877-9f96-0ad5e6de5af5 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:59.590250866 +0000 UTC m=+36.697038567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9dc9l" (UID: "4e405c69-f5d0-4877-9f96-0ad5e6de5af5") : configmap "kube-rbac-proxy" not found
Nov 04 03:16:59.090718 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:59.090623    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 03:16:59.090845 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:59.090776    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls podName:4e405c69-f5d0-4877-9f96-0ad5e6de5af5 nodeName:}" failed. No retries permitted until 2026-11-04 03:16:59.59075499 +0000 UTC m=+36.697542682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9dc9l" (UID: "4e405c69-f5d0-4877-9f96-0ad5e6de5af5") : secret "insights-runtime-extractor-tls" not found
Nov 04 03:16:59.090845 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.090625    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-crio-socket\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:16:59.090976 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.090839    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-data-volume\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:16:59.095783 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.094981    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:16:59.138567 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.138530    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-8d87g-rnfgg"]
Nov 04 03:16:59.148332 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.148305    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-57t69\""
Nov 04 03:16:59.148498 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.148406    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 04 03:16:59.190875 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.190741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-service-ca-bundle\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:16:59.191063 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.190934    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-trusted-ca-bundle\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:16:59.191125 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.191062    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-archives-path\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:16:59.191125 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.191118    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfk4b\" (UniqueName: \"kubernetes.io/projected/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-kube-api-access-lfk4b\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:16:59.237003 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.236971    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 04 03:16:59.239622 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.239590    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzcjs\" (UniqueName: \"kubernetes.io/projected/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-api-access-zzcjs\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:16:59.292187 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.292146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-archives-path\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:16:59.292370 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.292219    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfk4b\" (UniqueName: \"kubernetes.io/projected/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-kube-api-access-lfk4b\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:16:59.292370 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.292281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-service-ca-bundle\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:16:59.292370 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.292330    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-trusted-ca-bundle\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:16:59.293101 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.292723    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-archives-path\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:16:59.293101 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.293055    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-service-ca-bundle\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:16:59.293251 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.293200    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-trusted-ca-bundle\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:16:59.361247 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.361176    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfk4b\" (UniqueName: \"kubernetes.io/projected/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-kube-api-access-lfk4b\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:16:59.429930 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.429890    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:16:59.596292 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.596260    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:16:59.596292 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.596303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:16:59.596491 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:59.596436    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 03:16:59.596525 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:59.596496    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls podName:4e405c69-f5d0-4877-9f96-0ad5e6de5af5 nodeName:}" failed. No retries permitted until 2026-11-04 03:17:00.596482734 +0000 UTC m=+37.703270420 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9dc9l" (UID: "4e405c69-f5d0-4877-9f96-0ad5e6de5af5") : secret "insights-runtime-extractor-tls" not found
Nov 04 03:16:59.596771 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:59.596648    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 03:16:59.596771 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:16:59.596734    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-rbac-proxy-cm podName:4e405c69-f5d0-4877-9f96-0ad5e6de5af5 nodeName:}" failed. No retries permitted until 2026-11-04 03:17:00.596714557 +0000 UTC m=+37.703502261 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9dc9l" (UID: "4e405c69-f5d0-4877-9f96-0ad5e6de5af5") : configmap "kube-rbac-proxy" not found
Nov 04 03:16:59.845547 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.845463    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-8d87g-rnfgg"]
Nov 04 03:16:59.849055 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.848155    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-chhd6"]
Nov 04 03:16:59.849473 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:16:59.849448    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de009d7_8e66_4f15_8cd7_88cbeae44fd9.slice/crio-663f92638d76bf9a438535cfd5bc2b3f18533d2bf76731aacc4a9413907beb7c WatchSource:0}: Error finding container 663f92638d76bf9a438535cfd5bc2b3f18533d2bf76731aacc4a9413907beb7c: Status 404 returned error can't find the container with id 663f92638d76bf9a438535cfd5bc2b3f18533d2bf76731aacc4a9413907beb7c
Nov 04 03:16:59.879221 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.878332    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-chhd6"
Nov 04 03:16:59.912188 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.912157    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-chhd6"]
Nov 04 03:16:59.931225 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.931188    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 04 03:16:59.931225 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.931204    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 04 03:16:59.931447 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.931265    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-sg2zz\""
Nov 04 03:16:59.999096 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:16:59.998976    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7l9k\" (UniqueName: \"kubernetes.io/projected/9ebfd8df-bb77-40e0-af1a-9632061eec38-kube-api-access-m7l9k\") pod \"migrator-66df5d496b-chhd6\" (UID: \"9ebfd8df-bb77-40e0-af1a-9632061eec38\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-chhd6"
Nov 04 03:17:00.100323 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:00.100194    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7l9k\" (UniqueName: \"kubernetes.io/projected/9ebfd8df-bb77-40e0-af1a-9632061eec38-kube-api-access-m7l9k\") pod \"migrator-66df5d496b-chhd6\" (UID: \"9ebfd8df-bb77-40e0-af1a-9632061eec38\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-chhd6"
Nov 04 03:17:00.170341 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:00.170301    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7l9k\" (UniqueName: \"kubernetes.io/projected/9ebfd8df-bb77-40e0-af1a-9632061eec38-kube-api-access-m7l9k\") pod \"migrator-66df5d496b-chhd6\" (UID: \"9ebfd8df-bb77-40e0-af1a-9632061eec38\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-chhd6"
Nov 04 03:17:00.210227 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:00.210191    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-chhd6"
Nov 04 03:17:00.604363 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:00.604333    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:00.604553 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:00.604437    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:00.604553 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:17:00.604483    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 03:17:00.604553 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:17:00.604518    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 03:17:00.604730 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:17:00.604557    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls podName:4e405c69-f5d0-4877-9f96-0ad5e6de5af5 nodeName:}" failed. No retries permitted until 2026-11-04 03:17:02.604538174 +0000 UTC m=+39.711325886 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9dc9l" (UID: "4e405c69-f5d0-4877-9f96-0ad5e6de5af5") : secret "insights-runtime-extractor-tls" not found
Nov 04 03:17:00.604730 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:17:00.604577    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-rbac-proxy-cm podName:4e405c69-f5d0-4877-9f96-0ad5e6de5af5 nodeName:}" failed. No retries permitted until 2026-11-04 03:17:02.604567948 +0000 UTC m=+39.711355656 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9dc9l" (UID: "4e405c69-f5d0-4877-9f96-0ad5e6de5af5") : configmap "kube-rbac-proxy" not found
Nov 04 03:17:00.605577 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:00.605556    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-chhd6"]
Nov 04 03:17:00.627632 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:17:00.627595    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ebfd8df_bb77_40e0_af1a_9632061eec38.slice/crio-decb0a975e7e0d64e8bcb194a1ee812f041a9178727fcfe59a5668ceebe170b4 WatchSource:0}: Error finding container decb0a975e7e0d64e8bcb194a1ee812f041a9178727fcfe59a5668ceebe170b4: Status 404 returned error can't find the container with id decb0a975e7e0d64e8bcb194a1ee812f041a9178727fcfe59a5668ceebe170b4
Nov 04 03:17:00.632206 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:00.632151    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-8d87g-rnfgg" event={"ID":"6de009d7-8e66-4f15-8cd7-88cbeae44fd9","Type":"ContainerStarted","Data":"663f92638d76bf9a438535cfd5bc2b3f18533d2bf76731aacc4a9413907beb7c"}
Nov 04 03:17:00.884348 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:00.884263    2579 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-qgp2f"]
Nov 04 03:17:00.903429 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:00.903386    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f"
Nov 04 03:17:00.948577 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:00.948538    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-qgp2f"]
Nov 04 03:17:00.963711 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:00.963665    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nvmcq\""
Nov 04 03:17:00.965808 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:00.963986    2579 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Nov 04 03:17:00.965808 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:00.965623    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Nov 04 03:17:00.965808 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:00.965725    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Nov 04 03:17:00.965808 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:00.965748    2579 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Nov 04 03:17:01.014959 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:01.014917    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1feac80c-15ce-41b5-b62b-14ddf279b515-signing-key\") pod \"service-ca-5fffc97bdf-qgp2f\" (UID: \"1feac80c-15ce-41b5-b62b-14ddf279b515\") " pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f"
Nov 04 03:17:01.015152 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:01.014986    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1feac80c-15ce-41b5-b62b-14ddf279b515-signing-cabundle\") pod \"service-ca-5fffc97bdf-qgp2f\" (UID: \"1feac80c-15ce-41b5-b62b-14ddf279b515\") " pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f"
Nov 04 03:17:01.015152 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:01.015113    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67ngj\" (UniqueName: \"kubernetes.io/projected/1feac80c-15ce-41b5-b62b-14ddf279b515-kube-api-access-67ngj\") pod \"service-ca-5fffc97bdf-qgp2f\" (UID: \"1feac80c-15ce-41b5-b62b-14ddf279b515\") " pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f"
Nov 04 03:17:01.115933 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:01.115894    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1feac80c-15ce-41b5-b62b-14ddf279b515-signing-key\") pod \"service-ca-5fffc97bdf-qgp2f\" (UID: \"1feac80c-15ce-41b5-b62b-14ddf279b515\") " pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f"
Nov 04 03:17:01.116122 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:01.115953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1feac80c-15ce-41b5-b62b-14ddf279b515-signing-cabundle\") pod \"service-ca-5fffc97bdf-qgp2f\" (UID: \"1feac80c-15ce-41b5-b62b-14ddf279b515\") " pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f"
Nov 04 03:17:01.116122 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:01.116007    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67ngj\" (UniqueName: \"kubernetes.io/projected/1feac80c-15ce-41b5-b62b-14ddf279b515-kube-api-access-67ngj\") pod \"service-ca-5fffc97bdf-qgp2f\" (UID: \"1feac80c-15ce-41b5-b62b-14ddf279b515\") " pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f"
Nov 04 03:17:01.117042 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:01.117017    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1feac80c-15ce-41b5-b62b-14ddf279b515-signing-cabundle\") pod \"service-ca-5fffc97bdf-qgp2f\" (UID: \"1feac80c-15ce-41b5-b62b-14ddf279b515\") " pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f"
Nov 04 03:17:01.118968 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:01.118919    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1feac80c-15ce-41b5-b62b-14ddf279b515-signing-key\") pod \"service-ca-5fffc97bdf-qgp2f\" (UID: \"1feac80c-15ce-41b5-b62b-14ddf279b515\") " pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f"
Nov 04 03:17:01.185508 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:01.185426    2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67ngj\" (UniqueName: \"kubernetes.io/projected/1feac80c-15ce-41b5-b62b-14ddf279b515-kube-api-access-67ngj\") pod \"service-ca-5fffc97bdf-qgp2f\" (UID: \"1feac80c-15ce-41b5-b62b-14ddf279b515\") " pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f"
Nov 04 03:17:01.229544 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:01.229477    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f"
Nov 04 03:17:01.619406 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:01.619319    2579 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-qgp2f"]
Nov 04 03:17:01.624188 ip-10-0-133-235 kubenswrapper[2579]: W1104 03:17:01.624145    2579 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1feac80c_15ce_41b5_b62b_14ddf279b515.slice/crio-907857a40f873d72644c4a05dd6f0fc0211bd65f1c11e0fc92d862700f7ec773 WatchSource:0}: Error finding container 907857a40f873d72644c4a05dd6f0fc0211bd65f1c11e0fc92d862700f7ec773: Status 404 returned error can't find the container with id 907857a40f873d72644c4a05dd6f0fc0211bd65f1c11e0fc92d862700f7ec773
Nov 04 03:17:01.636347 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:01.636317    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f" event={"ID":"1feac80c-15ce-41b5-b62b-14ddf279b515","Type":"ContainerStarted","Data":"907857a40f873d72644c4a05dd6f0fc0211bd65f1c11e0fc92d862700f7ec773"}
Nov 04 03:17:01.637767 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:01.637737    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-chhd6" event={"ID":"9ebfd8df-bb77-40e0-af1a-9632061eec38","Type":"ContainerStarted","Data":"decb0a975e7e0d64e8bcb194a1ee812f041a9178727fcfe59a5668ceebe170b4"}
Nov 04 03:17:01.639670 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:01.639646    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9k7j4" event={"ID":"51469efe-bf3a-47fe-8a90-f50da95851de","Type":"ContainerStarted","Data":"cd3faa95036429962e30444dfd6eb75b63d2d8b7764fd98357842032a8c66088"}
Nov 04 03:17:01.757352 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:01.757290    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9k7j4" podStartSLOduration=2.881694214 podStartE2EDuration="7.757267424s" totalImagesPullingTime="4.87557321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:16:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:17:01.75613532 +0000 UTC m=+38.862923033" watchObservedRunningTime="2026-11-04 03:17:01.757267424 +0000 UTC m=+38.864055123"
Nov 04 03:17:02.631322 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:02.630203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:02.631322 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:02.630277    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:02.631322 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:02.630328    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:02.631322 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:17:02.630406    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 03:17:02.631322 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:17:02.630452    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-rbac-proxy-cm podName:4e405c69-f5d0-4877-9f96-0ad5e6de5af5 nodeName:}" failed. No retries permitted until 2026-11-04 03:17:06.630436041 +0000 UTC m=+43.737223726 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-rbac-proxy-cm") pod "insights-runtime-extractor-9dc9l" (UID: "4e405c69-f5d0-4877-9f96-0ad5e6de5af5") : configmap "kube-rbac-proxy" not found
Nov 04 03:17:02.631322 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:17:02.630529    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 03:17:02.631322 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:17:02.630557    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls podName:4e405c69-f5d0-4877-9f96-0ad5e6de5af5 nodeName:}" failed. No retries permitted until 2026-11-04 03:17:06.630548437 +0000 UTC m=+43.737336121 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9dc9l" (UID: "4e405c69-f5d0-4877-9f96-0ad5e6de5af5") : secret "insights-runtime-extractor-tls" not found
Nov 04 03:17:02.631322 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:17:02.630595    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 03:17:02.631322 ip-10-0-133-235 kubenswrapper[2579]: E1104 03:17:02.630613    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls podName:69164241-41f2-49ca-aae0-660e932012df nodeName:}" failed. No retries permitted until 2026-11-04 03:17:10.630608033 +0000 UTC m=+47.737395718 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls") pod "dns-default-45mbz" (UID: "69164241-41f2-49ca-aae0-660e932012df") : secret "dns-default-metrics-tls" not found
Nov 04 03:17:03.277198 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:03.277154    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c45lh_ed2535b3-99cd-4eb4-9475-8fa24337d022/konnectivity-agent/0.log" limit=1024
Nov 04 03:17:03.585488 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:03.585452    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c45lh_ed2535b3-99cd-4eb4-9475-8fa24337d022/konnectivity-agent/0.log" limit=1024
Nov 04 03:17:03.647749 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:03.647645    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-chhd6" event={"ID":"9ebfd8df-bb77-40e0-af1a-9632061eec38","Type":"ContainerStarted","Data":"4b1cc1d90a9a630eaaec206ef2d339753f3ff698215069dab626211d6f5468cd"}
Nov 04 03:17:03.650254 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:03.650220    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mbsd5" event={"ID":"31c980c0-089e-4671-bfa2-f1fcaeb70291","Type":"ContainerStarted","Data":"dc2a579d0125562438fd8bdda7bc8fcd072b53ada52623dc5115b37ab73fc501"}
Nov 04 03:17:03.650406 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:03.650294    2579 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:17:03.652597 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:03.652243    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-8d87g-rnfgg" event={"ID":"6de009d7-8e66-4f15-8cd7-88cbeae44fd9","Type":"ContainerStarted","Data":"c03eaef5325305763f381014f34e26d83dee7454419eb721f1a254cba766e634"}
Nov 04 03:17:03.814502 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:03.814445    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-chhd6" podStartSLOduration=2.420845755 podStartE2EDuration="4.814418663s" totalImagesPullingTime="2.393572908s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:16:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:17:03.764012409 +0000 UTC m=+40.870800107" watchObservedRunningTime="2026-11-04 03:17:03.814418663 +0000 UTC m=+40.921206367"
Nov 04 03:17:03.881040 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:03.880976    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mbsd5" podStartSLOduration=35.231211372 podStartE2EDuration="39.880956071s" totalImagesPullingTime="4.649744699s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:16:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:17:03.880458024 +0000 UTC m=+40.987245732" watchObservedRunningTime="2026-11-04 03:17:03.880956071 +0000 UTC m=+40.987743781"
Nov 04 03:17:03.900588 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:03.900505    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-c45lh_ed2535b3-99cd-4eb4-9475-8fa24337d022/konnectivity-agent/0.log" limit=1024
Nov 04 03:17:04.003286 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:04.003239    2579 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-8d87g-rnfgg" podStartSLOduration=1.456719154 podStartE2EDuration="5.003221735s" totalImagesPullingTime="3.546502581s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:16:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:17:04.002799756 +0000 UTC m=+41.109587469" watchObservedRunningTime="2026-11-04 03:17:04.003221735 +0000 UTC m=+41.110009433"
Nov 04 03:17:04.657767 ip-10-0-133-235 kubenswrapper[2579]: I1104 03:17:04.656738    2579 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tnstt" event={"ID":"ebbc4d63-f22e-4763-89c4-e521051fd3f1","Type":"ContainerStarted","Data":"fffc857a708b86026b316c8998cbff0884da0faffb95a4029818cf85b0203c23"}
Nov 04 03:17:04.678860 ip-10-0-133-235 systemd[1]: Stopping Kubernetes Kubelet...
Nov 04 03:17:04.691133 ip-10-0-133-235 systemd[1]: kubelet.service: Deactivated successfully.
Nov 04 03:17:04.691309 ip-10-0-133-235 systemd[1]: Stopped Kubernetes Kubelet.
Nov 04 03:17:04.691357 ip-10-0-133-235 systemd[1]: kubelet.service: Consumed 2.624s CPU time.
Nov 04 03:17:04.704397 ip-10-0-133-235 systemd[1]: Starting Kubernetes Kubelet...
Nov 04 03:17:04.779880 ip-10-0-133-235 kubenswrapper[4510]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 03:17:04.779880 ip-10-0-133-235 kubenswrapper[4510]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 04 03:17:04.779880 ip-10-0-133-235 kubenswrapper[4510]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 03:17:04.779880 ip-10-0-133-235 kubenswrapper[4510]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 03:17:04.781939 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781848    4510 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 03:17:04.781939 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781939    4510 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 03:17:04.781939 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781942    4510 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781946    4510 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781948    4510 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781951    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781955    4510 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781957    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781960    4510 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781962    4510 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781965    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781968    4510 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781971    4510 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781973    4510 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781977    4510 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781980    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781982    4510 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781985    4510 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781987    4510 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781990    4510 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781992    4510 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781995    4510 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 03:17:04.782054 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.781998    4510 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782001    4510 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782003    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782007    4510 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782010    4510 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782012    4510 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782015    4510 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782017    4510 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782020    4510 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782023    4510 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782026    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782029    4510 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782032    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782034    4510 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782039    4510 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782044    4510 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782047    4510 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782049    4510 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782052    4510 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 03:17:04.782542 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782055    4510 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782058    4510 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782061    4510 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782064    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782066    4510 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782069    4510 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782071    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782074    4510 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782077    4510 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782079    4510 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782082    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782084    4510 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782087    4510 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782090    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782093    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782096    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782099    4510 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782102    4510 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782105    4510 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782108    4510 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 03:17:04.783030 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782110    4510 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782113    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782116    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782120    4510 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782125    4510 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782129    4510 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782132    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782135    4510 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782137    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782140    4510 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782142    4510 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782145    4510 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782148    4510 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782151    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782153    4510 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782156    4510 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782158    4510 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782161    4510 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782164    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 03:17:04.783530 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782167    4510 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782169    4510 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782172    4510 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782174    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782177    4510 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782179    4510 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782182    4510 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782185    4510 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782187    4510 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782190    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782193    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782196    4510 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782199    4510 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782202    4510 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782204    4510 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782207    4510 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782210    4510 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782212    4510 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782215    4510 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782218    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 03:17:04.784034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782220    4510 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782223    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782225    4510 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782228    4510 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782230    4510 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.782234    4510 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783023    4510 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783032    4510 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783035    4510 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783039    4510 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783041    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783044    4510 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783047    4510 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783050    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783052    4510 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783055    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783058    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783061    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783064    4510 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 03:17:04.784527 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783067    4510 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783070    4510 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783072    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783075    4510 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783078    4510 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783081    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783084    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783087    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783090    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783093    4510 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783096    4510 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783098    4510 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783101    4510 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783103    4510 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783106    4510 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783108    4510 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783111    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783114    4510 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783116    4510 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783119    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 03:17:04.785102 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783121    4510 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783124    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783126    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783129    4510 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783132    4510 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783134    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783137    4510 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783139    4510 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783142    4510 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783144    4510 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783147    4510 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783149    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783152    4510 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783154    4510 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783157    4510 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783159    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783162    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783164    4510 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783172    4510 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 03:17:04.785662 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783176    4510 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783180    4510 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783183    4510 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783192    4510 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783196    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783198    4510 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783201    4510 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783204    4510 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783207    4510 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783210    4510 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783212    4510 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783215    4510 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783218    4510 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783220    4510 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783223    4510 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783225    4510 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783232    4510 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783234    4510 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783237    4510 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783240    4510 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 03:17:04.786176 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783243    4510 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783245    4510 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783248    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783250    4510 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783253    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783256    4510 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783258    4510 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783261    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783263    4510 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783266    4510 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783269    4510 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783271    4510 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783275    4510 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783279    4510 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783281    4510 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783284    4510 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783286    4510 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783289    4510 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783291    4510 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 03:17:04.786663 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783296    4510 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783299    4510 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783303    4510 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783306    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783309    4510 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783311    4510 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783314    4510 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783316    4510 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783319    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783322    4510 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783325    4510 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783327    4510 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783330    4510 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783332    4510 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783335    4510 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783859    4510 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783866    4510 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783869    4510 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783871    4510 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783874    4510 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 03:17:04.787153 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783877    4510 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783879    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783882    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783885    4510 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783888    4510 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783891    4510 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783894    4510 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783897    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783900    4510 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783902    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783905    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783909    4510 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783911    4510 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783914    4510 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783916    4510 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783919    4510 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783922    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783924    4510 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783927    4510 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783929    4510 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 03:17:04.787641 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783932    4510 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783937    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783940    4510 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783942    4510 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783945    4510 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783947    4510 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783950    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783952    4510 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783955    4510 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783957    4510 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783962    4510 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783965    4510 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783967    4510 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783970    4510 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783973    4510 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783976    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783978    4510 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783981    4510 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783984    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783987    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 03:17:04.788155 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783990    4510 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783992    4510 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783995    4510 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.783997    4510 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784000    4510 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784002    4510 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784005    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784007    4510 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784010    4510 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784012    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784016    4510 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784018    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784021    4510 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784026    4510 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784028    4510 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784031    4510 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784034    4510 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784036    4510 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784041    4510 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 03:17:04.788635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784045    4510 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784048    4510 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784051    4510 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784055    4510 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784058    4510 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784060    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784063    4510 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784066    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784068    4510 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784071    4510 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784073    4510 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784076    4510 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784079    4510 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784081    4510 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784084    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784086    4510 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784089    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784091    4510 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784094    4510 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784096    4510 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 03:17:04.789117 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784099    4510 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784102    4510 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784104    4510 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784107    4510 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784109    4510 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784112    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784115    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784117    4510 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784120    4510 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784122    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784125    4510 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784127    4510 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784130    4510 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784132    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784135    4510 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784137    4510 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784142    4510 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784145    4510 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784148    4510 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 03:17:04.789612 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784151    4510 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784154    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784156    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784255    4510 flags.go:64] FLAG: --address="0.0.0.0"
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784264    4510 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784273    4510 flags.go:64] FLAG: --anonymous-auth="true"
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784282    4510 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784290    4510 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784295    4510 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784299    4510 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784304    4510 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784307    4510 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784310    4510 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784314    4510 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784317    4510 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784320    4510 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784323    4510 flags.go:64] FLAG: --cgroup-root=""
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784327    4510 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784330    4510 flags.go:64] FLAG: --client-ca-file=""
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784334    4510 flags.go:64] FLAG: --cloud-provider="external"
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784337    4510 flags.go:64] FLAG: --cluster-dns="[]"
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784342    4510 flags.go:64] FLAG: --cluster-domain=""
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784345    4510 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 04 03:17:04.790090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784349    4510 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784352    4510 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784356    4510 flags.go:64] FLAG: --container-log-max-files="5"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784360    4510 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784363    4510 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784366    4510 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784370    4510 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784373    4510 flags.go:64] FLAG: --contention-profiling="false"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784376    4510 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784378    4510 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784382    4510 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784385    4510 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784389    4510 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784392    4510 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784395    4510 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784398    4510 flags.go:64] FLAG: --enable-load-reader="false"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784402    4510 flags.go:64] FLAG: --enable-server="true"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784405    4510 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784409    4510 flags.go:64] FLAG: --event-burst="100"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784413    4510 flags.go:64] FLAG: --event-qps="50"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784415    4510 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784419    4510 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784422    4510 flags.go:64] FLAG: --eviction-hard=""
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784426    4510 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 04 03:17:04.790792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784429    4510 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784432    4510 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784435    4510 flags.go:64] FLAG: --eviction-soft=""
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784439    4510 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784442    4510 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784445    4510 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784448    4510 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784451    4510 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784454    4510 flags.go:64] FLAG: --fail-swap-on="true"
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784457    4510 flags.go:64] FLAG: --feature-gates=""
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784464    4510 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784467    4510 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784471    4510 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784474    4510 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784477    4510 flags.go:64] FLAG: --healthz-port="10248"
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784481    4510 flags.go:64] FLAG: --help="false"
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784484    4510 flags.go:64] FLAG: --hostname-override="ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784487    4510 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784490    4510 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784493    4510 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784497    4510 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784500    4510 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784503    4510 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 04 03:17:04.791428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784506    4510 flags.go:64] FLAG: --image-service-endpoint=""
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784509    4510 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784513    4510 flags.go:64] FLAG: --kube-api-burst="100"
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784516    4510 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784519    4510 flags.go:64] FLAG: --kube-api-qps="50"
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784522    4510 flags.go:64] FLAG: --kube-reserved=""
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784525    4510 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784528    4510 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784532    4510 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784535    4510 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784538    4510 flags.go:64] FLAG: --lock-file=""
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784541    4510 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784544    4510 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784547    4510 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784552    4510 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784555    4510 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784558    4510 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784563    4510 flags.go:64] FLAG: --logging-format="text"
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784566    4510 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784570    4510 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784573    4510 flags.go:64] FLAG: --manifest-url=""
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784576    4510 flags.go:64] FLAG: --manifest-url-header=""
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784581    4510 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784584    4510 flags.go:64] FLAG: --max-open-files="1000000"
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784588    4510 flags.go:64] FLAG: --max-pods="110"
Nov 04 03:17:04.792239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784591    4510 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784594    4510 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784597    4510 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784600    4510 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784603    4510 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784606    4510 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784611    4510 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784619    4510 flags.go:64] FLAG: --node-status-max-images="50"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784623    4510 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784626    4510 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784630    4510 flags.go:64] FLAG: --pod-cidr=""
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784633    4510 flags.go:64] FLAG: --pod-manifest-path=""
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784637    4510 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784640    4510 flags.go:64] FLAG: --pods-per-core="0"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784642    4510 flags.go:64] FLAG: --port="10250"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784646    4510 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784649    4510 flags.go:64] FLAG: --provider-id="aws:///us-west-1a/i-0ba3612a1b2fc9019"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784652    4510 flags.go:64] FLAG: --qos-reserved=""
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784655    4510 flags.go:64] FLAG: --read-only-port="10255"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784658    4510 flags.go:64] FLAG: --register-node="true"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784661    4510 flags.go:64] FLAG: --register-with-taints=""
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784665    4510 flags.go:64] FLAG: --registry-burst="10"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784668    4510 flags.go:64] FLAG: --registry-qps="5"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784671    4510 flags.go:64] FLAG: --reserved-cpus=""
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784690    4510 flags.go:64] FLAG: --reserved-memory=""
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784695    4510 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 04 03:17:04.793093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784698    4510 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784701    4510 flags.go:64] FLAG: --rotate-certificates="false"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784704    4510 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784708    4510 flags.go:64] FLAG: --runonce="false"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784711    4510 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784714    4510 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784717    4510 flags.go:64] FLAG: --seccomp-default="false"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784720    4510 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784723    4510 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784726    4510 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784730    4510 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784733    4510 flags.go:64] FLAG: --storage-driver-password="root"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784737    4510 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784740    4510 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784743    4510 flags.go:64] FLAG: --storage-driver-user="root"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784746    4510 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784749    4510 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784753    4510 flags.go:64] FLAG: --system-cgroups=""
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784756    4510 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784762    4510 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784765    4510 flags.go:64] FLAG: --tls-cert-file=""
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784768    4510 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784773    4510 flags.go:64] FLAG: --tls-min-version=""
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784777    4510 flags.go:64] FLAG: --tls-private-key-file=""
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784782    4510 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 04 03:17:04.793799 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784786    4510 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784791    4510 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784797    4510 flags.go:64] FLAG: --v="2"
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784802    4510 flags.go:64] FLAG: --version="false"
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784806    4510 flags.go:64] FLAG: --vmodule=""
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784814    4510 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.784817    4510 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784983    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784990    4510 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.784995    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785000    4510 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785004    4510 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785008    4510 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785013    4510 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785017    4510 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785021    4510 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785026    4510 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785030    4510 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785034    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785041    4510 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785045    4510 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 03:17:04.794437 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785050    4510 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785054    4510 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785058    4510 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785063    4510 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785068    4510 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785073    4510 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785077    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785081    4510 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785086    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785090    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785095    4510 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785099    4510 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785103    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785108    4510 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785113    4510 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785118    4510 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785124    4510 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785129    4510 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785134    4510 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 03:17:04.795283 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785138    4510 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785142    4510 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785146    4510 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785151    4510 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785155    4510 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785159    4510 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785164    4510 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785168    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785173    4510 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785177    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785185    4510 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785193    4510 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785198    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785203    4510 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785208    4510 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785212    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785216    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785221    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785227    4510 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 03:17:04.795865 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785231    4510 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785236    4510 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785240    4510 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785244    4510 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785248    4510 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785252    4510 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785257    4510 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785262    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785266    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785270    4510 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785276    4510 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785280    4510 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785284    4510 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785289    4510 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785293    4510 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785297    4510 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785302    4510 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785307    4510 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785311    4510 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785316    4510 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 03:17:04.796494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785320    4510 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785325    4510 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785328    4510 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785331    4510 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785336    4510 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785339    4510 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785342    4510 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785344    4510 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785347    4510 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785351    4510 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785355    4510 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785360    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785365    4510 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785368    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785371    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785373    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785376    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785379    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785382    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785384    4510 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 03:17:04.797077 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785388    4510 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 03:17:04.797694 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785390    4510 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 03:17:04.797694 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785394    4510 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 03:17:04.797694 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785397    4510 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 03:17:04.797694 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785399    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 03:17:04.797694 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785402    4510 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 03:17:04.797694 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785405    4510 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 03:17:04.797694 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785407    4510 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 03:17:04.797694 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785410    4510 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 03:17:04.797694 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785414    4510 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 03:17:04.797694 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785418    4510 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 03:17:04.797694 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785420    4510 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 03:17:04.797694 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785423    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 03:17:04.797694 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785426    4510 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 03:17:04.797694 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.785465    4510 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 03:17:04.797694 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785506    4510 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 03:17:04.797694 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785513    4510 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785516    4510 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785519    4510 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785522    4510 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785525    4510 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785528    4510 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785531    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785534    4510 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785537    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785540    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785543    4510 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785546    4510 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785548    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785551    4510 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785554    4510 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785556    4510 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785559    4510 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785561    4510 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785564    4510 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 03:17:04.798209 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785568    4510 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785570    4510 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785573    4510 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785575    4510 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785578    4510 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785580    4510 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785583    4510 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785586    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785588    4510 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785591    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785595    4510 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785598    4510 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785601    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785605    4510 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785607    4510 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785610    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785612    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785615    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785618    4510 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 03:17:04.798879 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785620    4510 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785623    4510 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785625    4510 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785628    4510 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785631    4510 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785634    4510 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785636    4510 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785639    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785642    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785644    4510 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785646    4510 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785649    4510 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785652    4510 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785656    4510 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785659    4510 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785662    4510 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785665    4510 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785668    4510 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785671    4510 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785673    4510 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 03:17:04.799432 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785694    4510 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785700    4510 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785703    4510 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785705    4510 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785708    4510 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785711    4510 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785715    4510 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785718    4510 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785720    4510 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785723    4510 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785725    4510 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785728    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785731    4510 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785733    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785736    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785738    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785741    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785745    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785747    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785750    4510 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 03:17:04.800007 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785753    4510 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785755    4510 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785758    4510 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785760    4510 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785763    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785766    4510 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785769    4510 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785771    4510 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785774    4510 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785778    4510 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785781    4510 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785784    4510 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785787    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785790    4510 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785793    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785796    4510 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785798    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785800    4510 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785805    4510 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 03:17:04.800494 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785807    4510 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785810    4510 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785812    4510 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785815    4510 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785818    4510 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785821    4510 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785824    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.785826    4510 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.789760    4510 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.789778    4510 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.789797    4510 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.789802    4510 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789865    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789871    4510 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789875    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789878    4510 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789880    4510 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789883    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789886    4510 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 03:17:04.800969 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789889    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789891    4510 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789894    4510 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789898    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789901    4510 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789904    4510 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789906    4510 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789909    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789912    4510 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789914    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789918    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789921    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789923    4510 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789926    4510 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789929    4510 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789931    4510 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789934    4510 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789937    4510 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789940    4510 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789943    4510 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 03:17:04.801431 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789946    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789949    4510 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789951    4510 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789954    4510 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789956    4510 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789959    4510 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789962    4510 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789964    4510 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789967    4510 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789969    4510 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789972    4510 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789976    4510 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789980    4510 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789983    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789986    4510 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789989    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789992    4510 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789995    4510 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.789997    4510 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790000    4510 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 03:17:04.801954 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790003    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790005    4510 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790008    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790011    4510 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790014    4510 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790017    4510 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790019    4510 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790022    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790025    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790027    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790031    4510 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790035    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790038    4510 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790041    4510 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790043    4510 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790046    4510 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790049    4510 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790052    4510 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790054    4510 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 03:17:04.802442 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790056    4510 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790059    4510 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790061    4510 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790064    4510 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790067    4510 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790069    4510 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790072    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790074    4510 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790077    4510 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790080    4510 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790082    4510 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790085    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790088    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790090    4510 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790093    4510 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790096    4510 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790099    4510 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790101    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790104    4510 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 03:17:04.802950 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790107    4510 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790109    4510 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790112    4510 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790115    4510 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790117    4510 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790120    4510 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790122    4510 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790125    4510 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790127    4510 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790130    4510 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790133    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790135    4510 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790138    4510 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790140    4510 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790143    4510 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790145    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790147    4510 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790150    4510 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790152    4510 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790155    4510 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 03:17:04.803429 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790157    4510 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 03:17:04.804009 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.790185    4510 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 03:17:04.804009 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790325    4510 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 03:17:04.804009 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790329    4510 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 03:17:04.804009 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790332    4510 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 03:17:04.804009 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790335    4510 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 03:17:04.804009 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790338    4510 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 03:17:04.804009 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790341    4510 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 03:17:04.804009 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790343    4510 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 03:17:04.804009 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790346    4510 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 03:17:04.804009 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790348    4510 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 03:17:04.804009 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790351    4510 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 03:17:04.804009 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790353    4510 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 03:17:04.804009 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790356    4510 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 03:17:04.804009 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790358    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 03:17:04.804009 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790361    4510 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 03:17:04.804009 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790364    4510 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790366    4510 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790369    4510 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790371    4510 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790374    4510 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790377    4510 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790381    4510 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790384    4510 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790387    4510 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790390    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790392    4510 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790395    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790397    4510 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790399    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790402    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790405    4510 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790407    4510 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790410    4510 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790412    4510 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 03:17:04.804399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790415    4510 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790417    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790421    4510 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790423    4510 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790426    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790428    4510 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790431    4510 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790434    4510 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790436    4510 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790439    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790441    4510 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790444    4510 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790447    4510 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790449    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790452    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790454    4510 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790458    4510 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790462    4510 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790465    4510 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 03:17:04.804908 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790468    4510 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790471    4510 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790473    4510 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790476    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790478    4510 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790481    4510 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790483    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790486    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790488    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790491    4510 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790493    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790496    4510 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790499    4510 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790502    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790504    4510 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790506    4510 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790510    4510 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790512    4510 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790518    4510 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 03:17:04.805371 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790521    4510 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790524    4510 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790526    4510 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790529    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790531    4510 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790534    4510 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790537    4510 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790539    4510 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790542    4510 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790544    4510 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790547    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790549    4510 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790553    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790555    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790558    4510 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790560    4510 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790563    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790565    4510 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790568    4510 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790570    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 03:17:04.805861 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790573    4510 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 03:17:04.806493 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790575    4510 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 03:17:04.806493 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790578    4510 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 03:17:04.806493 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790580    4510 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 03:17:04.806493 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790583    4510 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 03:17:04.806493 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790586    4510 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 03:17:04.806493 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790588    4510 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 03:17:04.806493 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790591    4510 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 03:17:04.806493 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790593    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 03:17:04.806493 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790596    4510 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 03:17:04.806493 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790599    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 03:17:04.806493 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790603    4510 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 03:17:04.806493 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790606    4510 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 03:17:04.806493 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790609    4510 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 03:17:04.806493 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790611    4510 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 03:17:04.806493 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.790634    4510 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 03:17:04.806493 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790666    4510 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 03:17:04.806493 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790670    4510 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790673    4510 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790693    4510 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790697    4510 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790700    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790703    4510 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790706    4510 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790708    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790711    4510 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790714    4510 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790716    4510 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790719    4510 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790721    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790724    4510 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790727    4510 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790729    4510 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790732    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790734    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790737    4510 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 03:17:04.806964 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790741    4510 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790746    4510 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790749    4510 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790752    4510 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790755    4510 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790757    4510 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790760    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790763    4510 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790768    4510 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790771    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790773    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790776    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790779    4510 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790782    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790785    4510 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790788    4510 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790790    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790793    4510 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790796    4510 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 03:17:04.807459 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790799    4510 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790802    4510 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790804    4510 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790807    4510 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790810    4510 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790813    4510 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790815    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790818    4510 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790820    4510 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790823    4510 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790825    4510 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790828    4510 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790830    4510 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790833    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790836    4510 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790838    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790840    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790843    4510 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790845    4510 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790848    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 03:17:04.808079 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790851    4510 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790854    4510 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790857    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790859    4510 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790862    4510 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790864    4510 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790867    4510 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790869    4510 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790872    4510 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790874    4510 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790877    4510 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790879    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790882    4510 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790884    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790887    4510 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790889    4510 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790891    4510 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790894    4510 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790896    4510 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790899    4510 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 03:17:04.815303 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790902    4510 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790904    4510 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790907    4510 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790909    4510 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790911    4510 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790915    4510 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790918    4510 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790920    4510 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790923    4510 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790925    4510 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790928    4510 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790931    4510 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790933    4510 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790936    4510 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790939    4510 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790942    4510 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790944    4510 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790949    4510 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790953    4510 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 03:17:04.815880 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790955    4510 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 03:17:04.816399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790958    4510 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 03:17:04.816399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790961    4510 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 03:17:04.816399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790963    4510 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 03:17:04.816399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790966    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 03:17:04.816399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790969    4510 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 03:17:04.816399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790971    4510 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 03:17:04.816399 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:04.790974    4510 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 03:17:04.816399 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.791025    4510 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 04 03:17:04.816399 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.793183    4510 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 04 03:17:04.816399 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.793249    4510 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 04 03:17:04.816399 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.793440    4510 server.go:1014] "Starting client certificate rotation"
Nov 04 03:17:04.816399 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.793582    4510 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 03:17:04.816399 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.793637    4510 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 03:11:23 +0000 UTC" deadline="2028-05-06 06:02:57.773253283 +0000 UTC"
Nov 04 03:17:04.816399 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.793701    4510 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13178h45m52.979578443s"
Nov 04 03:17:04.816399 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.793985    4510 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 03:17:04.816821 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.795274    4510 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 03:17:04.816821 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.796793    4510 log.go:25] "Validated CRI v1 runtime API"
Nov 04 03:17:04.816821 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.798310    4510 log.go:25] "Validated CRI v1 image API"
Nov 04 03:17:04.816821 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.799155    4510 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 04 03:17:04.816821 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.800730    4510 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a275f15c-bdd6-46fa-877b-0103afde48b8:/dev/nvme0n1p3 bf299efb-074f-4c5d-9319-a1e0c15b2530:/dev/nvme0n1p4]
Nov 04 03:17:04.816984 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.800751    4510 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/024481a502bda5318b221264deddd56fe239196e97e17dce22d7f26d206bbfa5/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/024481a502bda5318b221264deddd56fe239196e97e17dce22d7f26d206bbfa5/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0cc31d863fc95ce28e1bed9fb552029961e2c17741f8efb7cc3466ddabcfe6d2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0cc31d863fc95ce28e1bed9fb552029961e2c17741f8efb7cc3466ddabcfe6d2/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/333b5aeb9f5a616b6cc237efe03d1ac13f51363301a47f57b830446d15dd46c0/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/333b5aeb9f5a616b6cc237efe03d1ac13f51363301a47f57b830446d15dd46c0/userdata/shm major:0 minor:210 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/4a908224acefb3caf00a4fe16cc98d92a4d73bedc08583a9fac0ee53eeecf114/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/4a908224acefb3caf00a4fe16cc98d92a4d73bedc08583a9fac0ee53eeecf114/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5bda71248aeacb970a728ca0455ccbcfd0131fca70d2654c2d695221fcff5ab2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5bda71248aeacb970a728ca0455ccbcfd0131fca70d2654c2d695221fcff5ab2/userdata/shm major:0 minor:74 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/663f92638d76bf9a438535cfd5bc2b3f18533d2bf76731aacc4a9413907beb7c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/663f92638d76bf9a438535cfd5bc2b3f18533d2bf76731aacc4a9413907beb7c/userdata/shm major:0 minor:218 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/75c575d1cde6b5e7d0a0c978817e541a5d2d1b5b887db81019630f8f09371128/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/75c575d1cde6b5e7d0a0c978817e541a5d2d1b5b887db81019630f8f09371128/userdata/shm major:0 minor:86 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/86794ea5ffb1372cc4de3f73b971900f7e575adf24cfb7782c943f44ef7c7c0b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/86794ea5ffb1372cc4de3f73b971900f7e575adf24cfb7782c943f44ef7c7c0b/userdata/shm major:0 minor:93 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8bfbb09b49fdf6683414f5407d7e98fd2145f95c75781686d2ee2c5a8cd56a8b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8bfbb09b49fdf6683414f5407d7e98fd2145f95c75781686d2ee2c5a8cd56a8b/userdata/shm major:0 minor:79 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/907857a40f873d72644c4a05dd6f0fc0211bd65f1c11e0fc92d862700f7ec773/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/907857a40f873d72644c4a05dd6f0fc0211bd65f1c11e0fc92d862700f7ec773/userdata/shm major:0 minor:235 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9fe0d4940364b1c26e3afe098b975d364a29bf80655ed90f1712bdff270cba59/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9fe0d4940364b1c26e3afe098b975d364a29bf80655ed90f1712bdff270cba59/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c45e332dc2d6610aa8bda6016c75af61b64b668c52a473693d84673720fe09c2/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c45e332dc2d6610aa8bda6016c75af61b64b668c52a473693d84673720fe09c2/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d663c9a8a4f9f7150616dc0ebd79b95f2c3782542169613128ee4b06c835cedf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d663c9a8a4f9f7150616dc0ebd79b95f2c3782542169613128ee4b06c835cedf/userdata/shm major:0 minor:78 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/decb0a975e7e0d64e8bcb194a1ee812f041a9178727fcfe59a5668ceebe170b4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/decb0a975e7e0d64e8bcb194a1ee812f041a9178727fcfe59a5668ceebe170b4/userdata/shm major:0 minor:223 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/eb28565ca200c8937d612a2816a916638b53e2d3daf1800beff39a79e6a522f4/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/eb28565ca200c8937d612a2816a916638b53e2d3daf1800beff39a79e6a522f4/userdata/shm major:0 minor:48 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f46b6676bd807ecafd0e0bd6b46fd767202533ee2dcca1497106595fc01aa54c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f46b6676bd807ecafd0e0bd6b46fd767202533ee2dcca1497106595fc01aa54c/userdata/shm major:0 minor:202 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/02e0dd3b-a707-46be-9aee-330b572db5fe/volumes/kubernetes.io~projected/kube-api-access-hvpq9:{mountpoint:/var/lib/kubelet/pods/02e0dd3b-a707-46be-9aee-330b572db5fe/volumes/kubernetes.io~projected/kube-api-access-hvpq9 major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1feac80c-15ce-41b5-b62b-14ddf279b515/volumes/kubernetes.io~projected/kube-api-access-67ngj:{mountpoint:/var/lib/kubelet/pods/1feac80c-15ce-41b5-b62b-14ddf279b515/volumes/kubernetes.io~projected/kube-api-access-67ngj major:0 minor:234 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1feac80c-15ce-41b5-b62b-14ddf279b515/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/1feac80c-15ce-41b5-b62b-14ddf279b515/volumes/kubernetes.io~secret/signing-key major:0 minor:229 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/31c980c0-089e-4671-bfa2-f1fcaeb70291/volumes/kubernetes.io~projected/kube-api-access-fqgnm:{mountpoint:/var/lib/kubelet/pods/31c980c0-089e-4671-bfa2-f1fcaeb70291/volumes/kubernetes.io~projected/kube-api-access-fqgnm major:0 minor:209 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/3bb8fd5b-13a9-4ee5-89c8-07cc20365113/volumes/kubernetes.io~projected/kube-api-access-ktsxx:{mountpoint:/var/lib/kubelet/pods/3bb8fd5b-13a9-4ee5-89c8-07cc20365113/volumes/kubernetes.io~projected/kube-api-access-ktsxx major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4977c0d1-54d6-4b30-8a86-1c3830ff0896/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/4977c0d1-54d6-4b30-8a86-1c3830ff0896/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4977c0d1-54d6-4b30-8a86-1c3830ff0896/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/4977c0d1-54d6-4b30-8a86-1c3830ff0896/volumes/kubernetes.io~empty-dir/tmp major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4977c0d1-54d6-4b30-8a86-1c3830ff0896/volumes/kubernetes.io~projected/kube-api-access-xdksf:{mountpoint:/var/lib/kubelet/pods/4977c0d1-54d6-4b30-8a86-1c3830ff0896/volumes/kubernetes.io~projected/kube-api-access-xdksf major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4e405c69-f5d0-4877-9f96-0ad5e6de5af5/volumes/kubernetes.io~projected/kube-api-access-zzcjs:{mountpoint:/var/lib/kubelet/pods/4e405c69-f5d0-4877-9f96-0ad5e6de5af5/volumes/kubernetes.io~projected/kube-api-access-zzcjs major:0 minor:216 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/51469efe-bf3a-47fe-8a90-f50da95851de/volumes/kubernetes.io~projected/kube-api-access-q2tw9:{mountpoint:/var/lib/kubelet/pods/51469efe-bf3a-47fe-8a90-f50da95851de/volumes/kubernetes.io~projected/kube-api-access-q2tw9 major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/51469efe-bf3a-47fe-8a90-f50da95851de/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/51469efe-bf3a-47fe-8a90-f50da95851de/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/54f9dc0b-7a1d-4be7-a624-fcf314049385/volumes/kubernetes.io~projected/kube-api-access-wmpdn:{mountpoint:/var/lib/kubelet/pods/54f9dc0b-7a1d-4be7-a624-fcf314049385/volumes/kubernetes.io~projected/kube-api-access-wmpdn major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/69164241-41f2-49ca-aae0-660e932012df/volumes/kubernetes.io~projected/kube-api-access-n7hq6:{mountpoint:/var/lib/kubelet/pods/69164241-41f2-49ca-aae0-660e932012df/volumes/kubernetes.io~projected/kube-api-access-n7hq6 major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6de009d7-8e66-4f15-8cd7-88cbeae44fd9/volumes/kubernetes.io~projected/kube-api-access-lfk4b:{mountpoint:/var/lib/kubelet/pods/6de009d7-8e66-4f15-8cd7-88cbeae44fd9/volumes/kubernetes.io~projected/kube-api-access-lfk4b major:0 minor:217 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8182d407-8f91-473a-b0d9-52a9fa1f7cf1/volumes/kubernetes.io~projected/kube-api-access-dklb5:{mountpoint:/var/lib/kubelet/pods/8182d407-8f91-473a-b0d9-52a9fa1f7cf1/volumes/kubernetes.io~projected/kube-api-access-dklb5 major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/98748f47-73db-4d89-b237-41ddf5bfe4bf/volumes/kubernetes.io~projected/kube-api-access-pccrq:{mountpoint:/var/lib/kubelet/pods/98748f47-73db-4d89-b237-41ddf5bfe4bf/volumes/kubernetes.io~projected/kube-api-access-pccrq major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9ebfd8df-bb77-40e0-af1a-9632061eec38/volumes/kubernetes.io~projected/kube-api-access-m7l9k:{mountpoint:/var/lib/kubelet/pods/9ebfd8df-bb77-40e0-af1a-9632061eec38/volumes/kubernetes.io~projected/kube-api-access-m7l9k major:0 minor:222 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9f281309-4b53-40fd-a044-03576371eff8/volumes/kubernetes.io~projected/kube-api-access-pgnv5:{mountpoint:/var/lib/kubelet/pods/9f281309-4b53-40fd-a044-03576371eff8/volumes/kubernetes.io~projected/kube-api-access-pgnv5 major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/a1162ece-d405-4175-a6c9-c45407f6c714/volumes/kubernetes.io~projected/kube-api-access-nmq4p:{mountpoint:/var/lib/kubelet/pods/a1162ece-d405-4175-a6c9-c45407f6c714/volumes/kubernetes.io~projected/kube-api-access-nmq4p major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/baffc706-950b-4f9d-9fb2-b6d1735e7db4/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/baffc706-950b-4f9d-9fb2-b6d1735e7db4/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/baffc706-950b-4f9d-9fb2-b6d1735e7db4/volumes/kubernetes.io~projected/kube-api-access-f2zr8:{mountpoint:/var/lib/kubelet/pods/baffc706-950b-4f9d-9fb2-b6d1735e7db4/volumes/kubernetes.io~projected/kube-api-access-f2zr8 major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/baffc706-950b-4f9d-9fb2-b6d1735e7db4/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/baffc706-950b-4f9d-9fb2-b6d1735e7db4/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ebbc4d63-f22e-4763-89c4-e521051fd3f1/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/ebbc4d63-f22e-4763-89c4-e521051fd3f1/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:206 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ed2535b3-99cd-4eb4-9475-8fa24337d022/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/ed2535b3-99cd-4eb4-9475-8fa24337d022/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/11d328ab494617947393f42b076734e75bc7411017585d60cb9dc9d0deee45b4/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/400c549a8d5b20aa8173637b5c470ae46599d94724da30361a7971b72962673e/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/a50c35570035e78b41da0ce0c4d82b2ceddd04ade5685d1c0062a3615eb6978e/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-110:{mountpoint:/var/lib/containers/storage/overlay/ac6ba8d9e4c469fe8616c49d901252a9a6bd69fb1533aa705585c10bfc200d0b/merged major:0 minor:110 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/a8fd24c04acccd5b346bb9aa755b2f8363784964f2b48a069c3bb3abf7421f6e/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/aafe2cddea534a67cb6aef72b672db85d2e17244ece1f491c6361625e7e1b036/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/195b9a95b97e98cd0a1444c1fe9199cc681fc10e1908e5cbc3893a63fb8805cf/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/66de760b502c685e2c0620a80c9e75c8a795ca662eb997971479044d3462c337/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/d20ac281b803ecb70a9db34a9e8322b66807e202fe9d739a59347b18fab9e9e3/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/c138744b94d93b9a0d1a16ea86d4a2a06945681736d6bd70716ecf7f9e67bad5/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-142:{mountpoint:/var/lib/containers/storage/overlay/26b443e7d5307f7896f12ef9a2a37c0b08d22b019ce682e780d6d067cb6d6422/merged major:0 minor:142 fsType:overlay blockSize:0} overlay_0-146:{mountpoint:/var/lib/containers/storage/overlay/2f3898b6386a45f94fb58c12686ce3d28b1f1286dd71cb8f3f18793090c66950/merged major:0 minor:146 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/9bb023644cb45f38a114a6e6a5601c4098b60c94658c7ebae51cfecf10345d2c/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-154:{mountpoint:/var/lib/containers/storage/overlay/315905458a64b31c21f1a27b7bcc0add6555cc3e5969925017ab857ff08f3937/merged major:0 minor:154 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/7bc2c14845c1590d227ac105ed137e1eb030fe69cbb5987750cec5dabd63c5fb/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/420acec935f19e2b5451d2e1af4730eaea8a6ba342a9b1d92c8c558d5e0dc000/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/d988576411813763dd48b7fcb64d4047aab49906b1213eb7bf21c9c12a665fa6/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/a021c8d68ec1cfd57884320871348f182b9e732b4f3d3bc477b02208cf2bfd44/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/2fd0fb83cbc12268a150490a556c2f2948115e5c395170b211aadf51d25351b7/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/87bdb76a583a4af86dfe2b1462c99b07c47042d47e17c45e5ccfb1361f835653/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/e58ec0e917eb4a09c1364f49e14b6c092a653fc43312c1736fd451f5ff85c018/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-204:{mountpoint:/var/lib/containers/storage/overlay/057b49c82d090fe64ac8ec3b5df00e58b9d05ae46d2c38714a948012b76a8054/merged major:0 minor:204 fsType:overlay blockSize:0} overlay_0-212:{mountpoint:/var/lib/containers/storage/overlay/1f997c1123877d13ed7c6e855493fb1faaf83edc75cf0a3a3fdd7d0da946c211/merged major:0 minor:212 fsType:overlay blockSize:0} overlay_0-214:{mountpoint:/var/lib/containers/storage/overlay/129d090accfbe71ecb7a76c9a7299c0847a6ce930d6c78de3cf39d9002df19f1/merged major:0 minor:214 fsType:overlay blockSize:0} overlay_0-220:{mountpoint:/var/lib/containers/storage/overlay/d0b50ec1d57c2a4b139e2819bb286a23ff8f577c39387ae3144f6388c93a06a4/merged major:0 minor:220 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/6a8528199eab1974ffdfca3cde6ebf857bbe305c4ae5f91dc9134fded12d575e/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-227:{mountpoint:/var/lib/containers/storage/overlay/6e50ec18f42b776a12d57f516827f7a6cdb5d157885462dfed5309580b90ee66/merged major:0 minor:227 fsType:overlay blockSize:0} overlay_0-237:{mountpoint:/var/lib/containers/storage/overlay/a51972ea05a9ef34f7b1354b7a93541c91a8b3adc4bf572a2c6a8f77797e512f/merged major:0 minor:237 fsType:overlay blockSize:0} overlay_0-239:{mountpoint:/var/lib/containers/storage/overlay/ee319831c34a6bc36b6e947bf930986d292d45c49cb4991a755561bf3c295808/merged major:0 minor:239 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/627fa996cdb26672295a20829bb5ad9fff721c18c98fa7217ffedef13232372a/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-247:{mountpoint:/var/lib/containers/storage/overlay/975f71ab122ec0e4d9500d84510e72bb10136c4546e5994dfce2e07ba8b587af/merged major:0 minor:247 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/bc1bcf7d8826d7cebbaf692a9d6b986e52bff582edf5659780dfe9bc558042a3/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-51:{mountpoint:/var/lib/containers/storage/overlay/a1e61eafcd642e616e1de665a51462dbc29255c38111bbdb065082cc1257b1e9/merged major:0 minor:51 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/6e51e02563e2e3decbd828f0c916e61a6f8e0bdd0fe1af54b5b133dc1df89d29/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/abf2b8c33b89e670c939006f76bb7ad550d6f9916e4ab01268c25fb13be303e8/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-72:{mountpoint:/var/lib/containers/storage/overlay/517dfe1c83f68cf7dfeda9742936e6f47c7d1602b4c66aa15162fe5d4e8bf921/merged major:0 minor:72 fsType:overlay blockSize:0} overlay_0-76:{mountpoint:/var/lib/containers/storage/overlay/20c30432696b39e493bf25839aaa8df873c47f187431f7505429bad87cb18e1d/merged major:0 minor:76 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/33227c4d9f0ecf30d29eeb57f0b112bfab8bf276a2f5a012e648717318dd2c2d/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-84:{mountpoint:/var/lib/containers/storage/overlay/d45839537152e07b9c57af627c4faa58ea49f48a79d80965ec15e79101936cb8/merged major:0 minor:84 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/80319fa667671437329a719f76764cdd028ad2a87245d123e301d0b775f7495b/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/5f3e1d9e9c4098aee13a0922993a685ef7a47be7f8aa301a723c381403775c8d/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/309aab2e28c58833faea36f5b42eb75be877ddda0846f2d1ac2897c842566e76/merged major:0 minor:96 fsType:overlay blockSize:0}]
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.807732    4510 manager.go:217] Machine: {Timestamp:2026-11-04 03:17:04.807262757 +0000 UTC m=+0.071137054 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3105846 MemoryCapacity:32812019712 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2468c3e2e5d5cc54c30da3843aceab SystemUUID:ec2468c3-e2e5-d5cc-54c3-0da3843aceab BootID:45a119ba-dc46-43f9-bb80-eb1b17d63a22 Filesystems:[{Device:overlay_0-84 DeviceMajor:0 DeviceMinor:84 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/75c575d1cde6b5e7d0a0c978817e541a5d2d1b5b887db81019630f8f09371128/userdata/shm DeviceMajor:0 DeviceMinor:86 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9fe0d4940364b1c26e3afe098b975d364a29bf80655ed90f1712bdff270cba59/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/98748f47-73db-4d89-b237-41ddf5bfe4bf/volumes/kubernetes.io~projected/kube-api-access-pccrq DeviceMajor:0 DeviceMinor:67 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-146 DeviceMajor:0 DeviceMinor:146 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6de009d7-8e66-4f15-8cd7-88cbeae44fd9/volumes/kubernetes.io~projected/kube-api-access-lfk4b DeviceMajor:0 DeviceMinor:217 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/4977c0d1-54d6-4b30-8a86-1c3830ff0896/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:56 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/8182d407-8f91-473a-b0d9-52a9fa1f7cf1/volumes/kubernetes.io~projected/kube-api-access-dklb5 DeviceMajor:0 DeviceMinor:59 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/4a908224acefb3caf00a4fe16cc98d92a4d73bedc08583a9fac0ee53eeecf114/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0cc31d863fc95ce28e1bed9fb552029961e2c17741f8efb7cc3466ddabcfe6d2/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/decb0a975e7e0d64e8bcb194a1ee812f041a9178727fcfe59a5668ceebe170b4/userdata/shm DeviceMajor:0 DeviceMinor:223 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-237 DeviceMajor:0 DeviceMinor:237 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-142 DeviceMajor:0 DeviceMinor:142 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f46b6676bd807ecafd0e0bd6b46fd767202533ee2dcca1497106595fc01aa54c/userdata/shm DeviceMajor:0 DeviceMinor:202 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/663f92638d76bf9a438535cfd5bc2b3f18533d2bf76731aacc4a9413907beb7c/userdata/shm DeviceMajor:0 DeviceMinor:218 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1feac80c-15ce-41b5-b62b-14ddf279b515/volumes/kubernetes.io~projected/kube-api-access-67ngj DeviceMajor:0 DeviceMinor:234 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/baffc706-950b-4f9d-9fb2-b6d1735e7db4/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:58 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/3bb8fd5b-13a9-4ee5-89c8-07cc20365113/volumes/kubernetes.io~projected/kube-api-access-ktsxx DeviceMajor:0 DeviceMinor:63 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/a1162ece-d405-4175-a6c9-c45407f6c714/volumes/kubernetes.io~projected/kube-api-access-nmq4p DeviceMajor:0 DeviceMinor:66 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-110 DeviceMajor:0 DeviceMinor:110 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/024481a502bda5318b221264deddd56fe239196e97e17dce22d7f26d206bbfa5/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/907857a40f873d72644c4a05dd6f0fc0211bd65f1c11e0fc92d862700f7ec773/userdata/shm DeviceMajor:0 DeviceMinor:235 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-239 DeviceMajor:0 DeviceMinor:239 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9f281309-4b53-40fd-a044-03576371eff8/volumes/kubernetes.io~projected/kube-api-access-pgnv5 DeviceMajor:0 DeviceMinor:60 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d663c9a8a4f9f7150616dc0ebd79b95f2c3782542169613128ee4b06c835cedf/userdata/shm DeviceMajor:0 DeviceMinor:78 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/51469efe-bf3a-47fe-8a90-f50da95851de/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/ebbc4d63-f22e-4763-89c4-e521051fd3f1/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:206 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/333b5aeb9f5a616b6cc237efe03d1ac13f51363301a47f57b830446d15dd46c0/userdata/shm DeviceMajor:0 DeviceMinor:210 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-212 DeviceMajor:0 DeviceMinor:212 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/baffc706-950b-4f9d-9fb2-b6d1735e7db4/volumes/kubernetes.io~projected/kube-api-access-f2zr8 DeviceMajor:0 DeviceMinor:62 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8bfbb09b49fdf6683414f5407d7e98fd2145f95c75781686d2ee2c5a8cd56a8b/userdata/shm DeviceMajor:0 DeviceMinor:79 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/31c980c0-089e-4671-bfa2-f1fcaeb70291/volumes/kubernetes.io~projected/kube-api-access-fqgnm DeviceMajor:0 DeviceMinor:209 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-227 DeviceMajor:0 DeviceMinor:227 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/eb28565ca200c8937d612a2816a916638b53e2d3daf1800beff39a79e6a522f4/userdata/shm DeviceMajor:0 DeviceMinor:48 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-51 DeviceMajor:0 DeviceMinor:51 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4977c0d1-54d6-4b30-8a86-1c3830ff0896/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:57 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-154 DeviceMajor:0 DeviceMinor:154 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4977c0d1-54d6-4b30-8a86-1c3830ff0896/volumes/kubernetes.io~projected/kube-api-access-xdksf DeviceMajor:0 DeviceMinor:61 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/54f9dc0b-7a1d-4be7-a624-fcf314049385/volumes/kubernetes.io~projected/kube-api-access-wmpdn DeviceMajor:0 DeviceMinor:64 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-76 DeviceMajor:0 DeviceMinor:76 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c45e332dc2d6610aa8bda6016c75af61b64b668c52a473693d84673720fe09c2/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/86794ea5ffb1372cc4de3f73b971900f7e575adf24cfb7782c943f44ef7c7c0b/userdata/shm DeviceMajor:0 DeviceMinor:93 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/9ebfd8df-bb77-40e0-af1a-9632061eec38/volumes/kubernetes.io~projected/kube-api-access-m7l9k DeviceMajor:0 DeviceMinor:222 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1feac80c-15ce-41b5-b62b-14ddf279b515/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:229 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/ed2535b3-99cd-4eb4-9475-8fa24337d022/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/51469efe-bf3a-47fe-8a90-f50da95851de/volumes/kubernetes.io~projected/kube-api-access-q2tw9 DeviceMajor:0 DeviceMinor:201 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/69164241-41f2-49ca-aae0-660e932012df/volumes/kubernetes.io~projected/kube-api-access-n7hq6 DeviceMajor:0 DeviceMinor:197 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-204 DeviceMajor:0 DeviceMinor:204 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-214 DeviceMajor:0 DeviceMinor:214 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/4e405c69-f5d0-4877-9f96-0ad5e6de5af5/volumes/kubernetes.io~projected/kube-api-access-zzcjs DeviceMajor:0 DeviceMinor:216 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406011904 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/02e0dd3b-a707-46be-9aee-330b572db5fe/volumes/kubernetes.io~projected/kube-api-access-hvpq9 DeviceMajor:0 DeviceMinor:65 Capacity:31633420288 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-72 DeviceMajor:0 DeviceMinor:72 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/baffc706-950b-4f9d-9fb2-b6d1735e7db4/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-220 DeviceMajor:0 DeviceMinor:220 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-247 DeviceMajor:0 DeviceMinor:247 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5bda71248aeacb970a728ca0455ccbcfd0131fca70d2654c2d695221fcff5ab2/userdata/shm DeviceMajor:0 DeviceMinor:74 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:024481a502bda53 MacAddress:42:21:4f:e9:89:9f Speed:10000 Mtu:8901} {Name:333b5aeb9f5a616 MacAddress:c6:58:43:e7:84:d0 Speed:10000 Mtu:8901} {Name:663f92638d76bf9 MacAddress:fa:f1:23:e8:3d:04 Speed:10000 Mtu:8901} {Name:907857a40f873d7 MacAddress:0a:46:3c:78:24:f7 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:30:3c:11:3e:13 Speed:0 Mtu:9001} {Name:br-int MacAddress:42:1a:1e:07:2a:55 Speed:0 Mtu:8901} {Name:decb0a975e7e0d6 MacAddress:ca:86:fc:86:ca:91 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:30:3c:11:3e:13 Speed:0 Mtu:9001} {Name:f46b6676bd807ec MacAddress:26:6e:7f:f0:b4:2d Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:ca:cd:81:3e:25:f1 Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:e6:68:46:1f:26:dd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812019712 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.808054    4510 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.808100    4510 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.808389    4510 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.808413    4510 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-235.us-west-1.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.808549    4510 topology_manager.go:143] "Creating topology manager with none policy"
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.808558    4510 container_manager_linux.go:311] "Creating device plugin manager"
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.808571    4510 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.808591    4510 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.808702    4510 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.808874    4510 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.808990    4510 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.809026    4510 kubelet.go:493] "Attempting to sync node with API server"
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.809036    4510 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.809045    4510 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.809054    4510 kubelet.go:405] "Adding apiserver pod source"
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.809062    4510 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.810149    4510 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.810168    4510 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 03:17:04.817136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.811407    4510 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 04 03:17:04.819642 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.819626    4510 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 04 03:17:04.819784 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.819643    4510 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 03:17:04.819784 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.819771    4510 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 04 03:17:04.819994 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.819982    4510 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 04 03:17:04.820034 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.820013    4510 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 04 03:17:04.820138 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.820129    4510 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 04 03:17:04.820166 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.820145    4510 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 04 03:17:04.820166 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.820151    4510 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 04 03:17:04.820166 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.820157    4510 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 04 03:17:04.820166 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.820163    4510 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 04 03:17:04.820262 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.820168    4510 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 04 03:17:04.820262 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.820175    4510 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 04 03:17:04.820262 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.820180    4510 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 04 03:17:04.820262 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.820188    4510 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 04 03:17:04.820262 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.820193    4510 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 04 03:17:04.820262 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.820208    4510 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 04 03:17:04.820262 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.820218    4510 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 04 03:17:04.820262 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.820244    4510 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 04 03:17:04.820262 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.820249    4510 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 04 03:17:04.823834 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.823820    4510 server.go:1263] "Started kubelet"
Nov 04 03:17:04.823932 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.823898    4510 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 04 03:17:04.823986 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.823933    4510 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 04 03:17:04.824041 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.824011    4510 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 04 03:17:04.824388 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.824357    4510 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 04 03:17:04.824756 ip-10-0-133-235 systemd[1]: Started Kubernetes Kubelet.
Nov 04 03:17:04.825491 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.825263    4510 server.go:317] "Adding debug handlers to kubelet server"
Nov 04 03:17:04.828845 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.826613    4510 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 04 03:17:04.828845 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.826635    4510 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 04 03:17:04.828845 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.826719    4510 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 03:11:25 +0000 UTC" deadline="2028-07-14 22:10:29.506979556 +0000 UTC"
Nov 04 03:17:04.828845 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.826754    4510 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 04 03:17:04.828845 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.826764    4510 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 04 03:17:04.828845 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:04.826780    4510 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-235.us-west-1.compute.internal\" not found"
Nov 04 03:17:04.828845 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.826754    4510 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14850h53m24.680230308s"
Nov 04 03:17:04.828845 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.827250    4510 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 04 03:17:04.828845 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.827338    4510 factory.go:55] Registering systemd factory
Nov 04 03:17:04.828845 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.827354    4510 factory.go:223] Registration of the systemd container factory successfully
Nov 04 03:17:04.828845 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.828220    4510 factory.go:153] Registering CRI-O factory
Nov 04 03:17:04.828845 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.828238    4510 factory.go:223] Registration of the crio container factory successfully
Nov 04 03:17:04.828845 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.828315    4510 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 04 03:17:04.828845 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.828351    4510 factory.go:103] Registering Raw factory
Nov 04 03:17:04.828845 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.828367    4510 manager.go:1199] Started watching for new ooms in manager
Nov 04 03:17:04.829619 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.829531    4510 manager.go:319] Starting recovery of all containers
Nov 04 03:17:04.833153 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833105    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4977c0d1-54d6-4b30-8a86-1c3830ff0896" volumeName="kubernetes.io/empty-dir/4977c0d1-54d6-4b30-8a86-1c3830ff0896-tmp" seLinuxMountContext=""
Nov 04 03:17:04.833153 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833147    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="54f9dc0b-7a1d-4be7-a624-fcf314049385" volumeName="kubernetes.io/projected/54f9dc0b-7a1d-4be7-a624-fcf314049385-kube-api-access-wmpdn" seLinuxMountContext=""
Nov 04 03:17:04.833470 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833162    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69164241-41f2-49ca-aae0-660e932012df" volumeName="kubernetes.io/empty-dir/69164241-41f2-49ca-aae0-660e932012df-tmp-dir" seLinuxMountContext=""
Nov 04 03:17:04.833470 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833172    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6de009d7-8e66-4f15-8cd7-88cbeae44fd9" volumeName="kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-trusted-ca-bundle" seLinuxMountContext=""
Nov 04 03:17:04.833470 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833187    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1162ece-d405-4175-a6c9-c45407f6c714" volumeName="kubernetes.io/projected/a1162ece-d405-4175-a6c9-c45407f6c714-kube-api-access-nmq4p" seLinuxMountContext=""
Nov 04 03:17:04.833470 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833264    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="baffc706-950b-4f9d-9fb2-b6d1735e7db4" volumeName="kubernetes.io/projected/baffc706-950b-4f9d-9fb2-b6d1735e7db4-kube-api-access-f2zr8" seLinuxMountContext=""
Nov 04 03:17:04.833470 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833309    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1feac80c-15ce-41b5-b62b-14ddf279b515" volumeName="kubernetes.io/projected/1feac80c-15ce-41b5-b62b-14ddf279b515-kube-api-access-67ngj" seLinuxMountContext=""
Nov 04 03:17:04.833470 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833334    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="54f9dc0b-7a1d-4be7-a624-fcf314049385" volumeName="kubernetes.io/configmap/54f9dc0b-7a1d-4be7-a624-fcf314049385-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 04 03:17:04.833470 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833367    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6de009d7-8e66-4f15-8cd7-88cbeae44fd9" volumeName="kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-service-ca-bundle" seLinuxMountContext=""
Nov 04 03:17:04.833470 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833388    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9f281309-4b53-40fd-a044-03576371eff8" volumeName="kubernetes.io/projected/9f281309-4b53-40fd-a044-03576371eff8-kube-api-access-pgnv5" seLinuxMountContext=""
Nov 04 03:17:04.833470 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833401    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="3bb8fd5b-13a9-4ee5-89c8-07cc20365113" volumeName="kubernetes.io/projected/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-kube-api-access-ktsxx" seLinuxMountContext=""
Nov 04 03:17:04.833944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833460    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69164241-41f2-49ca-aae0-660e932012df" volumeName="kubernetes.io/projected/69164241-41f2-49ca-aae0-660e932012df-kube-api-access-n7hq6" seLinuxMountContext=""
Nov 04 03:17:04.833944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833509    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6de009d7-8e66-4f15-8cd7-88cbeae44fd9" volumeName="kubernetes.io/projected/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-kube-api-access-lfk4b" seLinuxMountContext=""
Nov 04 03:17:04.833944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833524    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8182d407-8f91-473a-b0d9-52a9fa1f7cf1" volumeName="kubernetes.io/projected/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-kube-api-access-dklb5" seLinuxMountContext=""
Nov 04 03:17:04.833944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833606    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="a1162ece-d405-4175-a6c9-c45407f6c714" volumeName="kubernetes.io/configmap/a1162ece-d405-4175-a6c9-c45407f6c714-serviceca" seLinuxMountContext=""
Nov 04 03:17:04.833944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833623    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="baffc706-950b-4f9d-9fb2-b6d1735e7db4" volumeName="kubernetes.io/configmap/baffc706-950b-4f9d-9fb2-b6d1735e7db4-env-overrides" seLinuxMountContext=""
Nov 04 03:17:04.833944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833644    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4977c0d1-54d6-4b30-8a86-1c3830ff0896" volumeName="kubernetes.io/projected/4977c0d1-54d6-4b30-8a86-1c3830ff0896-kube-api-access-xdksf" seLinuxMountContext=""
Nov 04 03:17:04.833944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833723    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="51469efe-bf3a-47fe-8a90-f50da95851de" volumeName="kubernetes.io/secret/51469efe-bf3a-47fe-8a90-f50da95851de-cert" seLinuxMountContext=""
Nov 04 03:17:04.833944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833774    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="54f9dc0b-7a1d-4be7-a624-fcf314049385" volumeName="kubernetes.io/configmap/54f9dc0b-7a1d-4be7-a624-fcf314049385-cni-binary-copy" seLinuxMountContext=""
Nov 04 03:17:04.833944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833826    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8182d407-8f91-473a-b0d9-52a9fa1f7cf1" volumeName="kubernetes.io/configmap/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-daemon-config" seLinuxMountContext=""
Nov 04 03:17:04.834323 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833949    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4e405c69-f5d0-4877-9f96-0ad5e6de5af5" volumeName="kubernetes.io/empty-dir/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-data-volume" seLinuxMountContext=""
Nov 04 03:17:04.834323 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.833980    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="51469efe-bf3a-47fe-8a90-f50da95851de" volumeName="kubernetes.io/projected/51469efe-bf3a-47fe-8a90-f50da95851de-kube-api-access-q2tw9" seLinuxMountContext=""
Nov 04 03:17:04.834323 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834002    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6de009d7-8e66-4f15-8cd7-88cbeae44fd9" volumeName="kubernetes.io/empty-dir/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-archives-path" seLinuxMountContext=""
Nov 04 03:17:04.834323 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834043    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98748f47-73db-4d89-b237-41ddf5bfe4bf" volumeName="kubernetes.io/configmap/98748f47-73db-4d89-b237-41ddf5bfe4bf-iptables-alerter-script" seLinuxMountContext=""
Nov 04 03:17:04.834323 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834061    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ebbc4d63-f22e-4763-89c4-e521051fd3f1" volumeName="kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret" seLinuxMountContext=""
Nov 04 03:17:04.834323 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834084    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="02e0dd3b-a707-46be-9aee-330b572db5fe" volumeName="kubernetes.io/empty-dir/02e0dd3b-a707-46be-9aee-330b572db5fe-tmp-dir" seLinuxMountContext=""
Nov 04 03:17:04.834323 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834139    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1feac80c-15ce-41b5-b62b-14ddf279b515" volumeName="kubernetes.io/secret/1feac80c-15ce-41b5-b62b-14ddf279b515-signing-key" seLinuxMountContext=""
Nov 04 03:17:04.834323 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834163    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="31c980c0-089e-4671-bfa2-f1fcaeb70291" volumeName="kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm" seLinuxMountContext=""
Nov 04 03:17:04.834323 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834203    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4e405c69-f5d0-4877-9f96-0ad5e6de5af5" volumeName="kubernetes.io/projected/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-api-access-zzcjs" seLinuxMountContext=""
Nov 04 03:17:04.834323 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834236    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="54f9dc0b-7a1d-4be7-a624-fcf314049385" volumeName="kubernetes.io/configmap/54f9dc0b-7a1d-4be7-a624-fcf314049385-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 04 03:17:04.834323 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834265    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed2535b3-99cd-4eb4-9475-8fa24337d022" volumeName="kubernetes.io/secret/ed2535b3-99cd-4eb4-9475-8fa24337d022-agent-certs" seLinuxMountContext=""
Nov 04 03:17:04.834323 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834283    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="69164241-41f2-49ca-aae0-660e932012df" volumeName="kubernetes.io/configmap/69164241-41f2-49ca-aae0-660e932012df-config-volume" seLinuxMountContext=""
Nov 04 03:17:04.834323 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834308    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9ebfd8df-bb77-40e0-af1a-9632061eec38" volumeName="kubernetes.io/projected/9ebfd8df-bb77-40e0-af1a-9632061eec38-kube-api-access-m7l9k" seLinuxMountContext=""
Nov 04 03:17:04.834767 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834326    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="baffc706-950b-4f9d-9fb2-b6d1735e7db4" volumeName="kubernetes.io/configmap/baffc706-950b-4f9d-9fb2-b6d1735e7db4-ovnkube-config" seLinuxMountContext=""
Nov 04 03:17:04.834767 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834378    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ed2535b3-99cd-4eb4-9475-8fa24337d022" volumeName="kubernetes.io/configmap/ed2535b3-99cd-4eb4-9475-8fa24337d022-konnectivity-ca" seLinuxMountContext=""
Nov 04 03:17:04.834767 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834403    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="02e0dd3b-a707-46be-9aee-330b572db5fe" volumeName="kubernetes.io/projected/02e0dd3b-a707-46be-9aee-330b572db5fe-kube-api-access-hvpq9" seLinuxMountContext=""
Nov 04 03:17:04.834767 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834439    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1feac80c-15ce-41b5-b62b-14ddf279b515" volumeName="kubernetes.io/configmap/1feac80c-15ce-41b5-b62b-14ddf279b515-signing-cabundle" seLinuxMountContext=""
Nov 04 03:17:04.834767 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834461    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="98748f47-73db-4d89-b237-41ddf5bfe4bf" volumeName="kubernetes.io/projected/98748f47-73db-4d89-b237-41ddf5bfe4bf-kube-api-access-pccrq" seLinuxMountContext=""
Nov 04 03:17:04.834767 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834483    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="baffc706-950b-4f9d-9fb2-b6d1735e7db4" volumeName="kubernetes.io/configmap/baffc706-950b-4f9d-9fb2-b6d1735e7db4-ovnkube-script-lib" seLinuxMountContext=""
Nov 04 03:17:04.834767 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834499    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="baffc706-950b-4f9d-9fb2-b6d1735e7db4" volumeName="kubernetes.io/secret/baffc706-950b-4f9d-9fb2-b6d1735e7db4-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 04 03:17:04.834767 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834520    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8182d407-8f91-473a-b0d9-52a9fa1f7cf1" volumeName="kubernetes.io/configmap/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-cni-binary-copy" seLinuxMountContext=""
Nov 04 03:17:04.834767 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834534    4510 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4977c0d1-54d6-4b30-8a86-1c3830ff0896" volumeName="kubernetes.io/empty-dir/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-tuned" seLinuxMountContext=""
Nov 04 03:17:04.834767 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834548    4510 reconstruct.go:97] "Volume reconstruction finished"
Nov 04 03:17:04.834767 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.834557    4510 reconciler.go:29] "Reconciler: start to sync state"
Nov 04 03:17:04.853836 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.853798    4510 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 04 03:17:04.855383 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.855361    4510 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 04 03:17:04.855383 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.855382    4510 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 04 03:17:04.855576 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.855400    4510 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 04 03:17:04.855576 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:04.855440    4510 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 04 03:17:04.864292 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.864239    4510 generic.go:356] "Generic (PLEG): container finished" podID="54f9dc0b-7a1d-4be7-a624-fcf314049385" containerID="faa4d9054d072a7a50aba8c2cd572a1301f6d9397406bb3ce74cf84907173562" exitCode=0
Nov 04 03:17:04.864292 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.864289    4510 generic.go:356] "Generic (PLEG): container finished" podID="54f9dc0b-7a1d-4be7-a624-fcf314049385" containerID="86e4ea065bb378b2ee8ab36831b611ae43573e6a138f3bf7e48b5736d8a11900" exitCode=0
Nov 04 03:17:04.864485 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.864301    4510 generic.go:356] "Generic (PLEG): container finished" podID="54f9dc0b-7a1d-4be7-a624-fcf314049385" containerID="8de357627aa23b295f8edd1a5065e52c25a7e67425b7524a56945e431bb30927" exitCode=0
Nov 04 03:17:04.864485 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.864311    4510 generic.go:356] "Generic (PLEG): container finished" podID="54f9dc0b-7a1d-4be7-a624-fcf314049385" containerID="9e0088a1c3697aaa233eff434f874ff88c5868929f8b879596a1783c70aba2cf" exitCode=0
Nov 04 03:17:04.864485 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.864319    4510 generic.go:356] "Generic (PLEG): container finished" podID="54f9dc0b-7a1d-4be7-a624-fcf314049385" containerID="08d94cca452388950ea36067fce8106296f6f63d7ef54e1846d86c93b01273e2" exitCode=0
Nov 04 03:17:04.864485 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.864329    4510 generic.go:356] "Generic (PLEG): container finished" podID="54f9dc0b-7a1d-4be7-a624-fcf314049385" containerID="780afb9b6ae2aa69d18b61448d4ff46ef831efdf8570b36cf2059ab15e392b70" exitCode=0
Nov 04 03:17:04.891274 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.891239    4510 generic.go:356] "Generic (PLEG): container finished" podID="6a2b94a5dc0a9815239ea671208b14be" containerID="045e5b85f3552fffcb016d88a5024e8269fa816bc5612ce02f347ec15028c2ca" exitCode=0
Nov 04 03:17:04.905007 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.904981    4510 manager.go:324] Recovery completed
Nov 04 03:17:04.919608 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.919534    4510 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 03:17:04.920782 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.920763    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 03:17:04.920876 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.920795    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 03:17:04.920876 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.920808    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 03:17:04.922215 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.922199    4510 cpu_manager.go:226] "Starting" policy="none"
Nov 04 03:17:04.922215 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.922212    4510 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 04 03:17:04.922336 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.922216    4510 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 03:17:04.922336 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.922228    4510 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 04 03:17:04.922417 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.922342    4510 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 04 03:17:04.922417 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.922353    4510 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 04 03:17:04.922417 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.922371    4510 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 04 03:17:04.922417 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.922387    4510 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 04 03:17:04.922417 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.922392    4510 policy_none.go:50] "Start"
Nov 04 03:17:04.922417 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.922401    4510 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 04 03:17:04.922417 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.922409    4510 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 04 03:17:04.922651 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.922533    4510 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 04 03:17:04.922651 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.922539    4510 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 04 03:17:04.922651 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.922545    4510 policy_none.go:44] "Start"
Nov 04 03:17:04.923101 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.923081    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 03:17:04.923184 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.923117    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 03:17:04.923184 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.923132    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 03:17:04.926511 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.926471    4510 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 04 03:17:04.927014 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:04.926983    4510 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-133-235.us-west-1.compute.internal\" not found"
Nov 04 03:17:04.929620 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.929603    4510 manager.go:341] "Starting Device Plugin manager"
Nov 04 03:17:04.929738 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:04.929629    4510 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 04 03:17:04.929738 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.929639    4510 server.go:87] "Starting device plugin registration server"
Nov 04 03:17:04.929983 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.929968    4510 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 04 03:17:04.930044 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.929983    4510 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 04 03:17:04.930096 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.930058    4510 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 04 03:17:04.930191 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.930155    4510 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 04 03:17:04.930243 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.930203    4510 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 04 03:17:04.930243 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.930210    4510 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 04 03:17:04.930340 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.930242    4510 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T03:17:04.930188048Z","UUID":"f9714f5a-a621-4df3-895d-62ed7cffb2fa","Handler":null,"Name":"","Endpoint":""}
Nov 04 03:17:04.931605 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.931587    4510 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 04 03:17:04.931731 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.931617    4510 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 04 03:17:04.932169 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:04.932148    4510 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 04 03:17:04.932252 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:04.932189    4510 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-235.us-west-1.compute.internal\" not found"
Nov 04 03:17:04.956201 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.956146    4510 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal"]
Nov 04 03:17:04.956341 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.956281    4510 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 03:17:04.957336 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.957318    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 03:17:04.957427 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.957349    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 03:17:04.957427 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.957363    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 03:17:04.957627 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.957616    4510 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 03:17:04.957815 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.957800    4510 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 03:17:04.958422 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.958404    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 03:17:04.958515 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.958432    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 03:17:04.958515 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.958446    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 03:17:04.958515 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.958477    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 03:17:04.958515 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.958495    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 03:17:04.958515 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.958503    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 03:17:04.958771 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:04.958630    4510 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-235.us-west-1.compute.internal\" not found" node="ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:04.958771 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.958736    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal" event={"ID":"3c765b34c16910e2f80f9fa5e61a7a31","Type":"ContainerStarted","Data":"b984b8b4a916dcddcfc3f59d833bd9b0aafc55f340be75d4147f54a7a22f895a"}
Nov 04 03:17:04.958771 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.958769    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal" event={"ID":"3c765b34c16910e2f80f9fa5e61a7a31","Type":"ContainerStarted","Data":"9fe0d4940364b1c26e3afe098b975d364a29bf80655ed90f1712bdff270cba59"}
Nov 04 03:17:04.958870 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.958803    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal" event={"ID":"6a2b94a5dc0a9815239ea671208b14be","Type":"ContainerStarted","Data":"3d1afef336443f04a4d6bbbd53bf52a1ada2c85b43ffc4768ac4c0710566255c"}
Nov 04 03:17:04.958870 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.958809    4510 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 03:17:04.958870 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.958815    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal" event={"ID":"6a2b94a5dc0a9815239ea671208b14be","Type":"ContainerDied","Data":"045e5b85f3552fffcb016d88a5024e8269fa816bc5612ce02f347ec15028c2ca"}
Nov 04 03:17:04.958870 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.958828    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal" event={"ID":"6a2b94a5dc0a9815239ea671208b14be","Type":"ContainerStarted","Data":"eb28565ca200c8937d612a2816a916638b53e2d3daf1800beff39a79e6a522f4"}
Nov 04 03:17:04.959582 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.959566    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 03:17:04.959634 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.959592    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 03:17:04.959634 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:04.959602    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 03:17:04.959772 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:04.959760    4510 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-235.us-west-1.compute.internal\" not found" node="ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.020788 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.020755    4510 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 03:17:05.020968 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.020912    4510 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 03:17:05.021908 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.021893    4510 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 03:17:05.022016 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.021999    4510 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 04 03:17:05.027034 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.027019    4510 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.030073 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.030044    4510 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 03:17:05.031387 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.031372    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientMemory"
Nov 04 03:17:05.031442 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.031405    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 03:17:05.031442 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.031420    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeHasSufficientPID"
Nov 04 03:17:05.031515 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.031455    4510 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.072155 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.072122    4510 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 03:17:05.089812 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.089778    4510 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 03:17:05.089998 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:05.089840    4510 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.089998 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.089857    4510 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.123132 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.123095    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a2b94a5dc0a9815239ea671208b14be-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal\" (UID: \"6a2b94a5dc0a9815239ea671208b14be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.123132 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.123130    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c765b34c16910e2f80f9fa5e61a7a31-config\") pod \"kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal\" (UID: \"3c765b34c16910e2f80f9fa5e61a7a31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.123325 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.123149    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a2b94a5dc0a9815239ea671208b14be-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal\" (UID: \"6a2b94a5dc0a9815239ea671208b14be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.149319 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.149285    4510 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 03:17:05.149486 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:05.149340    4510 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.172305 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.172233    4510 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.172426 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.172313    4510 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.172934 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.172914    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeNotReady"
Nov 04 03:17:05.173006 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.172948    4510 setters.go:546] "Node became not ready" node="ip-10-0-133-235.us-west-1.compute.internal" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-11-04T03:17:05Z","lastTransitionTime":"2026-11-04T03:17:05Z","reason":"KubeletNotReady","message":"CSINode is not yet initialized"}
Nov 04 03:17:05.186131 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.186095    4510 nodeinfomanager.go:471] existing CSINode "ip-10-0-133-235.us-west-1.compute.internal" is owned by different node (oldNodeID="2897047e-6855-4590-b4b6-e309d8f336e0", newNodeID=""), cleaning up...
Nov 04 03:17:05.224321 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.224286    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a2b94a5dc0a9815239ea671208b14be-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal\" (UID: \"6a2b94a5dc0a9815239ea671208b14be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.224321 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.224324    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c765b34c16910e2f80f9fa5e61a7a31-config\") pod \"kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal\" (UID: \"3c765b34c16910e2f80f9fa5e61a7a31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.224493 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.224340    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a2b94a5dc0a9815239ea671208b14be-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal\" (UID: \"6a2b94a5dc0a9815239ea671208b14be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.224493 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.224412    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3c765b34c16910e2f80f9fa5e61a7a31-config\") pod \"kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal\" (UID: \"3c765b34c16910e2f80f9fa5e61a7a31\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.224493 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.224438    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a2b94a5dc0a9815239ea671208b14be-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal\" (UID: \"6a2b94a5dc0a9815239ea671208b14be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.224493 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.224410    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6a2b94a5dc0a9815239ea671208b14be-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal\" (UID: \"6a2b94a5dc0a9815239ea671208b14be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.810169 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.810136    4510 apiserver.go:52] "Watching apiserver"
Nov 04 03:17:05.897755 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.897729    4510 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.897939 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.897905    4510 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.913453 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.913421    4510 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 04 03:17:05.914013 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.913989    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-8d87g-rnfgg","kube-system/konnectivity-agent-c45lh","openshift-image-registry/node-ca-kjnsg","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t","openshift-multus/network-metrics-daemon-2qtd2","openshift-kube-storage-version-migrator/migrator-66df5d496b-chhd6","openshift-cluster-node-tuning-operator/tuned-q6lv4","kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal","openshift-dns/dns-default-45mbz","openshift-dns/node-resolver-qcx8j","openshift-network-operator/iptables-alerter-v8qgg","openshift-ovn-kubernetes/ovnkube-node-lft9z","openshift-service-ca/service-ca-5fffc97bdf-qgp2f","openshift-multus/multus-kk42g","kube-system/global-pull-secret-syncer-tnstt","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal","openshift-multus/multus-additional-cni-plugins-zntz9","openshift-network-diagnostics/network-check-target-mbsd5","openshift-insights/insights-runtime-extractor-9dc9l","openshift-ingress-canary/ingress-canary-9k7j4"]
Nov 04 03:17:05.915298 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.915273    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:17:05.921223 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.921204    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:05.921921 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.921906    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:05.928858 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.928840    4510 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 04 03:17:05.967555 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.967537    4510 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 03:17:05.967672 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:05.967591    4510 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.968930 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.968916    4510 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 03:17:05.969015 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:05.968950    4510 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-235.us-west-1.compute.internal"
Nov 04 03:17:05.970869 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.970849    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 04 03:17:05.971100 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.971082    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 04 03:17:05.971179 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.971080    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-x9qdq\""
Nov 04 03:17:05.971179 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.971108    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qhl58\""
Nov 04 03:17:05.971179 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.971109    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 03:17:05.971318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.971188    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-cj8mj\""
Nov 04 03:17:05.971318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.971284    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-8nk47\""
Nov 04 03:17:05.971318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.971286    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s72nt\""
Nov 04 03:17:05.971421 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.971330    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5q5qr\""
Nov 04 03:17:05.971772 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.971755    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 04 03:17:05.971822 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.971768    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 04 03:17:05.971822 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.971787    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-ztc7x\""
Nov 04 03:17:05.971822 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.971800    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 04 03:17:05.972033 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.972019    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 04 03:17:05.972111 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.972041    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 04 03:17:05.972111 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.972051    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 04 03:17:05.972111 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.972067    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 04 03:17:05.972254 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.972123    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 04 03:17:05.972254 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.972151    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 04 03:17:05.972254 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.972246    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 04 03:17:05.972348 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.972247    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 04 03:17:05.972411 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.972396    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 04 03:17:05.972495 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.972483    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 04 03:17:05.972526 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:05.972506    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 04 03:17:06.028360 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.028326    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/baffc706-950b-4f9d-9fb2-b6d1735e7db4-env-overrides\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.028360 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.028361    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:17:06.028490 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.028380    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/69164241-41f2-49ca-aae0-660e932012df-config-volume\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:06.028490 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.028403    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-var-lib-kubelet\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.028577 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.028554    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqgnm\" (UniqueName: \"kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm\") pod \"network-check-target-mbsd5\" (UID: \"31c980c0-089e-4671-bfa2-f1fcaeb70291\") " pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:17:06.028663 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.028647    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/baffc706-950b-4f9d-9fb2-b6d1735e7db4-env-overrides\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.028769 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.028755    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-slash\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.028808 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.028778    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-node-log\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.028878 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.028843    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-run-ovn-kubernetes\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.028924 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.028903    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-sys-fs\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.029016 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.028961    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-var-lib-cni-bin\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.029016 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.029007    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-run-multus-certs\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.029082 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.029030    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-systemd-units\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.029129 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.029081    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-run-systemd\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.029178 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.029134    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:06.029233 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.029174    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-run-netns\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.029279 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.029232    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pccrq\" (UniqueName: \"kubernetes.io/projected/98748f47-73db-4d89-b237-41ddf5bfe4bf-kube-api-access-pccrq\") pod \"iptables-alerter-v8qgg\" (UID: \"98748f47-73db-4d89-b237-41ddf5bfe4bf\") " pod="openshift-network-operator/iptables-alerter-v8qgg"
Nov 04 03:17:06.029326 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.029291    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ed2535b3-99cd-4eb4-9475-8fa24337d022-konnectivity-ca\") pod \"konnectivity-agent-c45lh\" (UID: \"ed2535b3-99cd-4eb4-9475-8fa24337d022\") " pod="kube-system/konnectivity-agent-c45lh"
Nov 04 03:17:06.029403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.029387    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-modprobe-d\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.029454 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.029412    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-sysctl-d\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.029454 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.029431    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7hq6\" (UniqueName: \"kubernetes.io/projected/69164241-41f2-49ca-aae0-660e932012df-kube-api-access-n7hq6\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:06.029454 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.029448    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-var-lib-kubelet\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.029594 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.029475    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dklb5\" (UniqueName: \"kubernetes.io/projected/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-kube-api-access-dklb5\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.029647 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.029588    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54f9dc0b-7a1d-4be7-a624-fcf314049385-system-cni-dir\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:17:06.029710 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.029649    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54f9dc0b-7a1d-4be7-a624-fcf314049385-cnibin\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:17:06.029786 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.029762    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02e0dd3b-a707-46be-9aee-330b572db5fe-tmp-dir\") pod \"node-resolver-qcx8j\" (UID: \"02e0dd3b-a707-46be-9aee-330b572db5fe\") " pod="openshift-dns/node-resolver-qcx8j"
Nov 04 03:17:06.029859 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.029844    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ed2535b3-99cd-4eb4-9475-8fa24337d022-konnectivity-ca\") pod \"konnectivity-agent-c45lh\" (UID: \"ed2535b3-99cd-4eb4-9475-8fa24337d022\") " pod="kube-system/konnectivity-agent-c45lh"
Nov 04 03:17:06.030291 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030273    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-run\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.030321 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030311    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-lib-modules\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.030355 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030335    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/02e0dd3b-a707-46be-9aee-330b572db5fe-tmp-dir\") pod \"node-resolver-qcx8j\" (UID: \"02e0dd3b-a707-46be-9aee-330b572db5fe\") " pod="openshift-dns/node-resolver-qcx8j"
Nov 04 03:17:06.030384 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030349    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-cni-binary-copy\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.030412 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030399    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvpq9\" (UniqueName: \"kubernetes.io/projected/02e0dd3b-a707-46be-9aee-330b572db5fe-kube-api-access-hvpq9\") pod \"node-resolver-qcx8j\" (UID: \"02e0dd3b-a707-46be-9aee-330b572db5fe\") " pod="openshift-dns/node-resolver-qcx8j"
Nov 04 03:17:06.030444 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030428    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98748f47-73db-4d89-b237-41ddf5bfe4bf-host-slash\") pod \"iptables-alerter-v8qgg\" (UID: \"98748f47-73db-4d89-b237-41ddf5bfe4bf\") " pod="openshift-network-operator/iptables-alerter-v8qgg"
Nov 04 03:17:06.030473 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030446    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-crio-socket\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:06.030523 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030507    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ed2535b3-99cd-4eb4-9475-8fa24337d022-agent-certs\") pod \"konnectivity-agent-c45lh\" (UID: \"ed2535b3-99cd-4eb4-9475-8fa24337d022\") " pod="kube-system/konnectivity-agent-c45lh"
Nov 04 03:17:06.030630 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030616    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdksf\" (UniqueName: \"kubernetes.io/projected/4977c0d1-54d6-4b30-8a86-1c3830ff0896-kube-api-access-xdksf\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.030730 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030713    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7l9k\" (UniqueName: \"kubernetes.io/projected/9ebfd8df-bb77-40e0-af1a-9632061eec38-kube-api-access-m7l9k\") pod \"migrator-66df5d496b-chhd6\" (UID: \"9ebfd8df-bb77-40e0-af1a-9632061eec38\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-chhd6"
Nov 04 03:17:06.030770 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030742    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-cnibin\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.030770 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030758    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-run-netns\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.030869 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030777    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-log-socket\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.030869 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030791    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-cni-netd\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.030869 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030829    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1162ece-d405-4175-a6c9-c45407f6c714-host\") pod \"node-ca-kjnsg\" (UID: \"a1162ece-d405-4175-a6c9-c45407f6c714\") " pod="openshift-image-registry/node-ca-kjnsg"
Nov 04 03:17:06.030869 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030835    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-cni-binary-copy\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.031031 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030907    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-socket-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.031031 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030948    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-device-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.031031 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030975    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-system-cni-dir\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.031031 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.030987    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ed2535b3-99cd-4eb4-9475-8fa24337d022-agent-certs\") pod \"konnectivity-agent-c45lh\" (UID: \"ed2535b3-99cd-4eb4-9475-8fa24337d022\") " pod="kube-system/konnectivity-agent-c45lh"
Nov 04 03:17:06.031031 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031012    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-data-volume\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:06.031176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031065    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzcjs\" (UniqueName: \"kubernetes.io/projected/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-api-access-zzcjs\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:06.031176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031082    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-data-volume\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:06.031176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031094    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1feac80c-15ce-41b5-b62b-14ddf279b515-signing-key\") pod \"service-ca-5fffc97bdf-qgp2f\" (UID: \"1feac80c-15ce-41b5-b62b-14ddf279b515\") " pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f"
Nov 04 03:17:06.031176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031119    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-kubelet\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.031176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031146    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.031176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031170    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/02e0dd3b-a707-46be-9aee-330b572db5fe-hosts-file\") pod \"node-resolver-qcx8j\" (UID: \"02e0dd3b-a707-46be-9aee-330b572db5fe\") " pod="openshift-dns/node-resolver-qcx8j"
Nov 04 03:17:06.031375 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031202    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-sys\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.031375 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031222    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69164241-41f2-49ca-aae0-660e932012df-tmp-dir\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:06.031375 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031295    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/69164241-41f2-49ca-aae0-660e932012df-tmp-dir\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:06.031375 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031292    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-var-lib-cni-multus\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.031375 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031323    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/54f9dc0b-7a1d-4be7-a624-fcf314049385-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:17:06.031375 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031345    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:06.031539 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031373    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-archives-path\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:17:06.031539 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031399    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-service-ca-bundle\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:17:06.031539 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031430    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-etc-selinux\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.031539 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031479    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-archives-path\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:17:06.031539 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031496    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-sysconfig\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.031539 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031519    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-kubernetes\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.031539 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031536    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/54f9dc0b-7a1d-4be7-a624-fcf314049385-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:17:06.031744 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031573    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-trusted-ca-bundle\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:17:06.031744 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031612    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-run-ovn\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.031744 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031641    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51469efe-bf3a-47fe-8a90-f50da95851de-cert\") pod \"ingress-canary-9k7j4\" (UID: \"51469efe-bf3a-47fe-8a90-f50da95851de\") " pod="openshift-ingress-canary/ingress-canary-9k7j4"
Nov 04 03:17:06.031744 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031670    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2tw9\" (UniqueName: \"kubernetes.io/projected/51469efe-bf3a-47fe-8a90-f50da95851de-kube-api-access-q2tw9\") pod \"ingress-canary-9k7j4\" (UID: \"51469efe-bf3a-47fe-8a90-f50da95851de\") " pod="openshift-ingress-canary/ingress-canary-9k7j4"
Nov 04 03:17:06.031744 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031727    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4977c0d1-54d6-4b30-8a86-1c3830ff0896-tmp\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.031889 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031751    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-cni-dir\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.031889 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031791    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-socket-dir-parent\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.031889 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031821    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4977c0d1-54d6-4b30-8a86-1c3830ff0896-tmp\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.031889 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031852    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-hostroot\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.031998 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031883    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-etc-kubernetes\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.031998 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031917    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-cni-bin\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.031998 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031943    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/baffc706-950b-4f9d-9fb2-b6d1735e7db4-ovnkube-config\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.031998 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.031981    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/baffc706-950b-4f9d-9fb2-b6d1735e7db4-ovn-node-metrics-cert\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.032102 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032094    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-tuned\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.032130 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032123    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/baffc706-950b-4f9d-9fb2-b6d1735e7db4-ovnkube-config\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.032172 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032157    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-run-openvswitch\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.032207 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032182    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-tuned\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.032207 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032190    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebbc4d63-f22e-4763-89c4-e521051fd3f1-kubelet-config\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:17:06.032260 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032208    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebbc4d63-f22e-4763-89c4-e521051fd3f1-dbus\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:17:06.032260 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032236    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-sysctl-conf\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.032312 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032267    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/baffc706-950b-4f9d-9fb2-b6d1735e7db4-ovn-node-metrics-cert\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.032312 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032289    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-run-k8s-cni-cncf-io\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.032368 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032326    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmpdn\" (UniqueName: \"kubernetes.io/projected/54f9dc0b-7a1d-4be7-a624-fcf314049385-kube-api-access-wmpdn\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:17:06.032368 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032344    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/baffc706-950b-4f9d-9fb2-b6d1735e7db4-ovnkube-script-lib\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.032421 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032397    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktsxx\" (UniqueName: \"kubernetes.io/projected/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-kube-api-access-ktsxx\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.032454 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032440    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-systemd\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.032515 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032490    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-registration-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.032555 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032519    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/baffc706-950b-4f9d-9fb2-b6d1735e7db4-ovnkube-script-lib\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.032555 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032551    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfk4b\" (UniqueName: \"kubernetes.io/projected/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-kube-api-access-lfk4b\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:17:06.032630 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032583    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1feac80c-15ce-41b5-b62b-14ddf279b515-signing-cabundle\") pod \"service-ca-5fffc97bdf-qgp2f\" (UID: \"1feac80c-15ce-41b5-b62b-14ddf279b515\") " pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f"
Nov 04 03:17:06.032630 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032617    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/98748f47-73db-4d89-b237-41ddf5bfe4bf-iptables-alerter-script\") pod \"iptables-alerter-v8qgg\" (UID: \"98748f47-73db-4d89-b237-41ddf5bfe4bf\") " pod="openshift-network-operator/iptables-alerter-v8qgg"
Nov 04 03:17:06.032751 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032726    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:06.032810 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032793    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67ngj\" (UniqueName: \"kubernetes.io/projected/1feac80c-15ce-41b5-b62b-14ddf279b515-kube-api-access-67ngj\") pod \"service-ca-5fffc97bdf-qgp2f\" (UID: \"1feac80c-15ce-41b5-b62b-14ddf279b515\") " pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f"
Nov 04 03:17:06.032851 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032825    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1162ece-d405-4175-a6c9-c45407f6c714-serviceca\") pod \"node-ca-kjnsg\" (UID: \"a1162ece-d405-4175-a6c9-c45407f6c714\") " pod="openshift-image-registry/node-ca-kjnsg"
Nov 04 03:17:06.032930 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032898    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:17:06.033003 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.032984    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgnv5\" (UniqueName: \"kubernetes.io/projected/9f281309-4b53-40fd-a044-03576371eff8-kube-api-access-pgnv5\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:17:06.033055 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.033021    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-daemon-config\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.033104 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.033055    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-var-lib-openvswitch\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.033104 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.033082    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-etc-openvswitch\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.033201 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.033110    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2zr8\" (UniqueName: \"kubernetes.io/projected/baffc706-950b-4f9d-9fb2-b6d1735e7db4-kube-api-access-f2zr8\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.033201 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.033137    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmq4p\" (UniqueName: \"kubernetes.io/projected/a1162ece-d405-4175-a6c9-c45407f6c714-kube-api-access-nmq4p\") pod \"node-ca-kjnsg\" (UID: \"a1162ece-d405-4175-a6c9-c45407f6c714\") " pod="openshift-image-registry/node-ca-kjnsg"
Nov 04 03:17:06.033201 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.033174    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-host\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.033201 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.033195    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.033379 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.033221    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-conf-dir\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.033379 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.033242    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54f9dc0b-7a1d-4be7-a624-fcf314049385-cni-binary-copy\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:17:06.033379 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.033258    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54f9dc0b-7a1d-4be7-a624-fcf314049385-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:17:06.033631 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.033615    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/54f9dc0b-7a1d-4be7-a624-fcf314049385-cni-binary-copy\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:17:06.070833 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.070801    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 04 03:17:06.070952 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.070926    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 04 03:17:06.071037 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.070986    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 04 03:17:06.071037 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.070981    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 04 03:17:06.071182 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.071078    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Nov 04 03:17:06.071182 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.071077    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Nov 04 03:17:06.071272 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.071249    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 04 03:17:06.071318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.071253    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 04 03:17:06.071368 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.071349    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Nov 04 03:17:06.071634 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.071464    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 04 03:17:06.071634 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.071480    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 04 03:17:06.071634 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.071465    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 04 03:17:06.071825 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.071656    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 03:17:06.071825 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.071750    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-service-ca-bundle\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:17:06.071905 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.071890    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 03:17:06.071979 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.071940    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 04 03:17:06.072149 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.071983    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 04 03:17:06.072149 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.072082    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 04 03:17:06.072389 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.072350    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-f24jt\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.072760    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.072835    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xmpr4\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.072906    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.073019    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.073044    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.073137    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/1feac80c-15ce-41b5-b62b-14ddf279b515-signing-cabundle\") pod \"service-ca-5fffc97bdf-qgp2f\" (UID: \"1feac80c-15ce-41b5-b62b-14ddf279b515\") " pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f"
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.073366    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.073441    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/a1162ece-d405-4175-a6c9-c45407f6c714-serviceca\") pod \"node-ca-kjnsg\" (UID: \"a1162ece-d405-4175-a6c9-c45407f6c714\") " pod="openshift-image-registry/node-ca-kjnsg"
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.073470    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-daemon-config\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.073368    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.073478    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.073749    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.073859    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n89nd\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.073911    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.073935    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.074269    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-2qrjk\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.074311    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.074427    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-sg2zz\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.074509    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9c548\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.074545    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.074852    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-kfskp\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.074866    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.074965    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nvmcq\""
Nov 04 03:17:06.075109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.075109    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5pzz6\""
Nov 04 03:17:06.076167 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.075415    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-57t69\""
Nov 04 03:17:06.076167 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.075415    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7jn7l\""
Nov 04 03:17:06.078989 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.078971    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/69164241-41f2-49ca-aae0-660e932012df-config-volume\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:06.079099 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.079027    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebbc4d63-f22e-4763-89c4-e521051fd3f1-original-pull-secret\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:17:06.081556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.081537    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/54f9dc0b-7a1d-4be7-a624-fcf314049385-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:17:06.081604 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.081584    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/1feac80c-15ce-41b5-b62b-14ddf279b515-signing-key\") pod \"service-ca-5fffc97bdf-qgp2f\" (UID: \"1feac80c-15ce-41b5-b62b-14ddf279b515\") " pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f"
Nov 04 03:17:06.082666 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.082652    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/51469efe-bf3a-47fe-8a90-f50da95851de-cert\") pod \"ingress-canary-9k7j4\" (UID: \"51469efe-bf3a-47fe-8a90-f50da95851de\") " pod="openshift-ingress-canary/ingress-canary-9k7j4"
Nov 04 03:17:06.082666 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.082658    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/54f9dc0b-7a1d-4be7-a624-fcf314049385-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:17:06.083965 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.083945    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/98748f47-73db-4d89-b237-41ddf5bfe4bf-iptables-alerter-script\") pod \"iptables-alerter-v8qgg\" (UID: \"98748f47-73db-4d89-b237-41ddf5bfe4bf\") " pod="openshift-network-operator/iptables-alerter-v8qgg"
Nov 04 03:17:06.121793 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.121751    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dklb5\" (UniqueName: \"kubernetes.io/projected/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-kube-api-access-dklb5\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.121978 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.121765    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pccrq\" (UniqueName: \"kubernetes.io/projected/98748f47-73db-4d89-b237-41ddf5bfe4bf-kube-api-access-pccrq\") pod \"iptables-alerter-v8qgg\" (UID: \"98748f47-73db-4d89-b237-41ddf5bfe4bf\") " pod="openshift-network-operator/iptables-alerter-v8qgg"
Nov 04 03:17:06.121978 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.121962    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfk4b\" (UniqueName: \"kubernetes.io/projected/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-kube-api-access-lfk4b\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:17:06.122155 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.122016    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqgnm\" (UniqueName: \"kubernetes.io/projected/31c980c0-089e-4671-bfa2-f1fcaeb70291-kube-api-access-fqgnm\") pod \"network-check-target-mbsd5\" (UID: \"31c980c0-089e-4671-bfa2-f1fcaeb70291\") " pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:17:06.122155 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.122122    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdksf\" (UniqueName: \"kubernetes.io/projected/4977c0d1-54d6-4b30-8a86-1c3830ff0896-kube-api-access-xdksf\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.122833 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.122269    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7hq6\" (UniqueName: \"kubernetes.io/projected/69164241-41f2-49ca-aae0-660e932012df-kube-api-access-n7hq6\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:06.122833 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.122326    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7l9k\" (UniqueName: \"kubernetes.io/projected/9ebfd8df-bb77-40e0-af1a-9632061eec38-kube-api-access-m7l9k\") pod \"migrator-66df5d496b-chhd6\" (UID: \"9ebfd8df-bb77-40e0-af1a-9632061eec38\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-chhd6"
Nov 04 03:17:06.122833 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.122360    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 04 03:17:06.122833 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.122519    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzcjs\" (UniqueName: \"kubernetes.io/projected/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-api-access-zzcjs\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:06.122833 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.122519    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgnv5\" (UniqueName: \"kubernetes.io/projected/9f281309-4b53-40fd-a044-03576371eff8-kube-api-access-pgnv5\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:17:06.122833 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.122552    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktsxx\" (UniqueName: \"kubernetes.io/projected/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-kube-api-access-ktsxx\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.122833 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.122752    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvpq9\" (UniqueName: \"kubernetes.io/projected/02e0dd3b-a707-46be-9aee-330b572db5fe-kube-api-access-hvpq9\") pod \"node-resolver-qcx8j\" (UID: \"02e0dd3b-a707-46be-9aee-330b572db5fe\") " pod="openshift-dns/node-resolver-qcx8j"
Nov 04 03:17:06.122833 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.122772    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2tw9\" (UniqueName: \"kubernetes.io/projected/51469efe-bf3a-47fe-8a90-f50da95851de-kube-api-access-q2tw9\") pod \"ingress-canary-9k7j4\" (UID: \"51469efe-bf3a-47fe-8a90-f50da95851de\") " pod="openshift-ingress-canary/ingress-canary-9k7j4"
Nov 04 03:17:06.123140 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.122895    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2zr8\" (UniqueName: \"kubernetes.io/projected/baffc706-950b-4f9d-9fb2-b6d1735e7db4-kube-api-access-f2zr8\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.123140 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.122965    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmpdn\" (UniqueName: \"kubernetes.io/projected/54f9dc0b-7a1d-4be7-a624-fcf314049385-kube-api-access-wmpdn\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:17:06.123140 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.123005    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmq4p\" (UniqueName: \"kubernetes.io/projected/a1162ece-d405-4175-a6c9-c45407f6c714-kube-api-access-nmq4p\") pod \"node-ca-kjnsg\" (UID: \"a1162ece-d405-4175-a6c9-c45407f6c714\") " pod="openshift-image-registry/node-ca-kjnsg"
Nov 04 03:17:06.123140 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.123133    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-67ngj\" (UniqueName: \"kubernetes.io/projected/1feac80c-15ce-41b5-b62b-14ddf279b515-kube-api-access-67ngj\") pod \"service-ca-5fffc97bdf-qgp2f\" (UID: \"1feac80c-15ce-41b5-b62b-14ddf279b515\") " pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f"
Nov 04 03:17:06.132248 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.132223    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-trusted-ca-bundle\") pod \"periodic-gathering-8d87g-rnfgg\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") " pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:17:06.134144 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134126    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-var-lib-kubelet\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.134187 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134153    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54f9dc0b-7a1d-4be7-a624-fcf314049385-system-cni-dir\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:17:06.134187 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134168    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54f9dc0b-7a1d-4be7-a624-fcf314049385-cnibin\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:17:06.134269 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134183    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-run\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.134269 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134200    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-lib-modules\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.134269 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134215    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98748f47-73db-4d89-b237-41ddf5bfe4bf-host-slash\") pod \"iptables-alerter-v8qgg\" (UID: \"98748f47-73db-4d89-b237-41ddf5bfe4bf\") " pod="openshift-network-operator/iptables-alerter-v8qgg"
Nov 04 03:17:06.134269 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134231    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-crio-socket\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:06.134269 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134235    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-var-lib-kubelet\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.134269 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134237    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/54f9dc0b-7a1d-4be7-a624-fcf314049385-system-cni-dir\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:17:06.134269 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134256    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/54f9dc0b-7a1d-4be7-a624-fcf314049385-cnibin\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134270    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-run\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134304    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-cnibin\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134283    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-crio-socket\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134283    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/98748f47-73db-4d89-b237-41ddf5bfe4bf-host-slash\") pod \"iptables-alerter-v8qgg\" (UID: \"98748f47-73db-4d89-b237-41ddf5bfe4bf\") " pod="openshift-network-operator/iptables-alerter-v8qgg"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134344    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-lib-modules\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134350    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-cnibin\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134368    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-run-netns\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134390    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-log-socket\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134407    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-cni-netd\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134420    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1162ece-d405-4175-a6c9-c45407f6c714-host\") pod \"node-ca-kjnsg\" (UID: \"a1162ece-d405-4175-a6c9-c45407f6c714\") " pod="openshift-image-registry/node-ca-kjnsg"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134424    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-run-netns\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134435    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-socket-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134453    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-log-socket\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134466    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-socket-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134468    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-cni-netd\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134480    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/a1162ece-d405-4175-a6c9-c45407f6c714-host\") pod \"node-ca-kjnsg\" (UID: \"a1162ece-d405-4175-a6c9-c45407f6c714\") " pod="openshift-image-registry/node-ca-kjnsg"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134482    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-device-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134507    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-system-cni-dir\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134526    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-kubelet\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134528    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-device-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.134556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134557    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-kubelet\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134569    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-system-cni-dir\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134589    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134605    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/02e0dd3b-a707-46be-9aee-330b572db5fe-hosts-file\") pod \"node-resolver-qcx8j\" (UID: \"02e0dd3b-a707-46be-9aee-330b572db5fe\") " pod="openshift-dns/node-resolver-qcx8j"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134648    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/02e0dd3b-a707-46be-9aee-330b572db5fe-hosts-file\") pod \"node-resolver-qcx8j\" (UID: \"02e0dd3b-a707-46be-9aee-330b572db5fe\") " pod="openshift-dns/node-resolver-qcx8j"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134649    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134674    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-sys\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134723    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-sys\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134736    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-var-lib-cni-multus\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134755    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134773    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-etc-selinux\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134788    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-sysconfig\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134802    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-kubernetes\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134821    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-run-ovn\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134800    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-var-lib-cni-multus\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134848    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-etc-selinux\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134855    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-sysconfig\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134862    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-run-ovn\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134862    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-kubernetes\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134879    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-cni-dir\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:06.134901    4510 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134907    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-socket-dir-parent\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134931    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-hostroot\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134946    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-socket-dir-parent\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134952    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-etc-kubernetes\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134974    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-hostroot\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.134980    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-cni-bin\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135006    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-etc-kubernetes\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135004    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-cni-dir\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:06.135018    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls podName:4e405c69-f5d0-4877-9f96-0ad5e6de5af5 nodeName:}" failed. No retries permitted until 2026-11-04 03:17:06.634996667 +0000 UTC m=+1.898870971 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9dc9l" (UID: "4e405c69-f5d0-4877-9f96-0ad5e6de5af5") : secret "insights-runtime-extractor-tls" not found
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135031    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-cni-bin\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135037    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-run-openvswitch\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135043    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-run-openvswitch\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135061    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebbc4d63-f22e-4763-89c4-e521051fd3f1-kubelet-config\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135076    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebbc4d63-f22e-4763-89c4-e521051fd3f1-dbus\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135091    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-sysctl-conf\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135105    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebbc4d63-f22e-4763-89c4-e521051fd3f1-kubelet-config\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135109    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-run-k8s-cni-cncf-io\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135136    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-systemd\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135158    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-registration-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135160    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebbc4d63-f22e-4763-89c4-e521051fd3f1-dbus\") pod \"global-pull-secret-syncer-tnstt\" (UID: \"ebbc4d63-f22e-4763-89c4-e521051fd3f1\") " pod="kube-system/global-pull-secret-syncer-tnstt"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135187    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135205    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-sysctl-conf\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135216    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-systemd\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135221    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-registration-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135216    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135232    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-run-k8s-cni-cncf-io\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135251    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-var-lib-openvswitch\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135273    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-etc-openvswitch\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:06.135285    4510 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135299    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-host\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135322    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135325    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-var-lib-openvswitch\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135332    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-etc-openvswitch\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:06.135336    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs podName:9f281309-4b53-40fd-a044-03576371eff8 nodeName:}" failed. No retries permitted until 2026-11-04 03:17:06.635323246 +0000 UTC m=+1.899197563 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs") pod "network-metrics-daemon-2qtd2" (UID: "9f281309-4b53-40fd-a044-03576371eff8") : secret "metrics-daemon-secret" not found
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135361    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-host\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135366    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.135337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135381    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-conf-dir\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135406    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54f9dc0b-7a1d-4be7-a624-fcf314049385-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135433    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-multus-conf-dir\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135433    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-var-lib-kubelet\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135461    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-slash\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135463    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/54f9dc0b-7a1d-4be7-a624-fcf314049385-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zntz9\" (UID: \"54f9dc0b-7a1d-4be7-a624-fcf314049385\") " pod="openshift-multus/multus-additional-cni-plugins-zntz9"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135495    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-node-log\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135501    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-slash\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135520    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-run-ovn-kubernetes\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135531    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-var-lib-kubelet\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135539    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-node-log\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135543    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-sys-fs\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135555    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-host-run-ovn-kubernetes\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135570    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-var-lib-cni-bin\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135589    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3bb8fd5b-13a9-4ee5-89c8-07cc20365113-sys-fs\") pod \"aws-ebs-csi-driver-node-tk69t\" (UID: \"3bb8fd5b-13a9-4ee5-89c8-07cc20365113\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tk69t"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135594    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-run-multus-certs\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135590    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-var-lib-cni-bin\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135617    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-systemd-units\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135639    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-run-multus-certs\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135642    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-systemd-units\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135642    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-run-systemd\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135699    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/baffc706-950b-4f9d-9fb2-b6d1735e7db4-run-systemd\") pod \"ovnkube-node-lft9z\" (UID: \"baffc706-950b-4f9d-9fb2-b6d1735e7db4\") " pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135714    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135740    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-run-netns\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135764    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-modprobe-d\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135787    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135791    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-sysctl-d\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:06.135810    4510 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135826    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8182d407-8f91-473a-b0d9-52a9fa1f7cf1-host-run-netns\") pod \"multus-kk42g\" (UID: \"8182d407-8f91-473a-b0d9-52a9fa1f7cf1\") " pod="openshift-multus/multus-kk42g"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:06.135853    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls podName:69164241-41f2-49ca-aae0-660e932012df nodeName:}" failed. No retries permitted until 2026-11-04 03:17:06.63583532 +0000 UTC m=+1.899709604 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls") pod "dns-default-45mbz" (UID: "69164241-41f2-49ca-aae0-660e932012df") : secret "dns-default-metrics-tls" not found
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135895    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-modprobe-d\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.137127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.135934    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4977c0d1-54d6-4b30-8a86-1c3830ff0896-etc-sysctl-d\") pod \"tuned-q6lv4\" (UID: \"4977c0d1-54d6-4b30-8a86-1c3830ff0896\") " pod="openshift-cluster-node-tuning-operator/tuned-q6lv4"
Nov 04 03:17:06.224953 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.224934    4510 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 03:17:06.639471 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.639382    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:06.639471 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.639452    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:17:06.639667 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:06.639547    4510 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 04 03:17:06.639667 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:06.639558    4510 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 03:17:06.639667 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:06.639600    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs podName:9f281309-4b53-40fd-a044-03576371eff8 nodeName:}" failed. No retries permitted until 2026-11-04 03:17:07.639587959 +0000 UTC m=+2.903462245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs") pod "network-metrics-daemon-2qtd2" (UID: "9f281309-4b53-40fd-a044-03576371eff8") : secret "metrics-daemon-secret" not found
Nov 04 03:17:06.639667 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.639594    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:06.639667 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:06.639626    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls podName:4e405c69-f5d0-4877-9f96-0ad5e6de5af5 nodeName:}" failed. No retries permitted until 2026-11-04 03:17:07.639609027 +0000 UTC m=+2.903483324 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9dc9l" (UID: "4e405c69-f5d0-4877-9f96-0ad5e6de5af5") : secret "insights-runtime-extractor-tls" not found
Nov 04 03:17:06.639667 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:06.639636    4510 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 03:17:06.639667 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:06.639658    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls podName:69164241-41f2-49ca-aae0-660e932012df nodeName:}" failed. No retries permitted until 2026-11-04 03:17:07.639651956 +0000 UTC m=+2.903526241 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls") pod "dns-default-45mbz" (UID: "69164241-41f2-49ca-aae0-660e932012df") : secret "dns-default-metrics-tls" not found
Nov 04 03:17:06.945676 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:06.945393    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qcx8j_02e0dd3b-a707-46be-9aee-330b572db5fe/dns-node-resolver/0.log"
Nov 04 03:17:07.647236 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:07.647131    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:17:07.647236 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:07.647198    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:07.647491 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:07.647247    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:07.647491 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:07.647312    4510 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 04 03:17:07.647491 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:07.647346    4510 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 03:17:07.647491 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:07.647348    4510 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 03:17:07.647491 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:07.647406    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs podName:9f281309-4b53-40fd-a044-03576371eff8 nodeName:}" failed. No retries permitted until 2026-11-04 03:17:09.64738482 +0000 UTC m=+4.911259109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs") pod "network-metrics-daemon-2qtd2" (UID: "9f281309-4b53-40fd-a044-03576371eff8") : secret "metrics-daemon-secret" not found
Nov 04 03:17:07.647491 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:07.647425    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls podName:69164241-41f2-49ca-aae0-660e932012df nodeName:}" failed. No retries permitted until 2026-11-04 03:17:09.647416148 +0000 UTC m=+4.911290433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls") pod "dns-default-45mbz" (UID: "69164241-41f2-49ca-aae0-660e932012df") : secret "dns-default-metrics-tls" not found
Nov 04 03:17:07.647491 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:07.647440    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls podName:4e405c69-f5d0-4877-9f96-0ad5e6de5af5 nodeName:}" failed. No retries permitted until 2026-11-04 03:17:09.647431783 +0000 UTC m=+4.911306073 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls") pod "insights-runtime-extractor-9dc9l" (UID: "4e405c69-f5d0-4877-9f96-0ad5e6de5af5") : secret "insights-runtime-extractor-tls" not found
Nov 04 03:17:07.744437 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:07.744407    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kjnsg_a1162ece-d405-4175-a6c9-c45407f6c714/node-ca/0.log"
Nov 04 03:17:07.903762 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:07.903671    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-qgp2f" event={"ID":"1feac80c-15ce-41b5-b62b-14ddf279b515","Type":"ContainerStarted","Data":"00507ddae3ca7d1efe596410f69417353a99638c93ac868cc53f546b5b4cab7f"}
Nov 04 03:17:08.545123 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:08.545095    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9k7j4_51469efe-bf3a-47fe-8a90-f50da95851de/serve-healthcheck-canary/0.log"
Nov 04 03:17:09.145497 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:09.145461    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-chhd6_9ebfd8df-bb77-40e0-af1a-9632061eec38/migrator/0.log"
Nov 04 03:17:09.661958 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:09.661914    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:09.662452 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:09.661968    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:17:09.662452 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:09.662002    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:09.662452 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:09.662096    4510 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 03:17:09.662452 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:09.662115    4510 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 04 03:17:09.662452 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:09.662162    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs podName:9f281309-4b53-40fd-a044-03576371eff8 nodeName:}" failed. No retries permitted until 2026-11-04 03:17:13.6621459 +0000 UTC m=+8.926020186 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs") pod "network-metrics-daemon-2qtd2" (UID: "9f281309-4b53-40fd-a044-03576371eff8") : secret "metrics-daemon-secret" not found
Nov 04 03:17:09.662452 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:09.662178    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls podName:69164241-41f2-49ca-aae0-660e932012df nodeName:}" failed. No retries permitted until 2026-11-04 03:17:13.662170799 +0000 UTC m=+8.926045101 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls") pod "dns-default-45mbz" (UID: "69164241-41f2-49ca-aae0-660e932012df") : secret "dns-default-metrics-tls" not found
Nov 04 03:17:09.662452 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:09.662386    4510 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 04 03:17:09.664693 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:09.664654    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4e405c69-f5d0-4877-9f96-0ad5e6de5af5-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-9dc9l\" (UID: \"4e405c69-f5d0-4877-9f96-0ad5e6de5af5\") " pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:09.822605 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:09.822573    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-9dc9l"
Nov 04 03:17:10.218843 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:10.218812    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-9dc9l"]
Nov 04 03:17:10.222449 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:10.222418    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e405c69_f5d0_4877_9f96_0ad5e6de5af5.slice/crio-e98569391e30a61f152a2fb45c7658d55cea4089cc06f449f6da0d212de8819c WatchSource:0}: Error finding container e98569391e30a61f152a2fb45c7658d55cea4089cc06f449f6da0d212de8819c: Status 404 returned error can't find the container with id e98569391e30a61f152a2fb45c7658d55cea4089cc06f449f6da0d212de8819c
Nov 04 03:17:10.531899 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:10.531810    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:17:10.918621 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:10.918540    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9dc9l" event={"ID":"4e405c69-f5d0-4877-9f96-0ad5e6de5af5","Type":"ContainerStarted","Data":"ddb962dbb6958577e89e203e38abc0fcd4a6e2dcaa4559529f0ae09e00e02346"}
Nov 04 03:17:10.918621 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:10.918613    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9dc9l" event={"ID":"4e405c69-f5d0-4877-9f96-0ad5e6de5af5","Type":"ContainerStarted","Data":"e98569391e30a61f152a2fb45c7658d55cea4089cc06f449f6da0d212de8819c"}
Nov 04 03:17:12.500356 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:12.500327    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:12.926081 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:12.925997    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9dc9l" event={"ID":"4e405c69-f5d0-4877-9f96-0ad5e6de5af5","Type":"ContainerStarted","Data":"3d457549371035b70bed6bb9953971978f3c69376911e8b28fdbe4f4b0e64ff2"}
Nov 04 03:17:13.690122 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:13.690081    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:13.690546 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:13.690170    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:17:13.690546 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:13.690243    4510 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 03:17:13.690546 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:13.690317    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls podName:69164241-41f2-49ca-aae0-660e932012df nodeName:}" failed. No retries permitted until 2026-11-04 03:17:21.690299231 +0000 UTC m=+16.954173727 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls") pod "dns-default-45mbz" (UID: "69164241-41f2-49ca-aae0-660e932012df") : secret "dns-default-metrics-tls" not found
Nov 04 03:17:13.692997 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:13.692969    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9f281309-4b53-40fd-a044-03576371eff8-metrics-certs\") pod \"network-metrics-daemon-2qtd2\" (UID: \"9f281309-4b53-40fd-a044-03576371eff8\") " pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:17:13.715871 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:13.715820    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2qtd2"
Nov 04 03:17:14.090004 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:14.089975    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2qtd2"]
Nov 04 03:17:14.093502 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:14.093474    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f281309_4b53_40fd_a044_03576371eff8.slice/crio-18444a6fdc6e3aba3147342b33a68ad50e33cc9ca2d77fb31d4a8464cc29e2f6 WatchSource:0}: Error finding container 18444a6fdc6e3aba3147342b33a68ad50e33cc9ca2d77fb31d4a8464cc29e2f6: Status 404 returned error can't find the container with id 18444a6fdc6e3aba3147342b33a68ad50e33cc9ca2d77fb31d4a8464cc29e2f6
Nov 04 03:17:14.933157 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:14.933116    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2qtd2" event={"ID":"9f281309-4b53-40fd-a044-03576371eff8","Type":"ContainerStarted","Data":"18444a6fdc6e3aba3147342b33a68ad50e33cc9ca2d77fb31d4a8464cc29e2f6"}
Nov 04 03:17:14.935243 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:14.935211    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-9dc9l" event={"ID":"4e405c69-f5d0-4877-9f96-0ad5e6de5af5","Type":"ContainerStarted","Data":"d7fb491b69c176f9982aaa62b217d46795a8caab0f75d914388fce376c86c5dd"}
Nov 04 03:17:15.584321 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:15.584295    4510 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-133-235.us-west-1.compute.internal" event="NodeReady"
Nov 04 03:17:15.661098 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:15.661070    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:15.661313 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:15.661294    4510 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 03:17:15.943917 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:15.943829    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2qtd2" event={"ID":"9f281309-4b53-40fd-a044-03576371eff8","Type":"ContainerStarted","Data":"f5010ff66eb694e354e8e6e41698515b53b0a1143b8a71d1ddd7ea58121d5bf5"}
Nov 04 03:17:15.944284 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:15.943919    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2qtd2" event={"ID":"9f281309-4b53-40fd-a044-03576371eff8","Type":"ContainerStarted","Data":"7ef4ff191bbd40562f916e7fda7e301fc0376069494e554a3ff52ae8880a6f38"}
Nov 04 03:17:17.202022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:17.201993    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-c45lh"
Nov 04 03:17:21.748908 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:21.748868    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:21.751323 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:21.751301    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/69164241-41f2-49ca-aae0-660e932012df-metrics-tls\") pod \"dns-default-45mbz\" (UID: \"69164241-41f2-49ca-aae0-660e932012df\") " pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:21.821788 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:21.821742    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:22.189883 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:22.189814    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-45mbz"]
Nov 04 03:17:22.193171 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:22.193139    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69164241_41f2_49ca_aae0_660e932012df.slice/crio-cc8c9a59732ffaba8d94ed22d3badd7e5e872e0dc848ce867842abb38ee31bd3 WatchSource:0}: Error finding container cc8c9a59732ffaba8d94ed22d3badd7e5e872e0dc848ce867842abb38ee31bd3: Status 404 returned error can't find the container with id cc8c9a59732ffaba8d94ed22d3badd7e5e872e0dc848ce867842abb38ee31bd3
Nov 04 03:17:22.967317 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:22.967277    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-45mbz" event={"ID":"69164241-41f2-49ca-aae0-660e932012df","Type":"ContainerStarted","Data":"cc8c9a59732ffaba8d94ed22d3badd7e5e872e0dc848ce867842abb38ee31bd3"}
Nov 04 03:17:23.321032 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:23.320923    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:17:24.758561 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.758532    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6dd789c8b7-vpbrp"]
Nov 04 03:17:24.762876 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.762851    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-vpbrp"
Nov 04 03:17:24.821145 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.821110    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"downloads-dockercfg-j7w2r\""
Nov 04 03:17:24.821145 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.821111    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Nov 04 03:17:24.821345 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.821191    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Nov 04 03:17:24.868231 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.868201    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f84745d-994e-423f-a145-f67907365e08-tmp\") pod \"downloads-6dd789c8b7-vpbrp\" (UID: \"3f84745d-994e-423f-a145-f67907365e08\") " pod="openshift-console/downloads-6dd789c8b7-vpbrp"
Nov 04 03:17:24.868231 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.868237    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzj9s\" (UniqueName: \"kubernetes.io/projected/3f84745d-994e-423f-a145-f67907365e08-kube-api-access-kzj9s\") pod \"downloads-6dd789c8b7-vpbrp\" (UID: \"3f84745d-994e-423f-a145-f67907365e08\") " pod="openshift-console/downloads-6dd789c8b7-vpbrp"
Nov 04 03:17:24.872006 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.871983    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5864777488-n65sb"]
Nov 04 03:17:24.873664 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.873650    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:24.927651 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.927617    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5864777488-n65sb"]
Nov 04 03:17:24.968507 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.968479    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-installation-pull-secrets\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:24.968507 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.968511    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-ca-trust-extracted\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:24.968785 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.968572    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzj9s\" (UniqueName: \"kubernetes.io/projected/3f84745d-994e-423f-a145-f67907365e08-kube-api-access-kzj9s\") pod \"downloads-6dd789c8b7-vpbrp\" (UID: \"3f84745d-994e-423f-a145-f67907365e08\") " pod="openshift-console/downloads-6dd789c8b7-vpbrp"
Nov 04 03:17:24.968785 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.968659    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-registry-certificates\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:24.968785 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.968705    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-image-registry-private-configuration\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:24.968785 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.968731    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncjhz\" (UniqueName: \"kubernetes.io/projected/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-kube-api-access-ncjhz\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:24.968785 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.968773    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f84745d-994e-423f-a145-f67907365e08-tmp\") pod \"downloads-6dd789c8b7-vpbrp\" (UID: \"3f84745d-994e-423f-a145-f67907365e08\") " pod="openshift-console/downloads-6dd789c8b7-vpbrp"
Nov 04 03:17:24.969065 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.968801    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-trusted-ca\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:24.969065 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.968823    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-registry-tls\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:24.969065 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.968873    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-bound-sa-token\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:24.969226 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.969119    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f84745d-994e-423f-a145-f67907365e08-tmp\") pod \"downloads-6dd789c8b7-vpbrp\" (UID: \"3f84745d-994e-423f-a145-f67907365e08\") " pod="openshift-console/downloads-6dd789c8b7-vpbrp"
Nov 04 03:17:24.975643 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.975609    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-45mbz" event={"ID":"69164241-41f2-49ca-aae0-660e932012df","Type":"ContainerStarted","Data":"f8f5dd27b4563ea87966379cb0abeb23d291cc84849e5a1ca8a37b06a2f1489d"}
Nov 04 03:17:24.975840 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.975667    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:24.975840 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.975702    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-45mbz" event={"ID":"69164241-41f2-49ca-aae0-660e932012df","Type":"ContainerStarted","Data":"e698fa500d23b0d27f962cabeb383a11aef642cef070161a279ac994bba07037"}
Nov 04 03:17:24.984988 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.984955    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Nov 04 03:17:24.985148 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.984955    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Nov 04 03:17:24.985148 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.985059    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Nov 04 03:17:24.985264 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.985243    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Nov 04 03:17:24.985336 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.985323    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mprmh\""
Nov 04 03:17:24.986081 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:24.986052    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-vpbrp"]
Nov 04 03:17:25.030130 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.030056    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzj9s\" (UniqueName: \"kubernetes.io/projected/3f84745d-994e-423f-a145-f67907365e08-kube-api-access-kzj9s\") pod \"downloads-6dd789c8b7-vpbrp\" (UID: \"3f84745d-994e-423f-a145-f67907365e08\") " pod="openshift-console/downloads-6dd789c8b7-vpbrp"
Nov 04 03:17:25.069463 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.069424    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-bound-sa-token\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:25.069658 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.069473    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-installation-pull-secrets\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:25.069658 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.069494    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-ca-trust-extracted\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:25.069658 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.069532    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-registry-certificates\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:25.069658 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.069566    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-image-registry-private-configuration\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:25.069914 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.069714    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncjhz\" (UniqueName: \"kubernetes.io/projected/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-kube-api-access-ncjhz\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:25.069914 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.069782    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-trusted-ca\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:25.069914 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.069844    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-registry-tls\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:25.070064 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.070009    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-ca-trust-extracted\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:25.070457 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.070437    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-registry-certificates\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:25.070875 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.070849    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-trusted-ca\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:25.072188 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.072165    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6dd789c8b7-vpbrp"
Nov 04 03:17:25.072307 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.072284    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-image-registry-private-configuration\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:25.072496 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.072479    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-registry-tls\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:25.072720 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.072702    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-installation-pull-secrets\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:25.130624 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.130591    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-bound-sa-token\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:25.132011 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.131983    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncjhz\" (UniqueName: \"kubernetes.io/projected/0a4dc97e-b66f-43dd-946b-01eeb8e98fe1-kube-api-access-ncjhz\") pod \"image-registry-5864777488-n65sb\" (UID: \"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1\") " pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:25.183803 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.183762    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:25.491805 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.491727    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6dd789c8b7-vpbrp"]
Nov 04 03:17:25.496225 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:25.496194    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f84745d_994e_423f_a145_f67907365e08.slice/crio-115cb1debc1aacf680a4bcabc7b56fcbcbf07880429cf8c057d3a98f998031f0 WatchSource:0}: Error finding container 115cb1debc1aacf680a4bcabc7b56fcbcbf07880429cf8c057d3a98f998031f0: Status 404 returned error can't find the container with id 115cb1debc1aacf680a4bcabc7b56fcbcbf07880429cf8c057d3a98f998031f0
Nov 04 03:17:25.537444 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.537412    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b72tp"]
Nov 04 03:17:25.539769 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.539754    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b72tp"
Nov 04 03:17:25.566713 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.566655    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5864777488-n65sb"]
Nov 04 03:17:25.570630 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:25.570593    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a4dc97e_b66f_43dd_946b_01eeb8e98fe1.slice/crio-10fd0fdc903307c6660465dfd283da2d263f38c06b1c4dabfd71c69d5dee8d89 WatchSource:0}: Error finding container 10fd0fdc903307c6660465dfd283da2d263f38c06b1c4dabfd71c69d5dee8d89: Status 404 returned error can't find the container with id 10fd0fdc903307c6660465dfd283da2d263f38c06b1c4dabfd71c69d5dee8d89
Nov 04 03:17:25.573063 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.573040    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cb42ed12-7192-4fce-a9e3-e9240081d662-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-b72tp\" (UID: \"cb42ed12-7192-4fce-a9e3-e9240081d662\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b72tp"
Nov 04 03:17:25.592312 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.592279    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Nov 04 03:17:25.592312 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.592289    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-nn2zv\""
Nov 04 03:17:25.597627 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.597603    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b72tp"]
Nov 04 03:17:25.673922 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.673884    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cb42ed12-7192-4fce-a9e3-e9240081d662-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-b72tp\" (UID: \"cb42ed12-7192-4fce-a9e3-e9240081d662\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b72tp"
Nov 04 03:17:25.676385 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.676358    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/cb42ed12-7192-4fce-a9e3-e9240081d662-tls-certificates\") pod \"prometheus-operator-admission-webhook-6489d8bf89-b72tp\" (UID: \"cb42ed12-7192-4fce-a9e3-e9240081d662\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b72tp"
Nov 04 03:17:25.850428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.850345    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b72tp"
Nov 04 03:17:25.981335 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.981298    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5864777488-n65sb" event={"ID":"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1","Type":"ContainerStarted","Data":"786e57bfe503e2c5d2eca8af612fd8ba27e8d1b812463799d23e6c99354d6cc0"}
Nov 04 03:17:25.981518 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.981383    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5864777488-n65sb" event={"ID":"0a4dc97e-b66f-43dd-946b-01eeb8e98fe1","Type":"ContainerStarted","Data":"10fd0fdc903307c6660465dfd283da2d263f38c06b1c4dabfd71c69d5dee8d89"}
Nov 04 03:17:25.981518 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.981411    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:25.982551 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:25.982524    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-vpbrp" event={"ID":"3f84745d-994e-423f-a145-f67907365e08","Type":"ContainerStarted","Data":"115cb1debc1aacf680a4bcabc7b56fcbcbf07880429cf8c057d3a98f998031f0"}
Nov 04 03:17:26.102030 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:26.101920    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5864777488-n65sb" podStartSLOduration=2.10190248 podStartE2EDuration="2.10190248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:17:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:17:26.101092348 +0000 UTC m=+21.364966650" watchObservedRunningTime="2026-11-04 03:17:26.10190248 +0000 UTC m=+21.365776787"
Nov 04 03:17:26.220628 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:26.220596    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b72tp"]
Nov 04 03:17:26.224211 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:26.224172    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb42ed12_7192_4fce_a9e3_e9240081d662.slice/crio-c53b7e97ba3f6aad6cac8fd89756c980340a324ffe996b149f2cf067d8a479ab WatchSource:0}: Error finding container c53b7e97ba3f6aad6cac8fd89756c980340a324ffe996b149f2cf067d8a479ab: Status 404 returned error can't find the container with id c53b7e97ba3f6aad6cac8fd89756c980340a324ffe996b149f2cf067d8a479ab
Nov 04 03:17:26.988117 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:26.988081    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b72tp" event={"ID":"cb42ed12-7192-4fce-a9e3-e9240081d662","Type":"ContainerStarted","Data":"c53b7e97ba3f6aad6cac8fd89756c980340a324ffe996b149f2cf067d8a479ab"}
Nov 04 03:17:27.993942 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:27.993844    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b72tp" event={"ID":"cb42ed12-7192-4fce-a9e3-e9240081d662","Type":"ContainerStarted","Data":"1bd7e22172f1e4b87103f1433a8e75d74a22eea4d7167dc539efd9422e8220b2"}
Nov 04 03:17:27.994368 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:27.994285    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b72tp"
Nov 04 03:17:27.999523 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:27.999491    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b72tp"
Nov 04 03:17:28.108997 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:28.108930    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6489d8bf89-b72tp" podStartSLOduration=1.602429273 podStartE2EDuration="3.108911837s" totalImagesPullingTime="1.506482564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:17:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:17:28.10871064 +0000 UTC m=+23.372584955" watchObservedRunningTime="2026-11-04 03:17:28.108911837 +0000 UTC m=+23.372786145"
Nov 04 03:17:28.779131 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:28.779102    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lft9z"
Nov 04 03:17:28.898052 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:28.898007    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-6b8db49fd-glkz2"]
Nov 04 03:17:28.900080 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:28.900050    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:28.985190 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:28.985142    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Nov 04 03:17:28.985190 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:28.985183    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Nov 04 03:17:28.985433 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:28.985212    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Nov 04 03:17:28.985433 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:28.985353    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-q5jn9\""
Nov 04 03:17:28.985562 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:28.985464    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Nov 04 03:17:28.985562 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:28.985492    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Nov 04 03:17:28.997485 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:28.997456    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b8db49fd-glkz2"]
Nov 04 03:17:29.000971 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.000937    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b75d77f6-5680-413a-baeb-c6108e193b27-console-serving-cert\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.001119 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.000991    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-console-config\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.001119 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.001101    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b75d77f6-5680-413a-baeb-c6108e193b27-console-oauth-config\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.001216 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.001135    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b75d77f6-5680-413a-baeb-c6108e193b27-tmp\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.001216 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.001166    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6k87j\" (UniqueName: \"kubernetes.io/projected/b75d77f6-5680-413a-baeb-c6108e193b27-kube-api-access-6k87j\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.001216 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.001212    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-service-ca\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.001353 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.001244    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-oauth-serving-cert\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.102548 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.102465    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-service-ca\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.102548 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.102508    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-oauth-serving-cert\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.102548 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.102546    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b75d77f6-5680-413a-baeb-c6108e193b27-console-serving-cert\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.102867 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.102594    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-console-config\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.102867 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.102630    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b75d77f6-5680-413a-baeb-c6108e193b27-console-oauth-config\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.102867 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.102654    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b75d77f6-5680-413a-baeb-c6108e193b27-tmp\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.103198 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.103114    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b75d77f6-5680-413a-baeb-c6108e193b27-tmp\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.103198 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.103121    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6k87j\" (UniqueName: \"kubernetes.io/projected/b75d77f6-5680-413a-baeb-c6108e193b27-kube-api-access-6k87j\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.103472 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.103444    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-oauth-serving-cert\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.103472 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.103449    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-console-config\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.103662 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.103638    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-service-ca\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.105757 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.105705    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b75d77f6-5680-413a-baeb-c6108e193b27-console-oauth-config\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.105997 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.105975    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b75d77f6-5680-413a-baeb-c6108e193b27-console-serving-cert\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.143080 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.143037    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs"]
Nov 04 03:17:29.145566 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.145541    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs"
Nov 04 03:17:29.167990 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.167952    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6k87j\" (UniqueName: \"kubernetes.io/projected/b75d77f6-5680-413a-baeb-c6108e193b27-kube-api-access-6k87j\") pod \"console-6b8db49fd-glkz2\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") " pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.198597 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.198563    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 04 03:17:29.198597 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.198562    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 04 03:17:29.198855 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.198715    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Nov 04 03:17:29.198855 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.198733    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Nov 04 03:17:29.198855 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.198753    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-kz9hc\""
Nov 04 03:17:29.198855 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.198779    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 04 03:17:29.204926 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.204042    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62fc46c7-2c38-4fbb-ad7c-e690e403b8e5-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-jl6bs\" (UID: \"62fc46c7-2c38-4fbb-ad7c-e690e403b8e5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs"
Nov 04 03:17:29.204926 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.204090    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62fc46c7-2c38-4fbb-ad7c-e690e403b8e5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-jl6bs\" (UID: \"62fc46c7-2c38-4fbb-ad7c-e690e403b8e5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs"
Nov 04 03:17:29.204926 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.204647    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgxqc\" (UniqueName: \"kubernetes.io/projected/62fc46c7-2c38-4fbb-ad7c-e690e403b8e5-kube-api-access-cgxqc\") pod \"prometheus-operator-9cd89b74c-jl6bs\" (UID: \"62fc46c7-2c38-4fbb-ad7c-e690e403b8e5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs"
Nov 04 03:17:29.204926 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.204769    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/62fc46c7-2c38-4fbb-ad7c-e690e403b8e5-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-jl6bs\" (UID: \"62fc46c7-2c38-4fbb-ad7c-e690e403b8e5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs"
Nov 04 03:17:29.206581 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.206555    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs"]
Nov 04 03:17:29.213146 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.213102    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:29.305901 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.305865    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62fc46c7-2c38-4fbb-ad7c-e690e403b8e5-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-jl6bs\" (UID: \"62fc46c7-2c38-4fbb-ad7c-e690e403b8e5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs"
Nov 04 03:17:29.306084 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.305915    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62fc46c7-2c38-4fbb-ad7c-e690e403b8e5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-jl6bs\" (UID: \"62fc46c7-2c38-4fbb-ad7c-e690e403b8e5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs"
Nov 04 03:17:29.306084 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.305948    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cgxqc\" (UniqueName: \"kubernetes.io/projected/62fc46c7-2c38-4fbb-ad7c-e690e403b8e5-kube-api-access-cgxqc\") pod \"prometheus-operator-9cd89b74c-jl6bs\" (UID: \"62fc46c7-2c38-4fbb-ad7c-e690e403b8e5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs"
Nov 04 03:17:29.306084 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.305981    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/62fc46c7-2c38-4fbb-ad7c-e690e403b8e5-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-jl6bs\" (UID: \"62fc46c7-2c38-4fbb-ad7c-e690e403b8e5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs"
Nov 04 03:17:29.307028 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.306970    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/62fc46c7-2c38-4fbb-ad7c-e690e403b8e5-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-jl6bs\" (UID: \"62fc46c7-2c38-4fbb-ad7c-e690e403b8e5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs"
Nov 04 03:17:29.308619 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.308596    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/62fc46c7-2c38-4fbb-ad7c-e690e403b8e5-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-jl6bs\" (UID: \"62fc46c7-2c38-4fbb-ad7c-e690e403b8e5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs"
Nov 04 03:17:29.309212 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.309188    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/62fc46c7-2c38-4fbb-ad7c-e690e403b8e5-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-jl6bs\" (UID: \"62fc46c7-2c38-4fbb-ad7c-e690e403b8e5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs"
Nov 04 03:17:29.368367 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.368280    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgxqc\" (UniqueName: \"kubernetes.io/projected/62fc46c7-2c38-4fbb-ad7c-e690e403b8e5-kube-api-access-cgxqc\") pod \"prometheus-operator-9cd89b74c-jl6bs\" (UID: \"62fc46c7-2c38-4fbb-ad7c-e690e403b8e5\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs"
Nov 04 03:17:29.459363 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.459326    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs"
Nov 04 03:17:29.592515 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.592480    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6b8db49fd-glkz2"]
Nov 04 03:17:29.596261 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:29.596227    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb75d77f6_5680_413a_baeb_c6108e193b27.slice/crio-0b4b6ff06c889145dfb37054b1987e66f23d6df74ec3f8a28c8d83b6b85ee281 WatchSource:0}: Error finding container 0b4b6ff06c889145dfb37054b1987e66f23d6df74ec3f8a28c8d83b6b85ee281: Status 404 returned error can't find the container with id 0b4b6ff06c889145dfb37054b1987e66f23d6df74ec3f8a28c8d83b6b85ee281
Nov 04 03:17:29.840048 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:29.840015    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs"]
Nov 04 03:17:29.843468 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:29.843438    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62fc46c7_2c38_4fbb_ad7c_e690e403b8e5.slice/crio-242222220bd4d114d51d23d577dfcffad366142cda39268bd4141ad5699b2a0a WatchSource:0}: Error finding container 242222220bd4d114d51d23d577dfcffad366142cda39268bd4141ad5699b2a0a: Status 404 returned error can't find the container with id 242222220bd4d114d51d23d577dfcffad366142cda39268bd4141ad5699b2a0a
Nov 04 03:17:30.002055 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:30.002014    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8db49fd-glkz2" event={"ID":"b75d77f6-5680-413a-baeb-c6108e193b27","Type":"ContainerStarted","Data":"0b4b6ff06c889145dfb37054b1987e66f23d6df74ec3f8a28c8d83b6b85ee281"}
Nov 04 03:17:30.003496 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:30.003463    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs" event={"ID":"62fc46c7-2c38-4fbb-ad7c-e690e403b8e5","Type":"ContainerStarted","Data":"242222220bd4d114d51d23d577dfcffad366142cda39268bd4141ad5699b2a0a"}
Nov 04 03:17:32.014955 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:32.014290    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs" event={"ID":"62fc46c7-2c38-4fbb-ad7c-e690e403b8e5","Type":"ContainerStarted","Data":"24a446b4f35e7db585b998307a6c9e5243e33490932f9165de94df036c5ae41e"}
Nov 04 03:17:32.014955 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:32.014388    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs" event={"ID":"62fc46c7-2c38-4fbb-ad7c-e690e403b8e5","Type":"ContainerStarted","Data":"24333258a63482d1d8409b6114693c375a6909e0b01da2c3a64cd41f87e7059b"}
Nov 04 03:17:32.133711 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:32.133642    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-jl6bs" podStartSLOduration=1.337483558 podStartE2EDuration="3.133627583s" totalImagesPullingTime="1.796144025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:17:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:17:32.132519554 +0000 UTC m=+27.396393861" watchObservedRunningTime="2026-11-04 03:17:32.133627583 +0000 UTC m=+27.397501891"
Nov 04 03:17:34.023696 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.023645    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8db49fd-glkz2" event={"ID":"b75d77f6-5680-413a-baeb-c6108e193b27","Type":"ContainerStarted","Data":"8525b272cda5eb5700f727ddf7f25944174b7a1e3383ad8eaa7c62d075318178"}
Nov 04 03:17:34.142031 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.141970    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-6b8db49fd-glkz2" podStartSLOduration=2.491428342 podStartE2EDuration="6.141951396s" totalImagesPullingTime="3.650523054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:17:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:17:34.140997146 +0000 UTC m=+29.404871455" watchObservedRunningTime="2026-11-04 03:17:34.141951396 +0000 UTC m=+29.405825704"
Nov 04 03:17:34.673535 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.673477    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dq5vb"]
Nov 04 03:17:34.703504 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.703464    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.754396 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.754350    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-node-exporter-textfile\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.754396 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.754431    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6f2j\" (UniqueName: \"kubernetes.io/projected/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-kube-api-access-k6f2j\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.754832 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.754526    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-metrics-client-ca\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.754832 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.754547    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.754832 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.754580    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-node-exporter-wtmp\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.754832 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.754610    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-node-exporter-tls\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.754832 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.754697    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-sys\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.754832 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.754779    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-root\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.754832 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.754815    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-node-exporter-accelerators-collector-config\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.755922 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.755902    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 04 03:17:34.756050 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.755948    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-krstf\""
Nov 04 03:17:34.756050 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.756036    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 04 03:17:34.805990 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.805953    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 04 03:17:34.855424 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.855352    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6f2j\" (UniqueName: \"kubernetes.io/projected/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-kube-api-access-k6f2j\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.855619 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.855445    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-metrics-client-ca\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.855619 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.855478    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.855619 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.855517    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-node-exporter-wtmp\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.855619 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.855550    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-node-exporter-tls\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.855619 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.855574    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-sys\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.855619 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.855599    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-root\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.855981 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.855626    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-node-exporter-accelerators-collector-config\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.855981 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.855658    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-node-exporter-textfile\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.856131 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.856109    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-node-exporter-textfile\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.856187 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.856178    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-sys\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.856239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.856213    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-root\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.856621 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.856603    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-node-exporter-accelerators-collector-config\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.857134 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.857084    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-node-exporter-wtmp\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.857514 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.857497    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-metrics-client-ca\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.859235 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.859211    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-node-exporter-tls\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.859603 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.859574    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.918342 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.918308    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6f2j\" (UniqueName: \"kubernetes.io/projected/b097a546-e7b4-4a9b-b747-4f5cf12c5ed1-kube-api-access-k6f2j\") pod \"node-exporter-dq5vb\" (UID: \"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1\") " pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:34.985517 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:34.985488    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-45mbz"
Nov 04 03:17:35.057531 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:35.057496    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dq5vb"
Nov 04 03:17:35.099712 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:35.099654    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb097a546_e7b4_4a9b_b747_4f5cf12c5ed1.slice/crio-119696e942be75579a9dcd79421c2dedba5a8668db767319373aa22828f93cd0 WatchSource:0}: Error finding container 119696e942be75579a9dcd79421c2dedba5a8668db767319373aa22828f93cd0: Status 404 returned error can't find the container with id 119696e942be75579a9dcd79421c2dedba5a8668db767319373aa22828f93cd0
Nov 04 03:17:36.036813 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:36.036772    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dq5vb" event={"ID":"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1","Type":"ContainerStarted","Data":"119696e942be75579a9dcd79421c2dedba5a8668db767319373aa22828f93cd0"}
Nov 04 03:17:38.046889 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:38.046847    4510 generic.go:356] "Generic (PLEG): container finished" podID="b097a546-e7b4-4a9b-b747-4f5cf12c5ed1" containerID="ede1ea42ca7d3ba487ee6eae2b17b330046419cb76ec3ab71176276d9b2db679" exitCode=0
Nov 04 03:17:38.047377 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:38.046901    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dq5vb" event={"ID":"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1","Type":"ContainerDied","Data":"ede1ea42ca7d3ba487ee6eae2b17b330046419cb76ec3ab71176276d9b2db679"}
Nov 04 03:17:39.053959 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.053916    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dq5vb" event={"ID":"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1","Type":"ContainerStarted","Data":"747e28ca612c74465c39e27b70ceb42c1277274f678440f35fc9c273d754c678"}
Nov 04 03:17:39.054407 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.053986    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dq5vb" event={"ID":"b097a546-e7b4-4a9b-b747-4f5cf12c5ed1","Type":"ContainerStarted","Data":"7e1c2bfc2d2c8aa6522951a9dd5f685eab1c24f9a4017380e9df984519954105"}
Nov 04 03:17:39.213762 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.213722    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:39.213957 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.213797    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:39.219610 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.219574    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:39.223587 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.223540    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dq5vb" podStartSLOduration=3.167705591 podStartE2EDuration="5.223525254s" totalImagesPullingTime="1.954940801s" totalInitContainerRuntime="100.878862ms" isStatefulPod=true podCreationTimestamp="2026-11-04 03:17:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:17:39.223031568 +0000 UTC m=+34.486905866" watchObservedRunningTime="2026-11-04 03:17:39.223525254 +0000 UTC m=+34.487399562"
Nov 04 03:17:39.595872 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.595833    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-79c78dbf68-665nc"]
Nov 04 03:17:39.606038 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.606008    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.664297 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.664265    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79c78dbf68-665nc"]
Nov 04 03:17:39.695059 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.695024    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-oauth-config\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.695250 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.695067    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-config\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.695250 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.695106    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-oauth-serving-cert\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.695250 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.695230    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-trusted-ca-bundle\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.695401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.695306    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-service-ca\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.695401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.695381    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-tmp\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.695506 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.695427    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-serving-cert\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.695597 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.695537    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q8lx\" (UniqueName: \"kubernetes.io/projected/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-kube-api-access-6q8lx\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.759448 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.759414    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Nov 04 03:17:39.797914 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.796386    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-oauth-config\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.797914 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.796433    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-config\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.797914 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.796461    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-oauth-serving-cert\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.797914 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.796483    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-trusted-ca-bundle\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.797914 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.796511    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-service-ca\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.797914 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.796531    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-tmp\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.797914 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.796564    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-serving-cert\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.797914 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.796612    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q8lx\" (UniqueName: \"kubernetes.io/projected/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-kube-api-access-6q8lx\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.797914 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.797781    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-oauth-serving-cert\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.798986 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.798933    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-tmp\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.800984 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.799315    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-config\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.800984 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.799632    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-service-ca\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.800984 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.800411    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-oauth-config\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.801511 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.801488    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-trusted-ca-bundle\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.801614 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.801521    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-serving-cert\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.861640 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.861564    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q8lx\" (UniqueName: \"kubernetes.io/projected/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-kube-api-access-6q8lx\") pod \"console-79c78dbf68-665nc\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") " pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:39.930507 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:39.930470    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:40.061973 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:40.061943    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:17:40.337639 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:40.337597    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79c78dbf68-665nc"]
Nov 04 03:17:40.341833 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:40.341803    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64ef4a0f_308b_4dbb_a2cc_8fe1bc0d1a5a.slice/crio-2453a6047d133f335a76152535121afd77d4079505f8f0251058dd0c2c6bdf79 WatchSource:0}: Error finding container 2453a6047d133f335a76152535121afd77d4079505f8f0251058dd0c2c6bdf79: Status 404 returned error can't find the container with id 2453a6047d133f335a76152535121afd77d4079505f8f0251058dd0c2c6bdf79
Nov 04 03:17:40.535132 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:40.535086    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mbsd5"
Nov 04 03:17:41.062888 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:41.062847    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c78dbf68-665nc" event={"ID":"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a","Type":"ContainerStarted","Data":"f2f895029980246970aeab9a5731dd2633c738812de2fcbe890678d1ad160404"}
Nov 04 03:17:41.063373 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:41.062904    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c78dbf68-665nc" event={"ID":"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a","Type":"ContainerStarted","Data":"2453a6047d133f335a76152535121afd77d4079505f8f0251058dd0c2c6bdf79"}
Nov 04 03:17:41.182391 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:41.182337    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-79c78dbf68-665nc" podStartSLOduration=2.182322275 podStartE2EDuration="2.182322275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:17:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:17:41.181471936 +0000 UTC m=+36.445346249" watchObservedRunningTime="2026-11-04 03:17:41.182322275 +0000 UTC m=+36.446196582"
Nov 04 03:17:43.078737 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:43.078690    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6dd789c8b7-vpbrp" event={"ID":"3f84745d-994e-423f-a145-f67907365e08","Type":"ContainerStarted","Data":"dd3ec72c83aa8e3ff4b49f0c373078ec69be592232d042d390a499a3f567650b"}
Nov 04 03:17:43.079254 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:43.078973    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6dd789c8b7-vpbrp"
Nov 04 03:17:43.096625 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:43.096591    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6dd789c8b7-vpbrp"
Nov 04 03:17:43.246559 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:43.246497    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/downloads-6dd789c8b7-vpbrp" podStartSLOduration=2.25192291 podStartE2EDuration="19.24647857s" totalImagesPullingTime="16.99455566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:17:43.245376975 +0000 UTC m=+38.509251332" watchObservedRunningTime="2026-11-04 03:17:43.24647857 +0000 UTC m=+38.510352878"
Nov 04 03:17:46.818969 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:46.818770    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79c78dbf68-665nc"]
Nov 04 03:17:46.845956 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:46.845918    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5cfb65b658-j7zn5"]
Nov 04 03:17:46.877250 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:46.877213    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:46.928766 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:46.928721    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cfb65b658-j7zn5"]
Nov 04 03:17:46.966579 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:46.966538    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69501c9e-0ffb-4d21-8f07-00fa023ee383-tmp\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:46.966795 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:46.966592    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-trusted-ca-bundle\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:46.966795 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:46.966661    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-oauth-config\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:46.966795 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:46.966777    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v2nj\" (UniqueName: \"kubernetes.io/projected/69501c9e-0ffb-4d21-8f07-00fa023ee383-kube-api-access-5v2nj\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:46.966960 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:46.966843    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-service-ca\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:46.966960 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:46.966867    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-serving-cert\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:46.967039 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:46.966980    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-config\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:46.967039 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:46.967003    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-oauth-serving-cert\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:46.994100 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:46.994071    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5864777488-n65sb"
Nov 04 03:17:47.068193 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:47.068146    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-oauth-serving-cert\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:47.068386 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:47.068311    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69501c9e-0ffb-4d21-8f07-00fa023ee383-tmp\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:47.068386 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:47.068343    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-trusted-ca-bundle\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:47.068497 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:47.068395    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-oauth-config\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:47.068497 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:47.068450    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v2nj\" (UniqueName: \"kubernetes.io/projected/69501c9e-0ffb-4d21-8f07-00fa023ee383-kube-api-access-5v2nj\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:47.068608 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:47.068520    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-service-ca\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:47.068608 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:47.068556    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-serving-cert\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:47.068740 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:47.068638    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-config\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:47.069169 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:47.069097    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-oauth-serving-cert\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:47.069822 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:47.069450    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69501c9e-0ffb-4d21-8f07-00fa023ee383-tmp\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:47.069822 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:47.069779    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-service-ca\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:47.069977 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:47.069944    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-config\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:47.070330 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:47.070309    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-trusted-ca-bundle\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:47.071613 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:47.071581    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-serving-cert\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:47.071725 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:47.071653    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-oauth-config\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:47.130707 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:47.130650    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v2nj\" (UniqueName: \"kubernetes.io/projected/69501c9e-0ffb-4d21-8f07-00fa023ee383-kube-api-access-5v2nj\") pod \"console-5cfb65b658-j7zn5\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") " pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:47.209417 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:47.209360    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:47.627908 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:47.627864    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5cfb65b658-j7zn5"]
Nov 04 03:17:47.632942 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:17:47.632908    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69501c9e_0ffb_4d21_8f07_00fa023ee383.slice/crio-16687e493845f0dbc1b2668cc3187395de1ef4a23f672779fff35e1987807527 WatchSource:0}: Error finding container 16687e493845f0dbc1b2668cc3187395de1ef4a23f672779fff35e1987807527: Status 404 returned error can't find the container with id 16687e493845f0dbc1b2668cc3187395de1ef4a23f672779fff35e1987807527
Nov 04 03:17:48.100308 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:48.100271    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfb65b658-j7zn5" event={"ID":"69501c9e-0ffb-4d21-8f07-00fa023ee383","Type":"ContainerStarted","Data":"20c7465150a8c084247173a82d6f9b6ec584d762354608382ad4a42c23c0d09d"}
Nov 04 03:17:48.100786 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:48.100322    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfb65b658-j7zn5" event={"ID":"69501c9e-0ffb-4d21-8f07-00fa023ee383","Type":"ContainerStarted","Data":"16687e493845f0dbc1b2668cc3187395de1ef4a23f672779fff35e1987807527"}
Nov 04 03:17:48.218993 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:48.218926    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5cfb65b658-j7zn5" podStartSLOduration=2.218904513 podStartE2EDuration="2.218904513s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:17:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:17:48.218512549 +0000 UTC m=+43.482386869" watchObservedRunningTime="2026-11-04 03:17:48.218904513 +0000 UTC m=+43.482778814"
Nov 04 03:17:49.931159 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:49.931120    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:17:53.316006 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:17:53.315967    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:17:57.209605 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:57.209562    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:57.210032 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:57.209624    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:57.216336 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:57.216306    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:58.139675 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:58.139639    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:17:58.310301 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:17:58.310219    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b8db49fd-glkz2"]
Nov 04 03:18:11.841937 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:11.841880    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-79c78dbf68-665nc" podUID="64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a" containerName="console" containerID="cri-o://f2f895029980246970aeab9a5731dd2633c738812de2fcbe890678d1ad160404" gracePeriod=15
Nov 04 03:18:12.138057 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.138028    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:18:12.174670 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.174640    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-oauth-serving-cert\") pod \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") "
Nov 04 03:18:12.174886 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.174700    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-serving-cert\") pod \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") "
Nov 04 03:18:12.174886 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.174737    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-service-ca\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-service-ca\") pod \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") "
Nov 04 03:18:12.174886 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.174759    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-kube-api-access-6q8lx\" (UniqueName: \"kubernetes.io/projected/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-kube-api-access-6q8lx\") pod \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") "
Nov 04 03:18:12.174886 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.174783    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-trusted-ca-bundle\") pod \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") "
Nov 04 03:18:12.175183 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.175155    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-oauth-serving-cert" pod "64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a" (UID: "64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:18:12.175269 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.175247    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-service-ca" pod "64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a" (UID: "64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:18:12.175317 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.175290    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-trusted-ca-bundle" pod "64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a" (UID: "64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:18:12.177133 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.177113    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-kube-api-access-6q8lx" pod "64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a" (UID: "64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a"). InnerVolumeSpecName "kube-api-access-6q8lx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:18:12.177210 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.177141    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-serving-cert" pod "64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a" (UID: "64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:18:12.183973 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.183949    4510 generic.go:356] "Generic (PLEG): container finished" podID="64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a" containerID="f2f895029980246970aeab9a5731dd2633c738812de2fcbe890678d1ad160404" exitCode=0
Nov 04 03:18:12.184084 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.184001    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79c78dbf68-665nc"
Nov 04 03:18:12.184084 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.184018    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c78dbf68-665nc" event={"ID":"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a","Type":"ContainerDied","Data":"f2f895029980246970aeab9a5731dd2633c738812de2fcbe890678d1ad160404"}
Nov 04 03:18:12.184084 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.184058    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79c78dbf68-665nc" event={"ID":"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a","Type":"ContainerDied","Data":"2453a6047d133f335a76152535121afd77d4079505f8f0251058dd0c2c6bdf79"}
Nov 04 03:18:12.184084 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.184077    4510 scope.go:122] "RemoveContainer" containerID="f2f895029980246970aeab9a5731dd2633c738812de2fcbe890678d1ad160404"
Nov 04 03:18:12.193918 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.193412    4510 scope.go:122] "RemoveContainer" containerID="f2f895029980246970aeab9a5731dd2633c738812de2fcbe890678d1ad160404"
Nov 04 03:18:12.195672 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:18:12.195643    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2f895029980246970aeab9a5731dd2633c738812de2fcbe890678d1ad160404\": container with ID starting with f2f895029980246970aeab9a5731dd2633c738812de2fcbe890678d1ad160404 not found: ID does not exist" containerID="f2f895029980246970aeab9a5731dd2633c738812de2fcbe890678d1ad160404"
Nov 04 03:18:12.195803 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.195706    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2f895029980246970aeab9a5731dd2633c738812de2fcbe890678d1ad160404"} err="failed to get container status \"f2f895029980246970aeab9a5731dd2633c738812de2fcbe890678d1ad160404\": rpc error: code = NotFound desc = could not find container \"f2f895029980246970aeab9a5731dd2633c738812de2fcbe890678d1ad160404\": container with ID starting with f2f895029980246970aeab9a5731dd2633c738812de2fcbe890678d1ad160404 not found: ID does not exist"
Nov 04 03:18:12.275822 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.275791    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-tmp\" (UniqueName: \"kubernetes.io/empty-dir/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-tmp\") pod \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") "
Nov 04 03:18:12.275822 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.275837    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-config\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-config\") pod \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") "
Nov 04 03:18:12.276030 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.275874    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-oauth-config\") pod \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\" (UID: \"64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a\") "
Nov 04 03:18:12.276030 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.275992    4510 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-oauth-serving-cert\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:12.276030 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.276003    4510 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-serving-cert\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:12.276030 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.276013    4510 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-service-ca\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:12.276030 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.276028    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6q8lx\" (UniqueName: \"kubernetes.io/projected/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-kube-api-access-6q8lx\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:12.276178 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.276043    4510 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-trusted-ca-bundle\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:12.276178 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.276097    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-tmp" pod "64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a" (UID: "64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:18:12.276241 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.276196    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-config" pod "64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a" (UID: "64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:18:12.278214 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.278174    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-oauth-config" pod "64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a" (UID: "64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:18:12.377043 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.376961    4510 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-tmp\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:12.377043 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.376991    4510 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-config\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:12.377043 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.377004    4510 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a-console-oauth-config\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:12.606015 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.605981    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79c78dbf68-665nc"]
Nov 04 03:18:12.612299 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.612268    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79c78dbf68-665nc"]
Nov 04 03:18:12.631632 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.631553    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5f9fcd6497-kn9v2"]
Nov 04 03:18:12.631862 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.631850    4510 cpu_manager.go:414] "containerMap: removing container" podUID="64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a" containerName="console"
Nov 04 03:18:12.631910 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.631865    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a" containerName="console"
Nov 04 03:18:12.631952 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.631926    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a" containerName="console"
Nov 04 03:18:12.646903 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.645527    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.678895 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.678862    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df41660c-9648-49d9-9591-fe8f205349a5-console-oauth-config\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.679064 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.678906    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwpk2\" (UniqueName: \"kubernetes.io/projected/df41660c-9648-49d9-9591-fe8f205349a5-kube-api-access-mwpk2\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.679064 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.678926    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df41660c-9648-49d9-9591-fe8f205349a5-service-ca\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.679064 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.678994    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df41660c-9648-49d9-9591-fe8f205349a5-console-serving-cert\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.679064 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.679057    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df41660c-9648-49d9-9591-fe8f205349a5-oauth-serving-cert\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.679191 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.679114    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df41660c-9648-49d9-9591-fe8f205349a5-trusted-ca-bundle\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.679191 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.679138    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df41660c-9648-49d9-9591-fe8f205349a5-tmp\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.679191 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.679157    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df41660c-9648-49d9-9591-fe8f205349a5-console-config\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.720037 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.720002    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9fcd6497-kn9v2"]
Nov 04 03:18:12.779834 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.779799    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df41660c-9648-49d9-9591-fe8f205349a5-service-ca\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.779834 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.779839    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df41660c-9648-49d9-9591-fe8f205349a5-console-serving-cert\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.780087 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.779903    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df41660c-9648-49d9-9591-fe8f205349a5-oauth-serving-cert\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.780087 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.779930    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df41660c-9648-49d9-9591-fe8f205349a5-trusted-ca-bundle\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.780087 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.779957    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df41660c-9648-49d9-9591-fe8f205349a5-tmp\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.780087 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.779993    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df41660c-9648-49d9-9591-fe8f205349a5-console-config\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.780279 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.780237    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df41660c-9648-49d9-9591-fe8f205349a5-console-oauth-config\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.780331 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.780286    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwpk2\" (UniqueName: \"kubernetes.io/projected/df41660c-9648-49d9-9591-fe8f205349a5-kube-api-access-mwpk2\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.805601 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.805563    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/df41660c-9648-49d9-9591-fe8f205349a5-tmp\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.805868 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.805665    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/df41660c-9648-49d9-9591-fe8f205349a5-service-ca\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.805868 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.805727    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/df41660c-9648-49d9-9591-fe8f205349a5-console-serving-cert\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.805868 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.805727    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/df41660c-9648-49d9-9591-fe8f205349a5-console-oauth-config\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.805868 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.805727    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/df41660c-9648-49d9-9591-fe8f205349a5-oauth-serving-cert\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.805868 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.805727    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/df41660c-9648-49d9-9591-fe8f205349a5-console-config\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.808396 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.808369    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/df41660c-9648-49d9-9591-fe8f205349a5-trusted-ca-bundle\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.840964 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.840928    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwpk2\" (UniqueName: \"kubernetes.io/projected/df41660c-9648-49d9-9591-fe8f205349a5-kube-api-access-mwpk2\") pod \"console-5f9fcd6497-kn9v2\" (UID: \"df41660c-9648-49d9-9591-fe8f205349a5\") " pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:12.860510 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.860479    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a" path="/var/lib/kubelet/pods/64ef4a0f-308b-4dbb-a2cc-8fe1bc0d1a5a/volumes"
Nov 04 03:18:12.969756 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:12.969719    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:13.366042 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:13.366012    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5f9fcd6497-kn9v2"]
Nov 04 03:18:13.369538 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:18:13.369506    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf41660c_9648_49d9_9591_fe8f205349a5.slice/crio-9d8aa9edf664bcb99d59de75f86ac31611f9643a0f6ea779dd10c30e2e5b53bf WatchSource:0}: Error finding container 9d8aa9edf664bcb99d59de75f86ac31611f9643a0f6ea779dd10c30e2e5b53bf: Status 404 returned error can't find the container with id 9d8aa9edf664bcb99d59de75f86ac31611f9643a0f6ea779dd10c30e2e5b53bf
Nov 04 03:18:14.193945 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:14.193913    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9fcd6497-kn9v2" event={"ID":"df41660c-9648-49d9-9591-fe8f205349a5","Type":"ContainerStarted","Data":"641c07c7836f7ab4a3289a1acd4b8fc5ef670e1b93c504b2befc9c8efb23899c"}
Nov 04 03:18:14.194349 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:14.193961    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5f9fcd6497-kn9v2" event={"ID":"df41660c-9648-49d9-9591-fe8f205349a5","Type":"ContainerStarted","Data":"9d8aa9edf664bcb99d59de75f86ac31611f9643a0f6ea779dd10c30e2e5b53bf"}
Nov 04 03:18:14.312808 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:14.312754    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5f9fcd6497-kn9v2" podStartSLOduration=2.312734061 podStartE2EDuration="2.312734061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:18:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:18:14.311456126 +0000 UTC m=+69.575330433" watchObservedRunningTime="2026-11-04 03:18:14.312734061 +0000 UTC m=+69.576608368"
Nov 04 03:18:22.970093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:22.970054    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:22.970617 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:22.970117    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:22.975120 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:22.975095    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:23.229591 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.229504    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5f9fcd6497-kn9v2"
Nov 04 03:18:23.316927 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:18:23.316879    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:18:23.331342 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.331311    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-6b8db49fd-glkz2" podUID="b75d77f6-5680-413a-baeb-c6108e193b27" containerName="console" containerID="cri-o://8525b272cda5eb5700f727ddf7f25944174b7a1e3383ad8eaa7c62d075318178" gracePeriod=15
Nov 04 03:18:23.379498 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.379461    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cfb65b658-j7zn5"]
Nov 04 03:18:23.598226 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.598192    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:18:23.663929 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.663895    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b75d77f6-5680-413a-baeb-c6108e193b27-tmp\" (UniqueName: \"kubernetes.io/empty-dir/b75d77f6-5680-413a-baeb-c6108e193b27-tmp\") pod \"b75d77f6-5680-413a-baeb-c6108e193b27\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") "
Nov 04 03:18:23.664112 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.663947    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b75d77f6-5680-413a-baeb-c6108e193b27-kube-api-access-6k87j\" (UniqueName: \"kubernetes.io/projected/b75d77f6-5680-413a-baeb-c6108e193b27-kube-api-access-6k87j\") pod \"b75d77f6-5680-413a-baeb-c6108e193b27\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") "
Nov 04 03:18:23.664112 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.663976    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-oauth-serving-cert\") pod \"b75d77f6-5680-413a-baeb-c6108e193b27\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") "
Nov 04 03:18:23.664112 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.664005    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b75d77f6-5680-413a-baeb-c6108e193b27-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b75d77f6-5680-413a-baeb-c6108e193b27-console-oauth-config\") pod \"b75d77f6-5680-413a-baeb-c6108e193b27\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") "
Nov 04 03:18:23.664112 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.664035    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-console-config\" (UniqueName: \"kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-console-config\") pod \"b75d77f6-5680-413a-baeb-c6108e193b27\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") "
Nov 04 03:18:23.664112 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.664099    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-service-ca\" (UniqueName: \"kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-service-ca\") pod \"b75d77f6-5680-413a-baeb-c6108e193b27\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") "
Nov 04 03:18:23.664371 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.664140    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b75d77f6-5680-413a-baeb-c6108e193b27-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b75d77f6-5680-413a-baeb-c6108e193b27-console-serving-cert\") pod \"b75d77f6-5680-413a-baeb-c6108e193b27\" (UID: \"b75d77f6-5680-413a-baeb-c6108e193b27\") "
Nov 04 03:18:23.664371 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.664234    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b75d77f6-5680-413a-baeb-c6108e193b27-tmp" pod "b75d77f6-5680-413a-baeb-c6108e193b27" (UID: "b75d77f6-5680-413a-baeb-c6108e193b27"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:18:23.664479 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.664384    4510 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b75d77f6-5680-413a-baeb-c6108e193b27-tmp\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:23.664532 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.664516    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-service-ca" pod "b75d77f6-5680-413a-baeb-c6108e193b27" (UID: "b75d77f6-5680-413a-baeb-c6108e193b27"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:18:23.664584 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.664526    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-oauth-serving-cert" pod "b75d77f6-5680-413a-baeb-c6108e193b27" (UID: "b75d77f6-5680-413a-baeb-c6108e193b27"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:18:23.664584 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.664537    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-console-config" pod "b75d77f6-5680-413a-baeb-c6108e193b27" (UID: "b75d77f6-5680-413a-baeb-c6108e193b27"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:18:23.666312 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.666286    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b75d77f6-5680-413a-baeb-c6108e193b27-console-oauth-config" pod "b75d77f6-5680-413a-baeb-c6108e193b27" (UID: "b75d77f6-5680-413a-baeb-c6108e193b27"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:18:23.666493 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.666472    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b75d77f6-5680-413a-baeb-c6108e193b27-console-serving-cert" pod "b75d77f6-5680-413a-baeb-c6108e193b27" (UID: "b75d77f6-5680-413a-baeb-c6108e193b27"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:18:23.666554 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.666488    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b75d77f6-5680-413a-baeb-c6108e193b27-kube-api-access-6k87j" pod "b75d77f6-5680-413a-baeb-c6108e193b27" (UID: "b75d77f6-5680-413a-baeb-c6108e193b27"). InnerVolumeSpecName "kube-api-access-6k87j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:18:23.765599 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.765509    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6k87j\" (UniqueName: \"kubernetes.io/projected/b75d77f6-5680-413a-baeb-c6108e193b27-kube-api-access-6k87j\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:23.765599 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.765539    4510 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-oauth-serving-cert\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:23.765599 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.765550    4510 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b75d77f6-5680-413a-baeb-c6108e193b27-console-oauth-config\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:23.765599 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.765561    4510 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-console-config\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:23.765599 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.765569    4510 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b75d77f6-5680-413a-baeb-c6108e193b27-service-ca\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:23.765599 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:23.765579    4510 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b75d77f6-5680-413a-baeb-c6108e193b27-console-serving-cert\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:24.229935 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:24.229895    4510 generic.go:356] "Generic (PLEG): container finished" podID="b75d77f6-5680-413a-baeb-c6108e193b27" containerID="8525b272cda5eb5700f727ddf7f25944174b7a1e3383ad8eaa7c62d075318178" exitCode=0
Nov 04 03:18:24.229935 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:24.229938    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6b8db49fd-glkz2"
Nov 04 03:18:24.230525 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:24.229985    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8db49fd-glkz2" event={"ID":"b75d77f6-5680-413a-baeb-c6108e193b27","Type":"ContainerDied","Data":"8525b272cda5eb5700f727ddf7f25944174b7a1e3383ad8eaa7c62d075318178"}
Nov 04 03:18:24.230525 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:24.230044    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6b8db49fd-glkz2" event={"ID":"b75d77f6-5680-413a-baeb-c6108e193b27","Type":"ContainerDied","Data":"0b4b6ff06c889145dfb37054b1987e66f23d6df74ec3f8a28c8d83b6b85ee281"}
Nov 04 03:18:24.230525 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:24.230076    4510 scope.go:122] "RemoveContainer" containerID="8525b272cda5eb5700f727ddf7f25944174b7a1e3383ad8eaa7c62d075318178"
Nov 04 03:18:24.239463 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:24.239442    4510 scope.go:122] "RemoveContainer" containerID="8525b272cda5eb5700f727ddf7f25944174b7a1e3383ad8eaa7c62d075318178"
Nov 04 03:18:24.239758 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:18:24.239741    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8525b272cda5eb5700f727ddf7f25944174b7a1e3383ad8eaa7c62d075318178\": container with ID starting with 8525b272cda5eb5700f727ddf7f25944174b7a1e3383ad8eaa7c62d075318178 not found: ID does not exist" containerID="8525b272cda5eb5700f727ddf7f25944174b7a1e3383ad8eaa7c62d075318178"
Nov 04 03:18:24.239824 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:24.239771    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8525b272cda5eb5700f727ddf7f25944174b7a1e3383ad8eaa7c62d075318178"} err="failed to get container status \"8525b272cda5eb5700f727ddf7f25944174b7a1e3383ad8eaa7c62d075318178\": rpc error: code = NotFound desc = could not find container \"8525b272cda5eb5700f727ddf7f25944174b7a1e3383ad8eaa7c62d075318178\": container with ID starting with 8525b272cda5eb5700f727ddf7f25944174b7a1e3383ad8eaa7c62d075318178 not found: ID does not exist"
Nov 04 03:18:24.397042 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:24.397011    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6b8db49fd-glkz2"]
Nov 04 03:18:24.446734 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:24.446700    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6b8db49fd-glkz2"]
Nov 04 03:18:24.860455 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:24.860422    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b75d77f6-5680-413a-baeb-c6108e193b27" path="/var/lib/kubelet/pods/b75d77f6-5680-413a-baeb-c6108e193b27/volumes"
Nov 04 03:18:34.261171 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:34.261138    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-8d87g-rnfgg"]
Nov 04 03:18:34.261781 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:34.261331    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-8d87g-rnfgg" podUID="6de009d7-8e66-4f15-8cd7-88cbeae44fd9" containerName="insights-gathering" containerID="cri-o://c03eaef5325305763f381014f34e26d83dee7454419eb721f1a254cba766e634" gracePeriod=30
Nov 04 03:18:34.509823 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:34.509798    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:18:34.547990 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:34.547913    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-service-ca-bundle\") pod \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") "
Nov 04 03:18:34.547990 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:34.547980    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-kube-api-access-lfk4b\" (UniqueName: \"kubernetes.io/projected/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-kube-api-access-lfk4b\") pod \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") "
Nov 04 03:18:34.548151 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:34.548010    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-trusted-ca-bundle\") pod \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") "
Nov 04 03:18:34.548151 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:34.548073    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-archives-path\") pod \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\" (UID: \"6de009d7-8e66-4f15-8cd7-88cbeae44fd9\") "
Nov 04 03:18:34.548366 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:34.548342    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-service-ca-bundle" pod "6de009d7-8e66-4f15-8cd7-88cbeae44fd9" (UID: "6de009d7-8e66-4f15-8cd7-88cbeae44fd9"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:18:34.548410 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:34.548376    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-archives-path" pod "6de009d7-8e66-4f15-8cd7-88cbeae44fd9" (UID: "6de009d7-8e66-4f15-8cd7-88cbeae44fd9"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:18:34.548481 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:34.548439    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-trusted-ca-bundle" pod "6de009d7-8e66-4f15-8cd7-88cbeae44fd9" (UID: "6de009d7-8e66-4f15-8cd7-88cbeae44fd9"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:18:34.550514 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:34.550496    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-kube-api-access-lfk4b" pod "6de009d7-8e66-4f15-8cd7-88cbeae44fd9" (UID: "6de009d7-8e66-4f15-8cd7-88cbeae44fd9"). InnerVolumeSpecName "kube-api-access-lfk4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:18:34.649494 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:34.649459    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfk4b\" (UniqueName: \"kubernetes.io/projected/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-kube-api-access-lfk4b\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:34.649494 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:34.649490    4510 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-trusted-ca-bundle\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:34.649494 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:34.649500    4510 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-archives-path\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:34.649760 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:34.649508    4510 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6de009d7-8e66-4f15-8cd7-88cbeae44fd9-service-ca-bundle\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:35.269649 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:35.269615    4510 generic.go:356] "Generic (PLEG): container finished" podID="6de009d7-8e66-4f15-8cd7-88cbeae44fd9" containerID="c03eaef5325305763f381014f34e26d83dee7454419eb721f1a254cba766e634" exitCode=2
Nov 04 03:18:35.270164 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:35.269664    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-8d87g-rnfgg"
Nov 04 03:18:35.270164 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:35.269710    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-8d87g-rnfgg" event={"ID":"6de009d7-8e66-4f15-8cd7-88cbeae44fd9","Type":"ContainerDied","Data":"c03eaef5325305763f381014f34e26d83dee7454419eb721f1a254cba766e634"}
Nov 04 03:18:35.270164 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:35.269773    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-8d87g-rnfgg" event={"ID":"6de009d7-8e66-4f15-8cd7-88cbeae44fd9","Type":"ContainerDied","Data":"663f92638d76bf9a438535cfd5bc2b3f18533d2bf76731aacc4a9413907beb7c"}
Nov 04 03:18:35.270164 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:35.269802    4510 scope.go:122] "RemoveContainer" containerID="c03eaef5325305763f381014f34e26d83dee7454419eb721f1a254cba766e634"
Nov 04 03:18:35.277581 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:35.277563    4510 scope.go:122] "RemoveContainer" containerID="c03eaef5325305763f381014f34e26d83dee7454419eb721f1a254cba766e634"
Nov 04 03:18:35.277873 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:18:35.277852    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c03eaef5325305763f381014f34e26d83dee7454419eb721f1a254cba766e634\": container with ID starting with c03eaef5325305763f381014f34e26d83dee7454419eb721f1a254cba766e634 not found: ID does not exist" containerID="c03eaef5325305763f381014f34e26d83dee7454419eb721f1a254cba766e634"
Nov 04 03:18:35.277944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:35.277888    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c03eaef5325305763f381014f34e26d83dee7454419eb721f1a254cba766e634"} err="failed to get container status \"c03eaef5325305763f381014f34e26d83dee7454419eb721f1a254cba766e634\": rpc error: code = NotFound desc = could not find container \"c03eaef5325305763f381014f34e26d83dee7454419eb721f1a254cba766e634\": container with ID starting with c03eaef5325305763f381014f34e26d83dee7454419eb721f1a254cba766e634 not found: ID does not exist"
Nov 04 03:18:35.432075 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:35.432042    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-8d87g-rnfgg"]
Nov 04 03:18:35.481871 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:35.481833    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-8d87g-rnfgg"]
Nov 04 03:18:36.860398 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:36.860360    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6de009d7-8e66-4f15-8cd7-88cbeae44fd9" path="/var/lib/kubelet/pods/6de009d7-8e66-4f15-8cd7-88cbeae44fd9/volumes"
Nov 04 03:18:48.405289 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.405247    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-5cfb65b658-j7zn5" podUID="69501c9e-0ffb-4d21-8f07-00fa023ee383" containerName="console" containerID="cri-o://20c7465150a8c084247173a82d6f9b6ec584d762354608382ad4a42c23c0d09d" gracePeriod=15
Nov 04 03:18:48.656101 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.656045    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:18:48.759979 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.759942    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-oauth-serving-cert\") pod \"69501c9e-0ffb-4d21-8f07-00fa023ee383\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") "
Nov 04 03:18:48.759979 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.759990    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/69501c9e-0ffb-4d21-8f07-00fa023ee383-kube-api-access-5v2nj\" (UniqueName: \"kubernetes.io/projected/69501c9e-0ffb-4d21-8f07-00fa023ee383-kube-api-access-5v2nj\") pod \"69501c9e-0ffb-4d21-8f07-00fa023ee383\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") "
Nov 04 03:18:48.760241 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.760009    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-trusted-ca-bundle\") pod \"69501c9e-0ffb-4d21-8f07-00fa023ee383\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") "
Nov 04 03:18:48.760241 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.760036    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-oauth-config\") pod \"69501c9e-0ffb-4d21-8f07-00fa023ee383\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") "
Nov 04 03:18:48.760241 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.760161    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-config\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-config\") pod \"69501c9e-0ffb-4d21-8f07-00fa023ee383\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") "
Nov 04 03:18:48.760241 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.760203    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/69501c9e-0ffb-4d21-8f07-00fa023ee383-tmp\" (UniqueName: \"kubernetes.io/empty-dir/69501c9e-0ffb-4d21-8f07-00fa023ee383-tmp\") pod \"69501c9e-0ffb-4d21-8f07-00fa023ee383\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") "
Nov 04 03:18:48.760241 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.760232    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-service-ca\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-service-ca\") pod \"69501c9e-0ffb-4d21-8f07-00fa023ee383\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") "
Nov 04 03:18:48.760494 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.760335    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-serving-cert\") pod \"69501c9e-0ffb-4d21-8f07-00fa023ee383\" (UID: \"69501c9e-0ffb-4d21-8f07-00fa023ee383\") "
Nov 04 03:18:48.760553 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.760486    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69501c9e-0ffb-4d21-8f07-00fa023ee383-tmp" pod "69501c9e-0ffb-4d21-8f07-00fa023ee383" (UID: "69501c9e-0ffb-4d21-8f07-00fa023ee383"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:18:48.760608 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.760549    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-oauth-serving-cert" pod "69501c9e-0ffb-4d21-8f07-00fa023ee383" (UID: "69501c9e-0ffb-4d21-8f07-00fa023ee383"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:18:48.760608 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.760571    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-trusted-ca-bundle" pod "69501c9e-0ffb-4d21-8f07-00fa023ee383" (UID: "69501c9e-0ffb-4d21-8f07-00fa023ee383"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:18:48.760779 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.760750    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-config" pod "69501c9e-0ffb-4d21-8f07-00fa023ee383" (UID: "69501c9e-0ffb-4d21-8f07-00fa023ee383"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:18:48.760907 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.760804    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-service-ca" pod "69501c9e-0ffb-4d21-8f07-00fa023ee383" (UID: "69501c9e-0ffb-4d21-8f07-00fa023ee383"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:18:48.762453 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.762432    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69501c9e-0ffb-4d21-8f07-00fa023ee383-kube-api-access-5v2nj" pod "69501c9e-0ffb-4d21-8f07-00fa023ee383" (UID: "69501c9e-0ffb-4d21-8f07-00fa023ee383"). InnerVolumeSpecName "kube-api-access-5v2nj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:18:48.762546 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.762462    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-oauth-config" pod "69501c9e-0ffb-4d21-8f07-00fa023ee383" (UID: "69501c9e-0ffb-4d21-8f07-00fa023ee383"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:18:48.762615 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.762600    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-serving-cert" pod "69501c9e-0ffb-4d21-8f07-00fa023ee383" (UID: "69501c9e-0ffb-4d21-8f07-00fa023ee383"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:18:48.860868 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.860837    4510 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-oauth-serving-cert\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:48.860868 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.860862    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5v2nj\" (UniqueName: \"kubernetes.io/projected/69501c9e-0ffb-4d21-8f07-00fa023ee383-kube-api-access-5v2nj\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:48.860868 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.860873    4510 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-trusted-ca-bundle\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:48.861100 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.860882    4510 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-oauth-config\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:48.861100 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.860890    4510 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-config\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:48.861100 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.860900    4510 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/69501c9e-0ffb-4d21-8f07-00fa023ee383-tmp\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:48.861100 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.860908    4510 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/69501c9e-0ffb-4d21-8f07-00fa023ee383-service-ca\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:48.861100 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:48.860917    4510 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/69501c9e-0ffb-4d21-8f07-00fa023ee383-console-serving-cert\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:18:49.317774 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:49.317740    4510 generic.go:356] "Generic (PLEG): container finished" podID="69501c9e-0ffb-4d21-8f07-00fa023ee383" containerID="20c7465150a8c084247173a82d6f9b6ec584d762354608382ad4a42c23c0d09d" exitCode=0
Nov 04 03:18:49.317927 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:49.317798    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5cfb65b658-j7zn5"
Nov 04 03:18:49.317927 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:49.317818    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfb65b658-j7zn5" event={"ID":"69501c9e-0ffb-4d21-8f07-00fa023ee383","Type":"ContainerDied","Data":"20c7465150a8c084247173a82d6f9b6ec584d762354608382ad4a42c23c0d09d"}
Nov 04 03:18:49.317927 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:49.317867    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5cfb65b658-j7zn5" event={"ID":"69501c9e-0ffb-4d21-8f07-00fa023ee383","Type":"ContainerDied","Data":"16687e493845f0dbc1b2668cc3187395de1ef4a23f672779fff35e1987807527"}
Nov 04 03:18:49.317927 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:49.317887    4510 scope.go:122] "RemoveContainer" containerID="20c7465150a8c084247173a82d6f9b6ec584d762354608382ad4a42c23c0d09d"
Nov 04 03:18:49.327476 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:49.327452    4510 scope.go:122] "RemoveContainer" containerID="20c7465150a8c084247173a82d6f9b6ec584d762354608382ad4a42c23c0d09d"
Nov 04 03:18:49.327807 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:18:49.327788    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20c7465150a8c084247173a82d6f9b6ec584d762354608382ad4a42c23c0d09d\": container with ID starting with 20c7465150a8c084247173a82d6f9b6ec584d762354608382ad4a42c23c0d09d not found: ID does not exist" containerID="20c7465150a8c084247173a82d6f9b6ec584d762354608382ad4a42c23c0d09d"
Nov 04 03:18:49.327854 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:49.327817    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20c7465150a8c084247173a82d6f9b6ec584d762354608382ad4a42c23c0d09d"} err="failed to get container status \"20c7465150a8c084247173a82d6f9b6ec584d762354608382ad4a42c23c0d09d\": rpc error: code = NotFound desc = could not find container \"20c7465150a8c084247173a82d6f9b6ec584d762354608382ad4a42c23c0d09d\": container with ID starting with 20c7465150a8c084247173a82d6f9b6ec584d762354608382ad4a42c23c0d09d not found: ID does not exist"
Nov 04 03:18:49.482066 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:49.482033    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5cfb65b658-j7zn5"]
Nov 04 03:18:49.532212 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:49.532177    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5cfb65b658-j7zn5"]
Nov 04 03:18:50.860850 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:18:50.860820    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="69501c9e-0ffb-4d21-8f07-00fa023ee383" path="/var/lib/kubelet/pods/69501c9e-0ffb-4d21-8f07-00fa023ee383/volumes"
Nov 04 03:18:53.315548 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:18:53.315506    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:19:23.316465 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:19:23.316382    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:19:53.317047 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:19:53.317009    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:20:23.316377 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:20:23.316338    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:20:47.657776 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.657697    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz"]
Nov 04 03:20:47.658176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.657941    4510 cpu_manager.go:414] "containerMap: removing container" podUID="b75d77f6-5680-413a-baeb-c6108e193b27" containerName="console"
Nov 04 03:20:47.658176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.657951    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b75d77f6-5680-413a-baeb-c6108e193b27" containerName="console"
Nov 04 03:20:47.658176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.657965    4510 cpu_manager.go:414] "containerMap: removing container" podUID="6de009d7-8e66-4f15-8cd7-88cbeae44fd9" containerName="insights-gathering"
Nov 04 03:20:47.658176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.657970    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6de009d7-8e66-4f15-8cd7-88cbeae44fd9" containerName="insights-gathering"
Nov 04 03:20:47.658176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.657990    4510 cpu_manager.go:414] "containerMap: removing container" podUID="69501c9e-0ffb-4d21-8f07-00fa023ee383" containerName="console"
Nov 04 03:20:47.658176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.657995    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="69501c9e-0ffb-4d21-8f07-00fa023ee383" containerName="console"
Nov 04 03:20:47.658176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.658030    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="69501c9e-0ffb-4d21-8f07-00fa023ee383" containerName="console"
Nov 04 03:20:47.658176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.658037    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="b75d77f6-5680-413a-baeb-c6108e193b27" containerName="console"
Nov 04 03:20:47.658176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.658044    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="6de009d7-8e66-4f15-8cd7-88cbeae44fd9" containerName="insights-gathering"
Nov 04 03:20:47.659830 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.659813    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz"
Nov 04 03:20:47.713301 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.713272    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Nov 04 03:20:47.762633 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.762598    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Nov 04 03:20:47.763501 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.763486    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-kfxrr\""
Nov 04 03:20:47.763769 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.763750    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz"]
Nov 04 03:20:47.764364 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.764344    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv"]
Nov 04 03:20:47.766423 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.766405    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv"
Nov 04 03:20:47.828219 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.828183    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brqxk\" (UniqueName: \"kubernetes.io/projected/9adff17e-e54f-49ff-81b8-ca15f741436f-kube-api-access-brqxk\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz\" (UID: \"9adff17e-e54f-49ff-81b8-ca15f741436f\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz"
Nov 04 03:20:47.828406 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.828229    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9adff17e-e54f-49ff-81b8-ca15f741436f-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz\" (UID: \"9adff17e-e54f-49ff-81b8-ca15f741436f\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz"
Nov 04 03:20:47.828406 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.828253    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9adff17e-e54f-49ff-81b8-ca15f741436f-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz\" (UID: \"9adff17e-e54f-49ff-81b8-ca15f741436f\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz"
Nov 04 03:20:47.850059 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.850024    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv"]
Nov 04 03:20:47.863890 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.863859    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-w9scn\""
Nov 04 03:20:47.929538 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.929463    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brqxk\" (UniqueName: \"kubernetes.io/projected/9adff17e-e54f-49ff-81b8-ca15f741436f-kube-api-access-brqxk\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz\" (UID: \"9adff17e-e54f-49ff-81b8-ca15f741436f\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz"
Nov 04 03:20:47.929538 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.929513    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55dc3a4e-e026-4207-87bb-d9ca844f4945-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv\" (UID: \"55dc3a4e-e026-4207-87bb-d9ca844f4945\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv"
Nov 04 03:20:47.929538 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.929536    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9adff17e-e54f-49ff-81b8-ca15f741436f-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz\" (UID: \"9adff17e-e54f-49ff-81b8-ca15f741436f\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz"
Nov 04 03:20:47.929769 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.929554    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9adff17e-e54f-49ff-81b8-ca15f741436f-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz\" (UID: \"9adff17e-e54f-49ff-81b8-ca15f741436f\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz"
Nov 04 03:20:47.929769 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.929721    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-929bn\" (UniqueName: \"kubernetes.io/projected/55dc3a4e-e026-4207-87bb-d9ca844f4945-kube-api-access-929bn\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv\" (UID: \"55dc3a4e-e026-4207-87bb-d9ca844f4945\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv"
Nov 04 03:20:47.929863 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.929794    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55dc3a4e-e026-4207-87bb-d9ca844f4945-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv\" (UID: \"55dc3a4e-e026-4207-87bb-d9ca844f4945\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv"
Nov 04 03:20:47.929960 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.929945    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9adff17e-e54f-49ff-81b8-ca15f741436f-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz\" (UID: \"9adff17e-e54f-49ff-81b8-ca15f741436f\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz"
Nov 04 03:20:47.930002 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.929986    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9adff17e-e54f-49ff-81b8-ca15f741436f-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz\" (UID: \"9adff17e-e54f-49ff-81b8-ca15f741436f\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz"
Nov 04 03:20:47.991570 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:47.991538    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-brqxk\" (UniqueName: \"kubernetes.io/projected/9adff17e-e54f-49ff-81b8-ca15f741436f-kube-api-access-brqxk\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz\" (UID: \"9adff17e-e54f-49ff-81b8-ca15f741436f\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz"
Nov 04 03:20:48.030450 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:48.030417    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55dc3a4e-e026-4207-87bb-d9ca844f4945-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv\" (UID: \"55dc3a4e-e026-4207-87bb-d9ca844f4945\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv"
Nov 04 03:20:48.030450 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:48.030464    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55dc3a4e-e026-4207-87bb-d9ca844f4945-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv\" (UID: \"55dc3a4e-e026-4207-87bb-d9ca844f4945\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv"
Nov 04 03:20:48.030708 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:48.030491    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-929bn\" (UniqueName: \"kubernetes.io/projected/55dc3a4e-e026-4207-87bb-d9ca844f4945-kube-api-access-929bn\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv\" (UID: \"55dc3a4e-e026-4207-87bb-d9ca844f4945\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv"
Nov 04 03:20:48.030938 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:48.030914    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55dc3a4e-e026-4207-87bb-d9ca844f4945-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv\" (UID: \"55dc3a4e-e026-4207-87bb-d9ca844f4945\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv"
Nov 04 03:20:48.030977 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:48.030917    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55dc3a4e-e026-4207-87bb-d9ca844f4945-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv\" (UID: \"55dc3a4e-e026-4207-87bb-d9ca844f4945\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv"
Nov 04 03:20:48.096832 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:48.096801    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-929bn\" (UniqueName: \"kubernetes.io/projected/55dc3a4e-e026-4207-87bb-d9ca844f4945-kube-api-access-929bn\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv\" (UID: \"55dc3a4e-e026-4207-87bb-d9ca844f4945\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv"
Nov 04 03:20:48.276287 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:48.276247    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz"
Nov 04 03:20:48.378260 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:48.378219    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv"
Nov 04 03:20:48.650149 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:48.650074    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz"]
Nov 04 03:20:48.653363 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:20:48.653340    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9adff17e_e54f_49ff_81b8_ca15f741436f.slice/crio-be2591f91e3d5d92923ccbc87d55e1547843724ccf6830e8bc6fe892089d384b WatchSource:0}: Error finding container be2591f91e3d5d92923ccbc87d55e1547843724ccf6830e8bc6fe892089d384b: Status 404 returned error can't find the container with id be2591f91e3d5d92923ccbc87d55e1547843724ccf6830e8bc6fe892089d384b
Nov 04 03:20:48.719500 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:48.719462    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz" event={"ID":"9adff17e-e54f-49ff-81b8-ca15f741436f","Type":"ContainerStarted","Data":"be2591f91e3d5d92923ccbc87d55e1547843724ccf6830e8bc6fe892089d384b"}
Nov 04 03:20:48.769823 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:48.769793    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv"]
Nov 04 03:20:48.772904 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:20:48.772879    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55dc3a4e_e026_4207_87bb_d9ca844f4945.slice/crio-503c9ff2fbad596f3702eb8a3bcd5d6f91592fe67e0d70f7259869c46e0c2356 WatchSource:0}: Error finding container 503c9ff2fbad596f3702eb8a3bcd5d6f91592fe67e0d70f7259869c46e0c2356: Status 404 returned error can't find the container with id 503c9ff2fbad596f3702eb8a3bcd5d6f91592fe67e0d70f7259869c46e0c2356
Nov 04 03:20:49.724282 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:49.724244    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv" event={"ID":"55dc3a4e-e026-4207-87bb-d9ca844f4945","Type":"ContainerStarted","Data":"503c9ff2fbad596f3702eb8a3bcd5d6f91592fe67e0d70f7259869c46e0c2356"}
Nov 04 03:20:51.822899 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:51.822829    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz"]
Nov 04 03:20:51.825491 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:51.825463    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz"
Nov 04 03:20:51.866954 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:51.866918    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2swc\" (UniqueName: \"kubernetes.io/projected/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-kube-api-access-f2swc\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz\" (UID: \"a8bc1d6f-8070-4737-9b53-0eead76cc3bc\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz"
Nov 04 03:20:51.867167 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:51.866969    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz\" (UID: \"a8bc1d6f-8070-4737-9b53-0eead76cc3bc\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz"
Nov 04 03:20:51.867167 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:51.867013    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz\" (UID: \"a8bc1d6f-8070-4737-9b53-0eead76cc3bc\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz"
Nov 04 03:20:51.927939 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:51.927883    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-7q4df\""
Nov 04 03:20:51.929373 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:51.929343    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz"]
Nov 04 03:20:51.967588 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:51.967555    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2swc\" (UniqueName: \"kubernetes.io/projected/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-kube-api-access-f2swc\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz\" (UID: \"a8bc1d6f-8070-4737-9b53-0eead76cc3bc\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz"
Nov 04 03:20:51.967787 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:51.967594    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz\" (UID: \"a8bc1d6f-8070-4737-9b53-0eead76cc3bc\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz"
Nov 04 03:20:51.967787 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:51.967640    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz\" (UID: \"a8bc1d6f-8070-4737-9b53-0eead76cc3bc\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz"
Nov 04 03:20:51.968093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:51.968068    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz\" (UID: \"a8bc1d6f-8070-4737-9b53-0eead76cc3bc\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz"
Nov 04 03:20:51.968550 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:51.968531    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz\" (UID: \"a8bc1d6f-8070-4737-9b53-0eead76cc3bc\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz"
Nov 04 03:20:52.030425 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:52.030392    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2swc\" (UniqueName: \"kubernetes.io/projected/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-kube-api-access-f2swc\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz\" (UID: \"a8bc1d6f-8070-4737-9b53-0eead76cc3bc\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz"
Nov 04 03:20:52.142110 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:52.142030    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz"
Nov 04 03:20:52.526257 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:52.526168    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz"]
Nov 04 03:20:52.530646 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:20:52.530608    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8bc1d6f_8070_4737_9b53_0eead76cc3bc.slice/crio-db7dad869f6fd1880baa993b3cee0bcfec24850af145678a09b81ff6e9550a25 WatchSource:0}: Error finding container db7dad869f6fd1880baa993b3cee0bcfec24850af145678a09b81ff6e9550a25: Status 404 returned error can't find the container with id db7dad869f6fd1880baa993b3cee0bcfec24850af145678a09b81ff6e9550a25
Nov 04 03:20:52.738661 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:52.738621    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz" event={"ID":"a8bc1d6f-8070-4737-9b53-0eead76cc3bc","Type":"ContainerStarted","Data":"db7dad869f6fd1880baa993b3cee0bcfec24850af145678a09b81ff6e9550a25"}
Nov 04 03:20:52.923647 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:52.923551    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6"]
Nov 04 03:20:52.926614 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:52.926584    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6"
Nov 04 03:20:52.976659 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:52.976614    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec46cc8-a6ee-468d-a70c-ea0f57465802-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6\" (UID: \"1ec46cc8-a6ee-468d-a70c-ea0f57465802\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6"
Nov 04 03:20:52.976659 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:52.976659    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec46cc8-a6ee-468d-a70c-ea0f57465802-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6\" (UID: \"1ec46cc8-a6ee-468d-a70c-ea0f57465802\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6"
Nov 04 03:20:52.976892 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:52.976748    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfkqm\" (UniqueName: \"kubernetes.io/projected/1ec46cc8-a6ee-468d-a70c-ea0f57465802-kube-api-access-jfkqm\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6\" (UID: \"1ec46cc8-a6ee-468d-a70c-ea0f57465802\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6"
Nov 04 03:20:52.986047 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:52.986016    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-wm8s4\""
Nov 04 03:20:52.987755 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:52.987726    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6"]
Nov 04 03:20:53.038729 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.037566    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q"]
Nov 04 03:20:53.040182 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.040154    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q"
Nov 04 03:20:53.078125 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.078081    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfkqm\" (UniqueName: \"kubernetes.io/projected/1ec46cc8-a6ee-468d-a70c-ea0f57465802-kube-api-access-jfkqm\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6\" (UID: \"1ec46cc8-a6ee-468d-a70c-ea0f57465802\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6"
Nov 04 03:20:53.078338 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.078154    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrgsn\" (UniqueName: \"kubernetes.io/projected/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-kube-api-access-xrgsn\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q\" (UID: \"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q"
Nov 04 03:20:53.078338 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.078197    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q\" (UID: \"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q"
Nov 04 03:20:53.078338 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.078238    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec46cc8-a6ee-468d-a70c-ea0f57465802-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6\" (UID: \"1ec46cc8-a6ee-468d-a70c-ea0f57465802\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6"
Nov 04 03:20:53.078338 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.078262    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q\" (UID: \"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q"
Nov 04 03:20:53.078338 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.078280    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec46cc8-a6ee-468d-a70c-ea0f57465802-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6\" (UID: \"1ec46cc8-a6ee-468d-a70c-ea0f57465802\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6"
Nov 04 03:20:53.078763 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.078739    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec46cc8-a6ee-468d-a70c-ea0f57465802-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6\" (UID: \"1ec46cc8-a6ee-468d-a70c-ea0f57465802\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6"
Nov 04 03:20:53.078853 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.078771    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec46cc8-a6ee-468d-a70c-ea0f57465802-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6\" (UID: \"1ec46cc8-a6ee-468d-a70c-ea0f57465802\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6"
Nov 04 03:20:53.093123 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.093083    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-4mz4r\""
Nov 04 03:20:53.101508 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.101471    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q"]
Nov 04 03:20:53.136696 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.136645    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w"]
Nov 04 03:20:53.139343 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.139315    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w"
Nov 04 03:20:53.144466 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.144440    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfkqm\" (UniqueName: \"kubernetes.io/projected/1ec46cc8-a6ee-468d-a70c-ea0f57465802-kube-api-access-jfkqm\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6\" (UID: \"1ec46cc8-a6ee-468d-a70c-ea0f57465802\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6"
Nov 04 03:20:53.179398 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.179320    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef925236-de11-4c72-af67-fdac2cbb42e0-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w\" (UID: \"ef925236-de11-4c72-af67-fdac2cbb42e0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w"
Nov 04 03:20:53.179542 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.179406    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef925236-de11-4c72-af67-fdac2cbb42e0-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w\" (UID: \"ef925236-de11-4c72-af67-fdac2cbb42e0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w"
Nov 04 03:20:53.179542 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.179508    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrgsn\" (UniqueName: \"kubernetes.io/projected/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-kube-api-access-xrgsn\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q\" (UID: \"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q"
Nov 04 03:20:53.179628 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.179554    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q\" (UID: \"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q"
Nov 04 03:20:53.179628 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.179596    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q\" (UID: \"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q"
Nov 04 03:20:53.179628 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.179617    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j5mv\" (UniqueName: \"kubernetes.io/projected/ef925236-de11-4c72-af67-fdac2cbb42e0-kube-api-access-7j5mv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w\" (UID: \"ef925236-de11-4c72-af67-fdac2cbb42e0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w"
Nov 04 03:20:53.180049 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.180022    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q\" (UID: \"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q"
Nov 04 03:20:53.180185 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.180068    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q\" (UID: \"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q"
Nov 04 03:20:53.194965 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.194932    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-z7mm7\""
Nov 04 03:20:53.197898 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.197857    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w"]
Nov 04 03:20:53.231718 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.230816    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4"]
Nov 04 03:20:53.233983 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.233950    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4"
Nov 04 03:20:53.241414 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.241386    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrgsn\" (UniqueName: \"kubernetes.io/projected/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-kube-api-access-xrgsn\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q\" (UID: \"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q"
Nov 04 03:20:53.242989 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.242958    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6"
Nov 04 03:20:53.280423 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.280388    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3259809-ebd8-411f-9bf2-4159939abd28-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4\" (UID: \"d3259809-ebd8-411f-9bf2-4159939abd28\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4"
Nov 04 03:20:53.280423 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.280436    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3259809-ebd8-411f-9bf2-4159939abd28-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4\" (UID: \"d3259809-ebd8-411f-9bf2-4159939abd28\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4"
Nov 04 03:20:53.280692 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.280472    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef925236-de11-4c72-af67-fdac2cbb42e0-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w\" (UID: \"ef925236-de11-4c72-af67-fdac2cbb42e0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w"
Nov 04 03:20:53.280692 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.280495    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef925236-de11-4c72-af67-fdac2cbb42e0-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w\" (UID: \"ef925236-de11-4c72-af67-fdac2cbb42e0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w"
Nov 04 03:20:53.280692 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.280567    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b65r7\" (UniqueName: \"kubernetes.io/projected/d3259809-ebd8-411f-9bf2-4159939abd28-kube-api-access-b65r7\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4\" (UID: \"d3259809-ebd8-411f-9bf2-4159939abd28\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4"
Nov 04 03:20:53.280692 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.280594    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j5mv\" (UniqueName: \"kubernetes.io/projected/ef925236-de11-4c72-af67-fdac2cbb42e0-kube-api-access-7j5mv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w\" (UID: \"ef925236-de11-4c72-af67-fdac2cbb42e0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w"
Nov 04 03:20:53.282038 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.281363    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef925236-de11-4c72-af67-fdac2cbb42e0-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w\" (UID: \"ef925236-de11-4c72-af67-fdac2cbb42e0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w"
Nov 04 03:20:53.282038 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.281716    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef925236-de11-4c72-af67-fdac2cbb42e0-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w\" (UID: \"ef925236-de11-4c72-af67-fdac2cbb42e0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w"
Nov 04 03:20:53.292706 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.292646    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4"]
Nov 04 03:20:53.298099 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.298056    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-4kv8j\""
Nov 04 03:20:53.325863 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:20:53.325820    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:20:53.344221 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.344188    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j5mv\" (UniqueName: \"kubernetes.io/projected/ef925236-de11-4c72-af67-fdac2cbb42e0-kube-api-access-7j5mv\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w\" (UID: \"ef925236-de11-4c72-af67-fdac2cbb42e0\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w"
Nov 04 03:20:53.356751 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.356722    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q"
Nov 04 03:20:53.381141 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.381101    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b65r7\" (UniqueName: \"kubernetes.io/projected/d3259809-ebd8-411f-9bf2-4159939abd28-kube-api-access-b65r7\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4\" (UID: \"d3259809-ebd8-411f-9bf2-4159939abd28\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4"
Nov 04 03:20:53.381331 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.381163    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3259809-ebd8-411f-9bf2-4159939abd28-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4\" (UID: \"d3259809-ebd8-411f-9bf2-4159939abd28\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4"
Nov 04 03:20:53.381331 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.381191    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3259809-ebd8-411f-9bf2-4159939abd28-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4\" (UID: \"d3259809-ebd8-411f-9bf2-4159939abd28\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4"
Nov 04 03:20:53.381671 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.381611    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3259809-ebd8-411f-9bf2-4159939abd28-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4\" (UID: \"d3259809-ebd8-411f-9bf2-4159939abd28\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4"
Nov 04 03:20:53.381826 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.381775    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3259809-ebd8-411f-9bf2-4159939abd28-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4\" (UID: \"d3259809-ebd8-411f-9bf2-4159939abd28\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4"
Nov 04 03:20:53.443597 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.443524    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b65r7\" (UniqueName: \"kubernetes.io/projected/d3259809-ebd8-411f-9bf2-4159939abd28-kube-api-access-b65r7\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4\" (UID: \"d3259809-ebd8-411f-9bf2-4159939abd28\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4"
Nov 04 03:20:53.462169 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.462135    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w"
Nov 04 03:20:53.571308 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.571257    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4"
Nov 04 03:20:53.628713 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.628654    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6"]
Nov 04 03:20:53.636850 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:20:53.633236    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec46cc8_a6ee_468d_a70c_ea0f57465802.slice/crio-4e5a4354d95849f168d89684e9761d87da242e2df637a7070a4f86963637b0e3 WatchSource:0}: Error finding container 4e5a4354d95849f168d89684e9761d87da242e2df637a7070a4f86963637b0e3: Status 404 returned error can't find the container with id 4e5a4354d95849f168d89684e9761d87da242e2df637a7070a4f86963637b0e3
Nov 04 03:20:53.736582 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.735849    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q"]
Nov 04 03:20:53.742550 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:20:53.741508    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2d01a38_01fe_47e1_9ca0_a745aaaa0d1c.slice/crio-b9c4f6ddc76e48dca2f4ec8cda0037213cde056effb180cabb6662d8570c83e5 WatchSource:0}: Error finding container b9c4f6ddc76e48dca2f4ec8cda0037213cde056effb180cabb6662d8570c83e5: Status 404 returned error can't find the container with id b9c4f6ddc76e48dca2f4ec8cda0037213cde056effb180cabb6662d8570c83e5
Nov 04 03:20:53.744390 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.744364    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6" event={"ID":"1ec46cc8-a6ee-468d-a70c-ea0f57465802","Type":"ContainerStarted","Data":"4e5a4354d95849f168d89684e9761d87da242e2df637a7070a4f86963637b0e3"}
Nov 04 03:20:53.851818 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.851729    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w"]
Nov 04 03:20:53.864204 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:20:53.864160    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef925236_de11_4c72_af67_fdac2cbb42e0.slice/crio-ded37eb1c6122394e689cb85a0e04139376e2791d9af5ebd1dd0da1250f481a9 WatchSource:0}: Error finding container ded37eb1c6122394e689cb85a0e04139376e2791d9af5ebd1dd0da1250f481a9: Status 404 returned error can't find the container with id ded37eb1c6122394e689cb85a0e04139376e2791d9af5ebd1dd0da1250f481a9
Nov 04 03:20:53.967223 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:53.966018    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4"]
Nov 04 03:20:53.970644 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:20:53.970607    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3259809_ebd8_411f_9bf2_4159939abd28.slice/crio-661d84c14d3d41c93f96c421a0fa1687ac6e0ebf6610dd5ebee1803e85404017 WatchSource:0}: Error finding container 661d84c14d3d41c93f96c421a0fa1687ac6e0ebf6610dd5ebee1803e85404017: Status 404 returned error can't find the container with id 661d84c14d3d41c93f96c421a0fa1687ac6e0ebf6610dd5ebee1803e85404017
Nov 04 03:20:54.751401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:54.751319    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4" event={"ID":"d3259809-ebd8-411f-9bf2-4159939abd28","Type":"ContainerStarted","Data":"661d84c14d3d41c93f96c421a0fa1687ac6e0ebf6610dd5ebee1803e85404017"}
Nov 04 03:20:54.755406 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:54.755314    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w" event={"ID":"ef925236-de11-4c72-af67-fdac2cbb42e0","Type":"ContainerStarted","Data":"ded37eb1c6122394e689cb85a0e04139376e2791d9af5ebd1dd0da1250f481a9"}
Nov 04 03:20:54.757989 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:54.757902    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q" event={"ID":"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c","Type":"ContainerStarted","Data":"b9c4f6ddc76e48dca2f4ec8cda0037213cde056effb180cabb6662d8570c83e5"}
Nov 04 03:20:55.044896 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.044818    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq"]
Nov 04 03:20:55.047726 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.047707    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq"
Nov 04 03:20:55.096944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.096703    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7j245\" (UniqueName: \"kubernetes.io/projected/bf6bef9e-71e7-4008-9d13-e28f96d691a3-kube-api-access-7j245\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq\" (UID: \"bf6bef9e-71e7-4008-9d13-e28f96d691a3\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq"
Nov 04 03:20:55.096944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.096779    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf6bef9e-71e7-4008-9d13-e28f96d691a3-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq\" (UID: \"bf6bef9e-71e7-4008-9d13-e28f96d691a3\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq"
Nov 04 03:20:55.096944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.096835    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf6bef9e-71e7-4008-9d13-e28f96d691a3-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq\" (UID: \"bf6bef9e-71e7-4008-9d13-e28f96d691a3\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq"
Nov 04 03:20:55.152305 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.152206    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq"]
Nov 04 03:20:55.198906 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.197366    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf6bef9e-71e7-4008-9d13-e28f96d691a3-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq\" (UID: \"bf6bef9e-71e7-4008-9d13-e28f96d691a3\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq"
Nov 04 03:20:55.198906 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.197459    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf6bef9e-71e7-4008-9d13-e28f96d691a3-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq\" (UID: \"bf6bef9e-71e7-4008-9d13-e28f96d691a3\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq"
Nov 04 03:20:55.198906 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.197523    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7j245\" (UniqueName: \"kubernetes.io/projected/bf6bef9e-71e7-4008-9d13-e28f96d691a3-kube-api-access-7j245\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq\" (UID: \"bf6bef9e-71e7-4008-9d13-e28f96d691a3\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq"
Nov 04 03:20:55.198906 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.198382    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf6bef9e-71e7-4008-9d13-e28f96d691a3-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq\" (UID: \"bf6bef9e-71e7-4008-9d13-e28f96d691a3\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq"
Nov 04 03:20:55.198906 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.198644    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf6bef9e-71e7-4008-9d13-e28f96d691a3-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq\" (UID: \"bf6bef9e-71e7-4008-9d13-e28f96d691a3\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq"
Nov 04 03:20:55.270206 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.268189    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh"]
Nov 04 03:20:55.271971 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.271482    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh"
Nov 04 03:20:55.284451 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.284377    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7j245\" (UniqueName: \"kubernetes.io/projected/bf6bef9e-71e7-4008-9d13-e28f96d691a3-kube-api-access-7j245\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq\" (UID: \"bf6bef9e-71e7-4008-9d13-e28f96d691a3\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq"
Nov 04 03:20:55.331620 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.331484    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh"]
Nov 04 03:20:55.369411 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.369376    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq"
Nov 04 03:20:55.399983 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.399945    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43c3983a-60b4-408f-868d-8657bdf6b2e2-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh\" (UID: \"43c3983a-60b4-408f-868d-8657bdf6b2e2\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh"
Nov 04 03:20:55.400166 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.400066    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxd7h\" (UniqueName: \"kubernetes.io/projected/43c3983a-60b4-408f-868d-8657bdf6b2e2-kube-api-access-cxd7h\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh\" (UID: \"43c3983a-60b4-408f-868d-8657bdf6b2e2\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh"
Nov 04 03:20:55.400166 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.400099    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43c3983a-60b4-408f-868d-8657bdf6b2e2-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh\" (UID: \"43c3983a-60b4-408f-868d-8657bdf6b2e2\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh"
Nov 04 03:20:55.501125 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.501093    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43c3983a-60b4-408f-868d-8657bdf6b2e2-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh\" (UID: \"43c3983a-60b4-408f-868d-8657bdf6b2e2\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh"
Nov 04 03:20:55.501323 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.501186    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxd7h\" (UniqueName: \"kubernetes.io/projected/43c3983a-60b4-408f-868d-8657bdf6b2e2-kube-api-access-cxd7h\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh\" (UID: \"43c3983a-60b4-408f-868d-8657bdf6b2e2\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh"
Nov 04 03:20:55.501323 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.501209    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43c3983a-60b4-408f-868d-8657bdf6b2e2-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh\" (UID: \"43c3983a-60b4-408f-868d-8657bdf6b2e2\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh"
Nov 04 03:20:55.501543 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.501519    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43c3983a-60b4-408f-868d-8657bdf6b2e2-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh\" (UID: \"43c3983a-60b4-408f-868d-8657bdf6b2e2\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh"
Nov 04 03:20:55.501818 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.501796    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43c3983a-60b4-408f-868d-8657bdf6b2e2-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh\" (UID: \"43c3983a-60b4-408f-868d-8657bdf6b2e2\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh"
Nov 04 03:20:55.569146 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.569077    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxd7h\" (UniqueName: \"kubernetes.io/projected/43c3983a-60b4-408f-868d-8657bdf6b2e2-kube-api-access-cxd7h\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh\" (UID: \"43c3983a-60b4-408f-868d-8657bdf6b2e2\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh"
Nov 04 03:20:55.597151 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.596983    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh"
Nov 04 03:20:55.784491 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:55.784401    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq"]
Nov 04 03:20:55.802341 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:20:55.802296    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf6bef9e_71e7_4008_9d13_e28f96d691a3.slice/crio-cde8fe3eaa86a342b390fb8dc60158755689c11ef78bac0b7e63d2d29ee3c8f1 WatchSource:0}: Error finding container cde8fe3eaa86a342b390fb8dc60158755689c11ef78bac0b7e63d2d29ee3c8f1: Status 404 returned error can't find the container with id cde8fe3eaa86a342b390fb8dc60158755689c11ef78bac0b7e63d2d29ee3c8f1
Nov 04 03:20:56.060407 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:56.060269    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh"]
Nov 04 03:20:56.065837 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:20:56.065806    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43c3983a_60b4_408f_868d_8657bdf6b2e2.slice/crio-ea800a313e20a4bf59f49e60604dcca3d644a9eae7383281b05fb4112a5bc329 WatchSource:0}: Error finding container ea800a313e20a4bf59f49e60604dcca3d644a9eae7383281b05fb4112a5bc329: Status 404 returned error can't find the container with id ea800a313e20a4bf59f49e60604dcca3d644a9eae7383281b05fb4112a5bc329
Nov 04 03:20:56.778261 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:56.778166    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq" event={"ID":"bf6bef9e-71e7-4008-9d13-e28f96d691a3","Type":"ContainerStarted","Data":"cde8fe3eaa86a342b390fb8dc60158755689c11ef78bac0b7e63d2d29ee3c8f1"}
Nov 04 03:20:56.779855 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:56.779778    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh" event={"ID":"43c3983a-60b4-408f-868d-8657bdf6b2e2","Type":"ContainerStarted","Data":"ea800a313e20a4bf59f49e60604dcca3d644a9eae7383281b05fb4112a5bc329"}
Nov 04 03:20:58.810667 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:58.810242    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv" event={"ID":"55dc3a4e-e026-4207-87bb-d9ca844f4945","Type":"ContainerStarted","Data":"49191044108f342b57cb45c3501ba5c3475a13f5be621601510f0a02ff8466f1"}
Nov 04 03:20:58.819569 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:58.818791    4510 generic.go:356] "Generic (PLEG): container finished" podID="9adff17e-e54f-49ff-81b8-ca15f741436f" containerID="5a143487fb8a7391ed3b94dae5853832651808ea809c121cf5437e38a9d22b2a" exitCode=0
Nov 04 03:20:58.819569 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:58.818839    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz" event={"ID":"9adff17e-e54f-49ff-81b8-ca15f741436f","Type":"ContainerDied","Data":"5a143487fb8a7391ed3b94dae5853832651808ea809c121cf5437e38a9d22b2a"}
Nov 04 03:20:59.831034 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:59.830994    4510 generic.go:356] "Generic (PLEG): container finished" podID="55dc3a4e-e026-4207-87bb-d9ca844f4945" containerID="49191044108f342b57cb45c3501ba5c3475a13f5be621601510f0a02ff8466f1" exitCode=0
Nov 04 03:20:59.831523 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:20:59.831110    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv" event={"ID":"55dc3a4e-e026-4207-87bb-d9ca844f4945","Type":"ContainerDied","Data":"49191044108f342b57cb45c3501ba5c3475a13f5be621601510f0a02ff8466f1"}
Nov 04 03:21:01.849751 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:01.848482    4510 generic.go:356] "Generic (PLEG): container finished" podID="a8bc1d6f-8070-4737-9b53-0eead76cc3bc" containerID="d26fb11275b92ac25060137604c42708f595ba8bf224912eca61e59f0230df98" exitCode=0
Nov 04 03:21:01.849751 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:01.848577    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz" event={"ID":"a8bc1d6f-8070-4737-9b53-0eead76cc3bc","Type":"ContainerDied","Data":"d26fb11275b92ac25060137604c42708f595ba8bf224912eca61e59f0230df98"}
Nov 04 03:21:03.864712 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:03.863965    4510 generic.go:356] "Generic (PLEG): container finished" podID="a8bc1d6f-8070-4737-9b53-0eead76cc3bc" containerID="a1854ddea0ed72ef004ca286d37471c063aa38c4241bfa50d1b5be291a89a6e9" exitCode=0
Nov 04 03:21:03.864712 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:03.864089    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz" event={"ID":"a8bc1d6f-8070-4737-9b53-0eead76cc3bc","Type":"ContainerDied","Data":"a1854ddea0ed72ef004ca286d37471c063aa38c4241bfa50d1b5be291a89a6e9"}
Nov 04 03:21:03.867926 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:03.867886    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4" event={"ID":"d3259809-ebd8-411f-9bf2-4159939abd28","Type":"ContainerStarted","Data":"53ddb9d888bbb61d6eaa9208cfbaa8180542fa45099744af5b06f3a766154b7b"}
Nov 04 03:21:03.871718 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:03.871407    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w" event={"ID":"ef925236-de11-4c72-af67-fdac2cbb42e0","Type":"ContainerStarted","Data":"e71afaa4bc0d293df2d32b1af201f9aeb843f51e1bcdd1a49de4e9f553a6a941"}
Nov 04 03:21:03.876444 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:03.875724    4510 generic.go:356] "Generic (PLEG): container finished" podID="1ec46cc8-a6ee-468d-a70c-ea0f57465802" containerID="411099226d307be7f2255c5892bcec60800f4d784fd8fb9ce19ffaef5144bae0" exitCode=0
Nov 04 03:21:03.876444 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:03.875813    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6" event={"ID":"1ec46cc8-a6ee-468d-a70c-ea0f57465802","Type":"ContainerDied","Data":"411099226d307be7f2255c5892bcec60800f4d784fd8fb9ce19ffaef5144bae0"}
Nov 04 03:21:03.879422 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:03.879399    4510 generic.go:356] "Generic (PLEG): container finished" podID="d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c" containerID="83f1a1536e024e972693c91f73262c73b628791c5af8c9f9efa78e14ddc57b43" exitCode=0
Nov 04 03:21:03.879529 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:03.879459    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q" event={"ID":"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c","Type":"ContainerDied","Data":"83f1a1536e024e972693c91f73262c73b628791c5af8c9f9efa78e14ddc57b43"}
Nov 04 03:21:04.885416 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:04.885373    4510 generic.go:356] "Generic (PLEG): container finished" podID="bf6bef9e-71e7-4008-9d13-e28f96d691a3" containerID="5fde2d229c4948ec19d3e403358f0cfceba5747c370ac0c6b48e2674d5614fbd" exitCode=0
Nov 04 03:21:04.885897 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:04.885516    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq" event={"ID":"bf6bef9e-71e7-4008-9d13-e28f96d691a3","Type":"ContainerDied","Data":"5fde2d229c4948ec19d3e403358f0cfceba5747c370ac0c6b48e2674d5614fbd"}
Nov 04 03:21:04.888547 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:04.888494    4510 generic.go:356] "Generic (PLEG): container finished" podID="d3259809-ebd8-411f-9bf2-4159939abd28" containerID="53ddb9d888bbb61d6eaa9208cfbaa8180542fa45099744af5b06f3a766154b7b" exitCode=0
Nov 04 03:21:04.888698 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:04.888650    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4" event={"ID":"d3259809-ebd8-411f-9bf2-4159939abd28","Type":"ContainerDied","Data":"53ddb9d888bbb61d6eaa9208cfbaa8180542fa45099744af5b06f3a766154b7b"}
Nov 04 03:21:04.890567 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:04.890543    4510 generic.go:356] "Generic (PLEG): container finished" podID="ef925236-de11-4c72-af67-fdac2cbb42e0" containerID="e71afaa4bc0d293df2d32b1af201f9aeb843f51e1bcdd1a49de4e9f553a6a941" exitCode=0
Nov 04 03:21:04.890665 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:04.890628    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w" event={"ID":"ef925236-de11-4c72-af67-fdac2cbb42e0","Type":"ContainerDied","Data":"e71afaa4bc0d293df2d32b1af201f9aeb843f51e1bcdd1a49de4e9f553a6a941"}
Nov 04 03:21:05.897277 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:05.897236    4510 generic.go:356] "Generic (PLEG): container finished" podID="55dc3a4e-e026-4207-87bb-d9ca844f4945" containerID="4388f5c41b5edfef452c3504d2a65a5b6e4c934e62b262fa14544ecd8aa031f7" exitCode=0
Nov 04 03:21:05.898000 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:05.897304    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv" event={"ID":"55dc3a4e-e026-4207-87bb-d9ca844f4945","Type":"ContainerDied","Data":"4388f5c41b5edfef452c3504d2a65a5b6e4c934e62b262fa14544ecd8aa031f7"}
Nov 04 03:21:05.899964 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:05.899864    4510 generic.go:356] "Generic (PLEG): container finished" podID="1ec46cc8-a6ee-468d-a70c-ea0f57465802" containerID="3c4f8c8d0b06446f2ea715f2bc74fcb15759099fefc10f84e1cc005321b9188f" exitCode=0
Nov 04 03:21:05.899964 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:05.899942    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6" event={"ID":"1ec46cc8-a6ee-468d-a70c-ea0f57465802","Type":"ContainerDied","Data":"3c4f8c8d0b06446f2ea715f2bc74fcb15759099fefc10f84e1cc005321b9188f"}
Nov 04 03:21:05.902413 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:05.902394    4510 generic.go:356] "Generic (PLEG): container finished" podID="d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c" containerID="ac6e56890fd99696032014db3b94dee8bb2240e5ab4da9437825f13847329b5a" exitCode=0
Nov 04 03:21:05.902488 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:05.902470    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q" event={"ID":"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c","Type":"ContainerDied","Data":"ac6e56890fd99696032014db3b94dee8bb2240e5ab4da9437825f13847329b5a"}
Nov 04 03:21:05.904075 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:05.904056    4510 generic.go:356] "Generic (PLEG): container finished" podID="43c3983a-60b4-408f-868d-8657bdf6b2e2" containerID="7e2efd43376549c5a93c940f2f8e23a9bf665a8eeb2ce3ef50a380b4ce0e3731" exitCode=0
Nov 04 03:21:05.904162 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:05.904090    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh" event={"ID":"43c3983a-60b4-408f-868d-8657bdf6b2e2","Type":"ContainerDied","Data":"7e2efd43376549c5a93c940f2f8e23a9bf665a8eeb2ce3ef50a380b4ce0e3731"}
Nov 04 03:21:06.917450 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:06.917158    4510 generic.go:356] "Generic (PLEG): container finished" podID="d3259809-ebd8-411f-9bf2-4159939abd28" containerID="7ccf52b72971aa38708957310466ab7b5940f094e752dd542094ad18527a67ed" exitCode=0
Nov 04 03:21:06.917877 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:06.917491    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4" event={"ID":"d3259809-ebd8-411f-9bf2-4159939abd28","Type":"ContainerDied","Data":"7ccf52b72971aa38708957310466ab7b5940f094e752dd542094ad18527a67ed"}
Nov 04 03:21:06.924438 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:06.924387    4510 generic.go:356] "Generic (PLEG): container finished" podID="ef925236-de11-4c72-af67-fdac2cbb42e0" containerID="1621c1e83537cc12effeb34711533682851a4eda97e3dc464e281bbcefa64b5d" exitCode=0
Nov 04 03:21:06.924612 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:06.924591    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w" event={"ID":"ef925236-de11-4c72-af67-fdac2cbb42e0","Type":"ContainerDied","Data":"1621c1e83537cc12effeb34711533682851a4eda97e3dc464e281bbcefa64b5d"}
Nov 04 03:21:06.928956 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:06.928926    4510 generic.go:356] "Generic (PLEG): container finished" podID="43c3983a-60b4-408f-868d-8657bdf6b2e2" containerID="f55549356f36b703fdd7335f74490c2ddc403059d9ba946bafc51153150a0bc8" exitCode=0
Nov 04 03:21:06.929057 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:06.929007    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh" event={"ID":"43c3983a-60b4-408f-868d-8657bdf6b2e2","Type":"ContainerDied","Data":"f55549356f36b703fdd7335f74490c2ddc403059d9ba946bafc51153150a0bc8"}
Nov 04 03:21:11.970823 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:11.970783    4510 generic.go:356] "Generic (PLEG): container finished" podID="bf6bef9e-71e7-4008-9d13-e28f96d691a3" containerID="1e8f22e3e2d48287f2d7a76caf5cf43f565673fa667d0c6eca09936bdbb3aa63" exitCode=0
Nov 04 03:21:11.971282 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:11.970837    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq" event={"ID":"bf6bef9e-71e7-4008-9d13-e28f96d691a3","Type":"ContainerDied","Data":"1e8f22e3e2d48287f2d7a76caf5cf43f565673fa667d0c6eca09936bdbb3aa63"}
Nov 04 03:21:12.986490 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:12.985455    4510 generic.go:356] "Generic (PLEG): container finished" podID="9adff17e-e54f-49ff-81b8-ca15f741436f" containerID="15c4ec8c9646ffcc075494f7f6e08cb5b2c25505ff05812ce241ba3cf6cc29cb" exitCode=0
Nov 04 03:21:12.986490 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:12.985555    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz" event={"ID":"9adff17e-e54f-49ff-81b8-ca15f741436f","Type":"ContainerDied","Data":"15c4ec8c9646ffcc075494f7f6e08cb5b2c25505ff05812ce241ba3cf6cc29cb"}
Nov 04 03:21:15.535133 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.535091    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"]
Nov 04 03:21:15.538010 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.537981    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.591065 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.591033    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 04 03:21:15.595612 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.595576    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.595784 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.595647    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptshj\" (UniqueName: \"kubernetes.io/projected/85cb4aab-7613-481a-af4c-228be87df8c9-kube-api-access-ptshj\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.595784 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.595696    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.595784 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.595738    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85cb4aab-7613-481a-af4c-228be87df8c9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.595784 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.595776    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85cb4aab-7613-481a-af4c-228be87df8c9-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.596010 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.595811    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85cb4aab-7613-481a-af4c-228be87df8c9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.596010 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.595851    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.596010 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.595902    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.596010 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.595926    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.613011 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.612873    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 04 03:21:15.613011 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.612937    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 04 03:21:15.640732 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.640632    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-cr7gn\""
Nov 04 03:21:15.654987 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.654894    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"]
Nov 04 03:21:15.699462 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.696458    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85cb4aab-7613-481a-af4c-228be87df8c9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.699462 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.696522    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85cb4aab-7613-481a-af4c-228be87df8c9-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.699462 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.696567    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85cb4aab-7613-481a-af4c-228be87df8c9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.699462 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.696640    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.699462 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.696716    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.699462 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.696745    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.699462 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.696791    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.699462 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.696843    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptshj\" (UniqueName: \"kubernetes.io/projected/85cb4aab-7613-481a-af4c-228be87df8c9-kube-api-access-ptshj\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.699462 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.696876    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.699462 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.697314    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.699462 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.698017    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85cb4aab-7613-481a-af4c-228be87df8c9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.699462 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.699037    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.700839 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.700662    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.700839 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.700695    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.723791 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.723741    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85cb4aab-7613-481a-af4c-228be87df8c9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.736723 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.736670    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.762728 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.762694    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85cb4aab-7613-481a-af4c-228be87df8c9-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.779047 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.778977    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptshj\" (UniqueName: \"kubernetes.io/projected/85cb4aab-7613-481a-af4c-228be87df8c9-kube-api-access-ptshj\") pod \"maas-default-gateway-openshift-default-6dcf757899-mpwlf\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.856832 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.856541    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:15.873313 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.871809    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"]
Nov 04 03:21:15.875554 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.874937    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:15.928657 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.928600    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-kzggw\""
Nov 04 03:21:15.942371 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:15.942177    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"]
Nov 04 03:21:16.002337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.002298    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daf49b68-23ca-478a-a48d-06db0f2f1760-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.002537 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.002375    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5npql\" (UniqueName: \"kubernetes.io/projected/daf49b68-23ca-478a-a48d-06db0f2f1760-kube-api-access-5npql\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.002537 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.002424    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daf49b68-23ca-478a-a48d-06db0f2f1760-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.002537 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.002462    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daf49b68-23ca-478a-a48d-06db0f2f1760-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.002537 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.002521    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daf49b68-23ca-478a-a48d-06db0f2f1760-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.002779 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.002562    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daf49b68-23ca-478a-a48d-06db0f2f1760-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.002779 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.002594    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daf49b68-23ca-478a-a48d-06db0f2f1760-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.002779 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.002624    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daf49b68-23ca-478a-a48d-06db0f2f1760-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.002779 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.002648    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daf49b68-23ca-478a-a48d-06db0f2f1760-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.103294 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.103250    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daf49b68-23ca-478a-a48d-06db0f2f1760-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.103488 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.103325    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daf49b68-23ca-478a-a48d-06db0f2f1760-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.103488 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.103362    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daf49b68-23ca-478a-a48d-06db0f2f1760-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.103488 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.103393    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daf49b68-23ca-478a-a48d-06db0f2f1760-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.103488 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.103420    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daf49b68-23ca-478a-a48d-06db0f2f1760-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.103488 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.103444    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daf49b68-23ca-478a-a48d-06db0f2f1760-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.103488 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.103479    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daf49b68-23ca-478a-a48d-06db0f2f1760-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.103838 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.103530    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5npql\" (UniqueName: \"kubernetes.io/projected/daf49b68-23ca-478a-a48d-06db0f2f1760-kube-api-access-5npql\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.103838 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.103572    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daf49b68-23ca-478a-a48d-06db0f2f1760-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.104111 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.103944    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daf49b68-23ca-478a-a48d-06db0f2f1760-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.104631 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.104607    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daf49b68-23ca-478a-a48d-06db0f2f1760-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.105453 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.104925    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daf49b68-23ca-478a-a48d-06db0f2f1760-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.105453 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.105162    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daf49b68-23ca-478a-a48d-06db0f2f1760-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.105453 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.105262    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daf49b68-23ca-478a-a48d-06db0f2f1760-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.108453 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.108402    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daf49b68-23ca-478a-a48d-06db0f2f1760-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.108560 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.108537    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daf49b68-23ca-478a-a48d-06db0f2f1760-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.175804 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.175700    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daf49b68-23ca-478a-a48d-06db0f2f1760-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.179236 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.179179    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5npql\" (UniqueName: \"kubernetes.io/projected/daf49b68-23ca-478a-a48d-06db0f2f1760-kube-api-access-5npql\") pod \"openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk\" (UID: \"daf49b68-23ca-478a-a48d-06db0f2f1760\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.200923 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.200886    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:16.365963 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.365826    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"]
Nov 04 03:21:16.371832 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:21:16.371791    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85cb4aab_7613_481a_af4c_228be87df8c9.slice/crio-65af33d0b0425e2eac8aed85e6a8db812d0cc6edffc3b1afcb58e7e7c2b29f27 WatchSource:0}: Error finding container 65af33d0b0425e2eac8aed85e6a8db812d0cc6edffc3b1afcb58e7e7c2b29f27: Status 404 returned error can't find the container with id 65af33d0b0425e2eac8aed85e6a8db812d0cc6edffc3b1afcb58e7e7c2b29f27
Nov 04 03:21:16.660505 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:16.660305    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"]
Nov 04 03:21:16.668500 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:21:16.668457    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaf49b68_23ca_478a_a48d_06db0f2f1760.slice/crio-ffb2fa8667f1a4f3c071862d7b89510c3747cf0fe7d6f6ea4bf67fd3d955401e WatchSource:0}: Error finding container ffb2fa8667f1a4f3c071862d7b89510c3747cf0fe7d6f6ea4bf67fd3d955401e: Status 404 returned error can't find the container with id ffb2fa8667f1a4f3c071862d7b89510c3747cf0fe7d6f6ea4bf67fd3d955401e
Nov 04 03:21:17.034629 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:17.034586    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk" event={"ID":"daf49b68-23ca-478a-a48d-06db0f2f1760","Type":"ContainerStarted","Data":"ffb2fa8667f1a4f3c071862d7b89510c3747cf0fe7d6f6ea4bf67fd3d955401e"}
Nov 04 03:21:17.042901 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:17.042861    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf" event={"ID":"85cb4aab-7613-481a-af4c-228be87df8c9","Type":"ContainerStarted","Data":"65af33d0b0425e2eac8aed85e6a8db812d0cc6edffc3b1afcb58e7e7c2b29f27"}
Nov 04 03:21:21.089440 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:21.088504    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz" event={"ID":"a8bc1d6f-8070-4737-9b53-0eead76cc3bc","Type":"ContainerStarted","Data":"57688861423da069506749f64b65b0cbfacccf1a8c41dd73e91a3f103228b0e7"}
Nov 04 03:21:21.223374 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:21.223309    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz" podStartSLOduration=4.031258108 podStartE2EDuration="30.223287814s" totalImagesPullingTime="26.192029706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:20:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:21:21.220984769 +0000 UTC m=+256.484859080" watchObservedRunningTime="2026-11-04 03:21:21.223287814 +0000 UTC m=+256.487162123"
Nov 04 03:21:22.105805 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:22.105413    4510 generic.go:356] "Generic (PLEG): container finished" podID="a8bc1d6f-8070-4737-9b53-0eead76cc3bc" containerID="57688861423da069506749f64b65b0cbfacccf1a8c41dd73e91a3f103228b0e7" exitCode=0
Nov 04 03:21:22.105805 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:22.105494    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz" event={"ID":"a8bc1d6f-8070-4737-9b53-0eead76cc3bc","Type":"ContainerDied","Data":"57688861423da069506749f64b65b0cbfacccf1a8c41dd73e91a3f103228b0e7"}
Nov 04 03:21:23.348841 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:21:23.348806    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:21:23.429655 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:23.429451    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz"
Nov 04 03:21:23.475417 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:23.475384    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-util\" (UniqueName: \"kubernetes.io/empty-dir/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-util\") pod \"a8bc1d6f-8070-4737-9b53-0eead76cc3bc\" (UID: \"a8bc1d6f-8070-4737-9b53-0eead76cc3bc\") "
Nov 04 03:21:23.475625 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:23.475430    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-bundle\") pod \"a8bc1d6f-8070-4737-9b53-0eead76cc3bc\" (UID: \"a8bc1d6f-8070-4737-9b53-0eead76cc3bc\") "
Nov 04 03:21:23.475625 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:23.475469    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-kube-api-access-f2swc\" (UniqueName: \"kubernetes.io/projected/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-kube-api-access-f2swc\") pod \"a8bc1d6f-8070-4737-9b53-0eead76cc3bc\" (UID: \"a8bc1d6f-8070-4737-9b53-0eead76cc3bc\") "
Nov 04 03:21:23.477148 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:23.477113    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-bundle" pod "a8bc1d6f-8070-4737-9b53-0eead76cc3bc" (UID: "a8bc1d6f-8070-4737-9b53-0eead76cc3bc"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:21:23.482544 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:23.482495    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-util" pod "a8bc1d6f-8070-4737-9b53-0eead76cc3bc" (UID: "a8bc1d6f-8070-4737-9b53-0eead76cc3bc"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:21:23.494508 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:23.494410    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-kube-api-access-f2swc" pod "a8bc1d6f-8070-4737-9b53-0eead76cc3bc" (UID: "a8bc1d6f-8070-4737-9b53-0eead76cc3bc"). InnerVolumeSpecName "kube-api-access-f2swc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:21:23.577070 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:23.576316    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f2swc\" (UniqueName: \"kubernetes.io/projected/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-kube-api-access-f2swc\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:23.577070 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:23.576359    4510 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-util\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:23.577070 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:23.576374    4510 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a8bc1d6f-8070-4737-9b53-0eead76cc3bc-bundle\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:24.134337 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:24.134284    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz" event={"ID":"a8bc1d6f-8070-4737-9b53-0eead76cc3bc","Type":"ContainerDied","Data":"db7dad869f6fd1880baa993b3cee0bcfec24850af145678a09b81ff6e9550a25"}
Nov 04 03:21:24.134543 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:24.134429    4510 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db7dad869f6fd1880baa993b3cee0bcfec24850af145678a09b81ff6e9550a25"
Nov 04 03:21:24.134612 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:24.134544    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be71j5xjz"
Nov 04 03:21:25.146170 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:25.145300    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq" event={"ID":"bf6bef9e-71e7-4008-9d13-e28f96d691a3","Type":"ContainerStarted","Data":"b1e15847d43ee15f01f30d9496631d85e2a325d666a7b7a03eda7ecfae5a0a17"}
Nov 04 03:21:25.314757 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:25.314629    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq" podStartSLOduration=3.34616892 podStartE2EDuration="31.314609803s" totalImagesPullingTime="27.968440883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:20:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:21:25.312975193 +0000 UTC m=+260.576849490" watchObservedRunningTime="2026-11-04 03:21:25.314609803 +0000 UTC m=+260.578484107"
Nov 04 03:21:26.154260 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:26.153706    4510 generic.go:356] "Generic (PLEG): container finished" podID="55dc3a4e-e026-4207-87bb-d9ca844f4945" containerID="c6061ee353412865adb8926cf34591cbe805da20794453f9b3527711e5bc7ee2" exitCode=0
Nov 04 03:21:26.154260 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:26.153817    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv" event={"ID":"55dc3a4e-e026-4207-87bb-d9ca844f4945","Type":"ContainerDied","Data":"c6061ee353412865adb8926cf34591cbe805da20794453f9b3527711e5bc7ee2"}
Nov 04 03:21:26.158066 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:26.158025    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz" event={"ID":"9adff17e-e54f-49ff-81b8-ca15f741436f","Type":"ContainerStarted","Data":"9c997bafa4d2ef08ddef625de2387b631ad25ca6ba8df824a3312c4ad46e258d"}
Nov 04 03:21:26.162546 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:26.162478    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6" event={"ID":"1ec46cc8-a6ee-468d-a70c-ea0f57465802","Type":"ContainerStarted","Data":"9b274c670c54a5457c967255a7d25dce4cac38d2378fee6bf84abc0c4a8f7bf6"}
Nov 04 03:21:26.171299 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:26.171268    4510 generic.go:356] "Generic (PLEG): container finished" podID="d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c" containerID="7704e632c685426a37e42d422f23894191cacbd128ff8620d99a479e4369adc9" exitCode=0
Nov 04 03:21:26.171459 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:26.171389    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q" event={"ID":"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c","Type":"ContainerDied","Data":"7704e632c685426a37e42d422f23894191cacbd128ff8620d99a479e4369adc9"}
Nov 04 03:21:26.176038 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:26.175993    4510 generic.go:356] "Generic (PLEG): container finished" podID="bf6bef9e-71e7-4008-9d13-e28f96d691a3" containerID="b1e15847d43ee15f01f30d9496631d85e2a325d666a7b7a03eda7ecfae5a0a17" exitCode=0
Nov 04 03:21:26.176177 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:26.176044    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq" event={"ID":"bf6bef9e-71e7-4008-9d13-e28f96d691a3","Type":"ContainerDied","Data":"b1e15847d43ee15f01f30d9496631d85e2a325d666a7b7a03eda7ecfae5a0a17"}
Nov 04 03:21:26.262877 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:26.262837    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:21:26.263000 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:26.262927    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:21:26.263000 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:26.262972    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:21:26.420572 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:26.420521    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:21:26.420752 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:26.420625    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:21:26.420752 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:26.420672    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:21:26.520358 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:26.515526    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6" podStartSLOduration=3.370159881 podStartE2EDuration="34.515507799s" totalImagesPullingTime="31.145347918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:20:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:21:26.396472639 +0000 UTC m=+261.660346938" watchObservedRunningTime="2026-11-04 03:21:26.515507799 +0000 UTC m=+261.779382106"
Nov 04 03:21:26.635354 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:26.635296    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz" podStartSLOduration=3.840017254 podStartE2EDuration="39.635277621s" totalImagesPullingTime="35.795260367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:20:47 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:21:26.633588663 +0000 UTC m=+261.897462983" watchObservedRunningTime="2026-11-04 03:21:26.635277621 +0000 UTC m=+261.899151929"
Nov 04 03:21:27.181832 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.181797    4510 generic.go:356] "Generic (PLEG): container finished" podID="1ec46cc8-a6ee-468d-a70c-ea0f57465802" containerID="9b274c670c54a5457c967255a7d25dce4cac38d2378fee6bf84abc0c4a8f7bf6" exitCode=0
Nov 04 03:21:27.182277 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.181881    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6" event={"ID":"1ec46cc8-a6ee-468d-a70c-ea0f57465802","Type":"ContainerDied","Data":"9b274c670c54a5457c967255a7d25dce4cac38d2378fee6bf84abc0c4a8f7bf6"}
Nov 04 03:21:27.183927 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.183895    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh" event={"ID":"43c3983a-60b4-408f-868d-8657bdf6b2e2","Type":"ContainerStarted","Data":"2a24eff469dfcf872d937aa6813d0b712da193f3fdb819f14604c45040d35695"}
Nov 04 03:21:27.185401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.185380    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk" event={"ID":"daf49b68-23ca-478a-a48d-06db0f2f1760","Type":"ContainerStarted","Data":"2df57f991dbc1dfebdd19b6d5db67fad56230ada06476b99dae3a44713cd2cae"}
Nov 04 03:21:27.186882 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.186825    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf" event={"ID":"85cb4aab-7613-481a-af4c-228be87df8c9","Type":"ContainerStarted","Data":"7e46aa0f8ee424bbb32cfa7b40d63e269e06aadbaf6882763c634dc519a68632"}
Nov 04 03:21:27.188852 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.188830    4510 generic.go:356] "Generic (PLEG): container finished" podID="9adff17e-e54f-49ff-81b8-ca15f741436f" containerID="9c997bafa4d2ef08ddef625de2387b631ad25ca6ba8df824a3312c4ad46e258d" exitCode=0
Nov 04 03:21:27.188950 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.188906    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz" event={"ID":"9adff17e-e54f-49ff-81b8-ca15f741436f","Type":"ContainerDied","Data":"9c997bafa4d2ef08ddef625de2387b631ad25ca6ba8df824a3312c4ad46e258d"}
Nov 04 03:21:27.190842 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.190823    4510 generic.go:356] "Generic (PLEG): container finished" podID="d3259809-ebd8-411f-9bf2-4159939abd28" containerID="58403a8d5b4080f8d211fd65cbc027c5e2197335df14b3a98c68162c20c1ea91" exitCode=0
Nov 04 03:21:27.190916 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.190872    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4" event={"ID":"d3259809-ebd8-411f-9bf2-4159939abd28","Type":"ContainerDied","Data":"58403a8d5b4080f8d211fd65cbc027c5e2197335df14b3a98c68162c20c1ea91"}
Nov 04 03:21:27.192819 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.192802    4510 generic.go:356] "Generic (PLEG): container finished" podID="ef925236-de11-4c72-af67-fdac2cbb42e0" containerID="aa3b348f813602af51fb75dbe9c535c79b9aafcd0649bde89ae37b5a47a38320" exitCode=0
Nov 04 03:21:27.192924 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.192889    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w" event={"ID":"ef925236-de11-4c72-af67-fdac2cbb42e0","Type":"ContainerDied","Data":"aa3b348f813602af51fb75dbe9c535c79b9aafcd0649bde89ae37b5a47a38320"}
Nov 04 03:21:27.201874 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.201840    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:27.208104 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.208082    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:27.407866 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.407837    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq"
Nov 04 03:21:27.410951 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.410931    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q"
Nov 04 03:21:27.414150 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.414131    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv"
Nov 04 03:21:27.516924 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.516899    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf6bef9e-71e7-4008-9d13-e28f96d691a3-util\" (UniqueName: \"kubernetes.io/empty-dir/bf6bef9e-71e7-4008-9d13-e28f96d691a3-util\") pod \"bf6bef9e-71e7-4008-9d13-e28f96d691a3\" (UID: \"bf6bef9e-71e7-4008-9d13-e28f96d691a3\") "
Nov 04 03:21:27.517126 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.516935    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bf6bef9e-71e7-4008-9d13-e28f96d691a3-bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf6bef9e-71e7-4008-9d13-e28f96d691a3-bundle\") pod \"bf6bef9e-71e7-4008-9d13-e28f96d691a3\" (UID: \"bf6bef9e-71e7-4008-9d13-e28f96d691a3\") "
Nov 04 03:21:27.517126 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.516966    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-bundle\") pod \"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c\" (UID: \"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c\") "
Nov 04 03:21:27.517126 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.517003    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-util\" (UniqueName: \"kubernetes.io/empty-dir/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-util\") pod \"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c\" (UID: \"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c\") "
Nov 04 03:21:27.517126 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.517028    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-kube-api-access-xrgsn\" (UniqueName: \"kubernetes.io/projected/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-kube-api-access-xrgsn\") pod \"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c\" (UID: \"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c\") "
Nov 04 03:21:27.517126 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.517071    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55dc3a4e-e026-4207-87bb-d9ca844f4945-util\" (UniqueName: \"kubernetes.io/empty-dir/55dc3a4e-e026-4207-87bb-d9ca844f4945-util\") pod \"55dc3a4e-e026-4207-87bb-d9ca844f4945\" (UID: \"55dc3a4e-e026-4207-87bb-d9ca844f4945\") "
Nov 04 03:21:27.517126 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.517091    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bf6bef9e-71e7-4008-9d13-e28f96d691a3-kube-api-access-7j245\" (UniqueName: \"kubernetes.io/projected/bf6bef9e-71e7-4008-9d13-e28f96d691a3-kube-api-access-7j245\") pod \"bf6bef9e-71e7-4008-9d13-e28f96d691a3\" (UID: \"bf6bef9e-71e7-4008-9d13-e28f96d691a3\") "
Nov 04 03:21:27.517126 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.517119    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/55dc3a4e-e026-4207-87bb-d9ca844f4945-kube-api-access-929bn\" (UniqueName: \"kubernetes.io/projected/55dc3a4e-e026-4207-87bb-d9ca844f4945-kube-api-access-929bn\") pod \"55dc3a4e-e026-4207-87bb-d9ca844f4945\" (UID: \"55dc3a4e-e026-4207-87bb-d9ca844f4945\") "
Nov 04 03:21:27.517491 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.517157    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/55dc3a4e-e026-4207-87bb-d9ca844f4945-bundle\" (UniqueName: \"kubernetes.io/empty-dir/55dc3a4e-e026-4207-87bb-d9ca844f4945-bundle\") pod \"55dc3a4e-e026-4207-87bb-d9ca844f4945\" (UID: \"55dc3a4e-e026-4207-87bb-d9ca844f4945\") "
Nov 04 03:21:27.517491 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.517417    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf6bef9e-71e7-4008-9d13-e28f96d691a3-bundle" pod "bf6bef9e-71e7-4008-9d13-e28f96d691a3" (UID: "bf6bef9e-71e7-4008-9d13-e28f96d691a3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:21:27.517635 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.517613    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-bundle" pod "d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c" (UID: "d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:21:27.518313 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.518143    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55dc3a4e-e026-4207-87bb-d9ca844f4945-bundle" pod "55dc3a4e-e026-4207-87bb-d9ca844f4945" (UID: "55dc3a4e-e026-4207-87bb-d9ca844f4945"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:21:27.520135 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.520108    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55dc3a4e-e026-4207-87bb-d9ca844f4945-kube-api-access-929bn" pod "55dc3a4e-e026-4207-87bb-d9ca844f4945" (UID: "55dc3a4e-e026-4207-87bb-d9ca844f4945"). InnerVolumeSpecName "kube-api-access-929bn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:21:27.520225 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.520171    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-kube-api-access-xrgsn" pod "d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c" (UID: "d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c"). InnerVolumeSpecName "kube-api-access-xrgsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:21:27.523010 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.522986    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf6bef9e-71e7-4008-9d13-e28f96d691a3-kube-api-access-7j245" pod "bf6bef9e-71e7-4008-9d13-e28f96d691a3" (UID: "bf6bef9e-71e7-4008-9d13-e28f96d691a3"). InnerVolumeSpecName "kube-api-access-7j245". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:21:27.524659 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.524638    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-util" pod "d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c" (UID: "d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:21:27.525600 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.525569    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55dc3a4e-e026-4207-87bb-d9ca844f4945-util" pod "55dc3a4e-e026-4207-87bb-d9ca844f4945" (UID: "55dc3a4e-e026-4207-87bb-d9ca844f4945"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:21:27.525846 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.525828    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf6bef9e-71e7-4008-9d13-e28f96d691a3-util" pod "bf6bef9e-71e7-4008-9d13-e28f96d691a3" (UID: "bf6bef9e-71e7-4008-9d13-e28f96d691a3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:21:27.542869 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.542824    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk" podStartSLOduration=2.798363759 podStartE2EDuration="12.542809771s" totalImagesPullingTime="9.744446012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:21:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:21:27.541599354 +0000 UTC m=+262.805473661" watchObservedRunningTime="2026-11-04 03:21:27.542809771 +0000 UTC m=+262.806684077"
Nov 04 03:21:27.618478 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.618438    4510 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-bundle\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:27.618478 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.618469    4510 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-util\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:27.618478 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.618478    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrgsn\" (UniqueName: \"kubernetes.io/projected/d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c-kube-api-access-xrgsn\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:27.618478 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.618489    4510 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/55dc3a4e-e026-4207-87bb-d9ca844f4945-util\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:27.618773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.618498    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j245\" (UniqueName: \"kubernetes.io/projected/bf6bef9e-71e7-4008-9d13-e28f96d691a3-kube-api-access-7j245\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:27.618773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.618506    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-929bn\" (UniqueName: \"kubernetes.io/projected/55dc3a4e-e026-4207-87bb-d9ca844f4945-kube-api-access-929bn\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:27.618773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.618515    4510 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/55dc3a4e-e026-4207-87bb-d9ca844f4945-bundle\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:27.618773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.618523    4510 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf6bef9e-71e7-4008-9d13-e28f96d691a3-util\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:27.618773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.618530    4510 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf6bef9e-71e7-4008-9d13-e28f96d691a3-bundle\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:27.660918 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.660866    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh" podStartSLOduration=4.219991434 podStartE2EDuration="32.660851317s" totalImagesPullingTime="28.440859883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:20:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:21:27.660278301 +0000 UTC m=+262.924152608" watchObservedRunningTime="2026-11-04 03:21:27.660851317 +0000 UTC m=+262.924725623"
Nov 04 03:21:27.781716 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.781586    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf" podStartSLOduration=2.902114643 podStartE2EDuration="12.781568598s" totalImagesPullingTime="9.879453955s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:21:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:21:27.780936412 +0000 UTC m=+263.044810720" watchObservedRunningTime="2026-11-04 03:21:27.781568598 +0000 UTC m=+263.045442909"
Nov 04 03:21:27.857457 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.857419    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:27.862066 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:27.862034    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:28.199369 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.199290    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq"
Nov 04 03:21:28.199890 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.199289    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644p8qhq" event={"ID":"bf6bef9e-71e7-4008-9d13-e28f96d691a3","Type":"ContainerDied","Data":"cde8fe3eaa86a342b390fb8dc60158755689c11ef78bac0b7e63d2d29ee3c8f1"}
Nov 04 03:21:28.199890 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.199442    4510 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cde8fe3eaa86a342b390fb8dc60158755689c11ef78bac0b7e63d2d29ee3c8f1"
Nov 04 03:21:28.201286 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.201267    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv"
Nov 04 03:21:28.201383 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.201309    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cxcthv" event={"ID":"55dc3a4e-e026-4207-87bb-d9ca844f4945","Type":"ContainerDied","Data":"503c9ff2fbad596f3702eb8a3bcd5d6f91592fe67e0d70f7259869c46e0c2356"}
Nov 04 03:21:28.201383 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.201346    4510 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="503c9ff2fbad596f3702eb8a3bcd5d6f91592fe67e0d70f7259869c46e0c2356"
Nov 04 03:21:28.203355 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.203326    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q" event={"ID":"d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c","Type":"ContainerDied","Data":"b9c4f6ddc76e48dca2f4ec8cda0037213cde056effb180cabb6662d8570c83e5"}
Nov 04 03:21:28.203475 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.203367    4510 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9c4f6ddc76e48dca2f4ec8cda0037213cde056effb180cabb6662d8570c83e5"
Nov 04 03:21:28.203475 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.203332    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6vv96q"
Nov 04 03:21:28.205634 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.205608    4510 generic.go:356] "Generic (PLEG): container finished" podID="43c3983a-60b4-408f-868d-8657bdf6b2e2" containerID="2a24eff469dfcf872d937aa6813d0b712da193f3fdb819f14604c45040d35695" exitCode=0
Nov 04 03:21:28.205751 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.205690    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh" event={"ID":"43c3983a-60b4-408f-868d-8657bdf6b2e2","Type":"ContainerDied","Data":"2a24eff469dfcf872d937aa6813d0b712da193f3fdb819f14604c45040d35695"}
Nov 04 03:21:28.207363 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.206899    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:28.207363 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.206974    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:28.207563 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.207544    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:21:28.208771 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.208468    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk"
Nov 04 03:21:28.389375 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.389340    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6"
Nov 04 03:21:28.416012 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.415986    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz"
Nov 04 03:21:28.429889 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.429869    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4"
Nov 04 03:21:28.432769 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.432748    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w"
Nov 04 03:21:28.523694 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.523640    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9adff17e-e54f-49ff-81b8-ca15f741436f-kube-api-access-brqxk\" (UniqueName: \"kubernetes.io/projected/9adff17e-e54f-49ff-81b8-ca15f741436f-kube-api-access-brqxk\") pod \"9adff17e-e54f-49ff-81b8-ca15f741436f\" (UID: \"9adff17e-e54f-49ff-81b8-ca15f741436f\") "
Nov 04 03:21:28.523852 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.523709    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9adff17e-e54f-49ff-81b8-ca15f741436f-bundle\" (UniqueName: \"kubernetes.io/empty-dir/9adff17e-e54f-49ff-81b8-ca15f741436f-bundle\") pod \"9adff17e-e54f-49ff-81b8-ca15f741436f\" (UID: \"9adff17e-e54f-49ff-81b8-ca15f741436f\") "
Nov 04 03:21:28.523852 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.523748    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ec46cc8-a6ee-468d-a70c-ea0f57465802-kube-api-access-jfkqm\" (UniqueName: \"kubernetes.io/projected/1ec46cc8-a6ee-468d-a70c-ea0f57465802-kube-api-access-jfkqm\") pod \"1ec46cc8-a6ee-468d-a70c-ea0f57465802\" (UID: \"1ec46cc8-a6ee-468d-a70c-ea0f57465802\") "
Nov 04 03:21:28.523852 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.523769    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ec46cc8-a6ee-468d-a70c-ea0f57465802-bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec46cc8-a6ee-468d-a70c-ea0f57465802-bundle\") pod \"1ec46cc8-a6ee-468d-a70c-ea0f57465802\" (UID: \"1ec46cc8-a6ee-468d-a70c-ea0f57465802\") "
Nov 04 03:21:28.523852 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.523809    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3259809-ebd8-411f-9bf2-4159939abd28-util\" (UniqueName: \"kubernetes.io/empty-dir/d3259809-ebd8-411f-9bf2-4159939abd28-util\") pod \"d3259809-ebd8-411f-9bf2-4159939abd28\" (UID: \"d3259809-ebd8-411f-9bf2-4159939abd28\") "
Nov 04 03:21:28.523852 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.523846    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3259809-ebd8-411f-9bf2-4159939abd28-bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3259809-ebd8-411f-9bf2-4159939abd28-bundle\") pod \"d3259809-ebd8-411f-9bf2-4159939abd28\" (UID: \"d3259809-ebd8-411f-9bf2-4159939abd28\") "
Nov 04 03:21:28.524116 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.523873    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef925236-de11-4c72-af67-fdac2cbb42e0-util\" (UniqueName: \"kubernetes.io/empty-dir/ef925236-de11-4c72-af67-fdac2cbb42e0-util\") pod \"ef925236-de11-4c72-af67-fdac2cbb42e0\" (UID: \"ef925236-de11-4c72-af67-fdac2cbb42e0\") "
Nov 04 03:21:28.524116 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.523912    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d3259809-ebd8-411f-9bf2-4159939abd28-kube-api-access-b65r7\" (UniqueName: \"kubernetes.io/projected/d3259809-ebd8-411f-9bf2-4159939abd28-kube-api-access-b65r7\") pod \"d3259809-ebd8-411f-9bf2-4159939abd28\" (UID: \"d3259809-ebd8-411f-9bf2-4159939abd28\") "
Nov 04 03:21:28.524116 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.523950    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ef925236-de11-4c72-af67-fdac2cbb42e0-bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef925236-de11-4c72-af67-fdac2cbb42e0-bundle\") pod \"ef925236-de11-4c72-af67-fdac2cbb42e0\" (UID: \"ef925236-de11-4c72-af67-fdac2cbb42e0\") "
Nov 04 03:21:28.524116 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.523979    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ec46cc8-a6ee-468d-a70c-ea0f57465802-util\" (UniqueName: \"kubernetes.io/empty-dir/1ec46cc8-a6ee-468d-a70c-ea0f57465802-util\") pod \"1ec46cc8-a6ee-468d-a70c-ea0f57465802\" (UID: \"1ec46cc8-a6ee-468d-a70c-ea0f57465802\") "
Nov 04 03:21:28.524116 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.524009    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9adff17e-e54f-49ff-81b8-ca15f741436f-util\" (UniqueName: \"kubernetes.io/empty-dir/9adff17e-e54f-49ff-81b8-ca15f741436f-util\") pod \"9adff17e-e54f-49ff-81b8-ca15f741436f\" (UID: \"9adff17e-e54f-49ff-81b8-ca15f741436f\") "
Nov 04 03:21:28.524116 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.524059    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef925236-de11-4c72-af67-fdac2cbb42e0-kube-api-access-7j5mv\" (UniqueName: \"kubernetes.io/projected/ef925236-de11-4c72-af67-fdac2cbb42e0-kube-api-access-7j5mv\") pod \"ef925236-de11-4c72-af67-fdac2cbb42e0\" (UID: \"ef925236-de11-4c72-af67-fdac2cbb42e0\") "
Nov 04 03:21:28.524395 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.524348    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9adff17e-e54f-49ff-81b8-ca15f741436f-bundle" pod "9adff17e-e54f-49ff-81b8-ca15f741436f" (UID: "9adff17e-e54f-49ff-81b8-ca15f741436f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:21:28.526821 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.524875    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef925236-de11-4c72-af67-fdac2cbb42e0-bundle" pod "ef925236-de11-4c72-af67-fdac2cbb42e0" (UID: "ef925236-de11-4c72-af67-fdac2cbb42e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:21:28.526821 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.524888    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ec46cc8-a6ee-468d-a70c-ea0f57465802-bundle" pod "1ec46cc8-a6ee-468d-a70c-ea0f57465802" (UID: "1ec46cc8-a6ee-468d-a70c-ea0f57465802"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:21:28.526821 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.525342    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3259809-ebd8-411f-9bf2-4159939abd28-bundle" pod "d3259809-ebd8-411f-9bf2-4159939abd28" (UID: "d3259809-ebd8-411f-9bf2-4159939abd28"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:21:28.526821 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.526649    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9adff17e-e54f-49ff-81b8-ca15f741436f-kube-api-access-brqxk" pod "9adff17e-e54f-49ff-81b8-ca15f741436f" (UID: "9adff17e-e54f-49ff-81b8-ca15f741436f"). InnerVolumeSpecName "kube-api-access-brqxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:21:28.526821 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.526767    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef925236-de11-4c72-af67-fdac2cbb42e0-kube-api-access-7j5mv" pod "ef925236-de11-4c72-af67-fdac2cbb42e0" (UID: "ef925236-de11-4c72-af67-fdac2cbb42e0"). InnerVolumeSpecName "kube-api-access-7j5mv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:21:28.526821 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.526785    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ec46cc8-a6ee-468d-a70c-ea0f57465802-kube-api-access-jfkqm" pod "1ec46cc8-a6ee-468d-a70c-ea0f57465802" (UID: "1ec46cc8-a6ee-468d-a70c-ea0f57465802"). InnerVolumeSpecName "kube-api-access-jfkqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:21:28.527204 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.527185    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3259809-ebd8-411f-9bf2-4159939abd28-kube-api-access-b65r7" pod "d3259809-ebd8-411f-9bf2-4159939abd28" (UID: "d3259809-ebd8-411f-9bf2-4159939abd28"). InnerVolumeSpecName "kube-api-access-b65r7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:21:28.531135 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.531111    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ec46cc8-a6ee-468d-a70c-ea0f57465802-util" pod "1ec46cc8-a6ee-468d-a70c-ea0f57465802" (UID: "1ec46cc8-a6ee-468d-a70c-ea0f57465802"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:21:28.532395 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.532373    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3259809-ebd8-411f-9bf2-4159939abd28-util" pod "d3259809-ebd8-411f-9bf2-4159939abd28" (UID: "d3259809-ebd8-411f-9bf2-4159939abd28"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:21:28.533762 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.533738    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef925236-de11-4c72-af67-fdac2cbb42e0-util" pod "ef925236-de11-4c72-af67-fdac2cbb42e0" (UID: "ef925236-de11-4c72-af67-fdac2cbb42e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:21:28.534206 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.534187    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9adff17e-e54f-49ff-81b8-ca15f741436f-util" pod "9adff17e-e54f-49ff-81b8-ca15f741436f" (UID: "9adff17e-e54f-49ff-81b8-ca15f741436f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:21:28.624841 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.624800    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7j5mv\" (UniqueName: \"kubernetes.io/projected/ef925236-de11-4c72-af67-fdac2cbb42e0-kube-api-access-7j5mv\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:28.624841 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.624841    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-brqxk\" (UniqueName: \"kubernetes.io/projected/9adff17e-e54f-49ff-81b8-ca15f741436f-kube-api-access-brqxk\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:28.625046 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.624858    4510 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9adff17e-e54f-49ff-81b8-ca15f741436f-bundle\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:28.625046 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.624873    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfkqm\" (UniqueName: \"kubernetes.io/projected/1ec46cc8-a6ee-468d-a70c-ea0f57465802-kube-api-access-jfkqm\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:28.625046 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.624888    4510 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1ec46cc8-a6ee-468d-a70c-ea0f57465802-bundle\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:28.625046 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.624901    4510 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3259809-ebd8-411f-9bf2-4159939abd28-util\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:28.625046 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.624914    4510 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3259809-ebd8-411f-9bf2-4159939abd28-bundle\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:28.625046 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.624926    4510 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef925236-de11-4c72-af67-fdac2cbb42e0-util\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:28.625046 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.624939    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b65r7\" (UniqueName: \"kubernetes.io/projected/d3259809-ebd8-411f-9bf2-4159939abd28-kube-api-access-b65r7\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:28.625046 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.624952    4510 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef925236-de11-4c72-af67-fdac2cbb42e0-bundle\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:28.625046 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.624965    4510 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1ec46cc8-a6ee-468d-a70c-ea0f57465802-util\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:28.625046 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:28.624978    4510 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9adff17e-e54f-49ff-81b8-ca15f741436f-util\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:29.212944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.212889    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz" event={"ID":"9adff17e-e54f-49ff-81b8-ca15f741436f","Type":"ContainerDied","Data":"be2591f91e3d5d92923ccbc87d55e1547843724ccf6830e8bc6fe892089d384b"}
Nov 04 03:21:29.212944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.212922    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644dngxz"
Nov 04 03:21:29.213450 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.212952    4510 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="be2591f91e3d5d92923ccbc87d55e1547843724ccf6830e8bc6fe892089d384b"
Nov 04 03:21:29.215600 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.215101    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4" event={"ID":"d3259809-ebd8-411f-9bf2-4159939abd28","Type":"ContainerDied","Data":"661d84c14d3d41c93f96c421a0fa1687ac6e0ebf6610dd5ebee1803e85404017"}
Nov 04 03:21:29.215600 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.215145    4510 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="661d84c14d3d41c93f96c421a0fa1687ac6e0ebf6610dd5ebee1803e85404017"
Nov 04 03:21:29.215600 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.215147    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847a8csw4"
Nov 04 03:21:29.217391 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.217366    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w" event={"ID":"ef925236-de11-4c72-af67-fdac2cbb42e0","Type":"ContainerDied","Data":"ded37eb1c6122394e689cb85a0e04139376e2791d9af5ebd1dd0da1250f481a9"}
Nov 04 03:21:29.217391 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.217380    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7bnj4w"
Nov 04 03:21:29.217537 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.217399    4510 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ded37eb1c6122394e689cb85a0e04139376e2791d9af5ebd1dd0da1250f481a9"
Nov 04 03:21:29.219730 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.219707    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6" event={"ID":"1ec46cc8-a6ee-468d-a70c-ea0f57465802","Type":"ContainerDied","Data":"4e5a4354d95849f168d89684e9761d87da242e2df637a7070a4f86963637b0e3"}
Nov 04 03:21:29.219832 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.219748    4510 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4e5a4354d95849f168d89684e9761d87da242e2df637a7070a4f86963637b0e3"
Nov 04 03:21:29.220331 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.220316    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cmt9r6"
Nov 04 03:21:29.361031 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.361007    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh"
Nov 04 03:21:29.431319 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.431282    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43c3983a-60b4-408f-868d-8657bdf6b2e2-util\" (UniqueName: \"kubernetes.io/empty-dir/43c3983a-60b4-408f-868d-8657bdf6b2e2-util\") pod \"43c3983a-60b4-408f-868d-8657bdf6b2e2\" (UID: \"43c3983a-60b4-408f-868d-8657bdf6b2e2\") "
Nov 04 03:21:29.431493 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.431331    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/43c3983a-60b4-408f-868d-8657bdf6b2e2-kube-api-access-cxd7h\" (UniqueName: \"kubernetes.io/projected/43c3983a-60b4-408f-868d-8657bdf6b2e2-kube-api-access-cxd7h\") pod \"43c3983a-60b4-408f-868d-8657bdf6b2e2\" (UID: \"43c3983a-60b4-408f-868d-8657bdf6b2e2\") "
Nov 04 03:21:29.431493 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.431359    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/43c3983a-60b4-408f-868d-8657bdf6b2e2-bundle\" (UniqueName: \"kubernetes.io/empty-dir/43c3983a-60b4-408f-868d-8657bdf6b2e2-bundle\") pod \"43c3983a-60b4-408f-868d-8657bdf6b2e2\" (UID: \"43c3983a-60b4-408f-868d-8657bdf6b2e2\") "
Nov 04 03:21:29.432000 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.431972    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c3983a-60b4-408f-868d-8657bdf6b2e2-bundle" pod "43c3983a-60b4-408f-868d-8657bdf6b2e2" (UID: "43c3983a-60b4-408f-868d-8657bdf6b2e2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:21:29.433582 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.433556    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43c3983a-60b4-408f-868d-8657bdf6b2e2-kube-api-access-cxd7h" pod "43c3983a-60b4-408f-868d-8657bdf6b2e2" (UID: "43c3983a-60b4-408f-868d-8657bdf6b2e2"). InnerVolumeSpecName "kube-api-access-cxd7h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:21:29.437612 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.437584    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43c3983a-60b4-408f-868d-8657bdf6b2e2-util" pod "43c3983a-60b4-408f-868d-8657bdf6b2e2" (UID: "43c3983a-60b4-408f-868d-8657bdf6b2e2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:21:29.531955 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.531871    4510 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/43c3983a-60b4-408f-868d-8657bdf6b2e2-util\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:29.531955 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.531897    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxd7h\" (UniqueName: \"kubernetes.io/projected/43c3983a-60b4-408f-868d-8657bdf6b2e2-kube-api-access-cxd7h\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:29.531955 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:29.531910    4510 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/43c3983a-60b4-408f-868d-8657bdf6b2e2-bundle\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:21:30.226000 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.225970    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh"
Nov 04 03:21:30.226000 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.225970    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cwg5gh" event={"ID":"43c3983a-60b4-408f-868d-8657bdf6b2e2","Type":"ContainerDied","Data":"ea800a313e20a4bf59f49e60604dcca3d644a9eae7383281b05fb4112a5bc329"}
Nov 04 03:21:30.226492 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.226026    4510 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ea800a313e20a4bf59f49e60604dcca3d644a9eae7383281b05fb4112a5bc329"
Nov 04 03:21:30.527922 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.527838    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"]
Nov 04 03:21:30.528124 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528112    4510 cpu_manager.go:414] "containerMap: removing container" podUID="1ec46cc8-a6ee-468d-a70c-ea0f57465802" containerName="pull"
Nov 04 03:21:30.528164 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528125    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ec46cc8-a6ee-468d-a70c-ea0f57465802" containerName="pull"
Nov 04 03:21:30.528164 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528134    4510 cpu_manager.go:414] "containerMap: removing container" podUID="9adff17e-e54f-49ff-81b8-ca15f741436f" containerName="extract"
Nov 04 03:21:30.528164 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528139    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9adff17e-e54f-49ff-81b8-ca15f741436f" containerName="extract"
Nov 04 03:21:30.528164 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528147    4510 cpu_manager.go:414] "containerMap: removing container" podUID="ef925236-de11-4c72-af67-fdac2cbb42e0" containerName="extract"
Nov 04 03:21:30.528164 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528151    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef925236-de11-4c72-af67-fdac2cbb42e0" containerName="extract"
Nov 04 03:21:30.528164 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528160    4510 cpu_manager.go:414] "containerMap: removing container" podUID="bf6bef9e-71e7-4008-9d13-e28f96d691a3" containerName="pull"
Nov 04 03:21:30.528164 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528164    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bf6bef9e-71e7-4008-9d13-e28f96d691a3" containerName="pull"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528171    4510 cpu_manager.go:414] "containerMap: removing container" podUID="a8bc1d6f-8070-4737-9b53-0eead76cc3bc" containerName="pull"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528176    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a8bc1d6f-8070-4737-9b53-0eead76cc3bc" containerName="pull"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528181    4510 cpu_manager.go:414] "containerMap: removing container" podUID="d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c" containerName="extract"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528186    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c" containerName="extract"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528191    4510 cpu_manager.go:414] "containerMap: removing container" podUID="9adff17e-e54f-49ff-81b8-ca15f741436f" containerName="util"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528195    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9adff17e-e54f-49ff-81b8-ca15f741436f" containerName="util"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528204    4510 cpu_manager.go:414] "containerMap: removing container" podUID="55dc3a4e-e026-4207-87bb-d9ca844f4945" containerName="pull"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528209    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="55dc3a4e-e026-4207-87bb-d9ca844f4945" containerName="pull"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528214    4510 cpu_manager.go:414] "containerMap: removing container" podUID="d3259809-ebd8-411f-9bf2-4159939abd28" containerName="util"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528219    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d3259809-ebd8-411f-9bf2-4159939abd28" containerName="util"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528225    4510 cpu_manager.go:414] "containerMap: removing container" podUID="ef925236-de11-4c72-af67-fdac2cbb42e0" containerName="pull"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528229    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef925236-de11-4c72-af67-fdac2cbb42e0" containerName="pull"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528236    4510 cpu_manager.go:414] "containerMap: removing container" podUID="bf6bef9e-71e7-4008-9d13-e28f96d691a3" containerName="extract"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528241    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bf6bef9e-71e7-4008-9d13-e28f96d691a3" containerName="extract"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528247    4510 cpu_manager.go:414] "containerMap: removing container" podUID="d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c" containerName="util"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528252    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c" containerName="util"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528257    4510 cpu_manager.go:414] "containerMap: removing container" podUID="d3259809-ebd8-411f-9bf2-4159939abd28" containerName="pull"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528261    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d3259809-ebd8-411f-9bf2-4159939abd28" containerName="pull"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528266    4510 cpu_manager.go:414] "containerMap: removing container" podUID="9adff17e-e54f-49ff-81b8-ca15f741436f" containerName="pull"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528270    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9adff17e-e54f-49ff-81b8-ca15f741436f" containerName="pull"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528279    4510 cpu_manager.go:414] "containerMap: removing container" podUID="43c3983a-60b4-408f-868d-8657bdf6b2e2" containerName="pull"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528283    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43c3983a-60b4-408f-868d-8657bdf6b2e2" containerName="pull"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528289    4510 cpu_manager.go:414] "containerMap: removing container" podUID="a8bc1d6f-8070-4737-9b53-0eead76cc3bc" containerName="extract"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528294    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a8bc1d6f-8070-4737-9b53-0eead76cc3bc" containerName="extract"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528301    4510 cpu_manager.go:414] "containerMap: removing container" podUID="bf6bef9e-71e7-4008-9d13-e28f96d691a3" containerName="util"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528305    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bf6bef9e-71e7-4008-9d13-e28f96d691a3" containerName="util"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528311    4510 cpu_manager.go:414] "containerMap: removing container" podUID="1ec46cc8-a6ee-468d-a70c-ea0f57465802" containerName="extract"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528315    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ec46cc8-a6ee-468d-a70c-ea0f57465802" containerName="extract"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528322    4510 cpu_manager.go:414] "containerMap: removing container" podUID="a8bc1d6f-8070-4737-9b53-0eead76cc3bc" containerName="util"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528326    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a8bc1d6f-8070-4737-9b53-0eead76cc3bc" containerName="util"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528333    4510 cpu_manager.go:414] "containerMap: removing container" podUID="55dc3a4e-e026-4207-87bb-d9ca844f4945" containerName="extract"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528338    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="55dc3a4e-e026-4207-87bb-d9ca844f4945" containerName="extract"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528344    4510 cpu_manager.go:414] "containerMap: removing container" podUID="d3259809-ebd8-411f-9bf2-4159939abd28" containerName="extract"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528348    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d3259809-ebd8-411f-9bf2-4159939abd28" containerName="extract"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528353    4510 cpu_manager.go:414] "containerMap: removing container" podUID="55dc3a4e-e026-4207-87bb-d9ca844f4945" containerName="util"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528357    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="55dc3a4e-e026-4207-87bb-d9ca844f4945" containerName="util"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528362    4510 cpu_manager.go:414] "containerMap: removing container" podUID="ef925236-de11-4c72-af67-fdac2cbb42e0" containerName="util"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528366    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef925236-de11-4c72-af67-fdac2cbb42e0" containerName="util"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528371    4510 cpu_manager.go:414] "containerMap: removing container" podUID="43c3983a-60b4-408f-868d-8657bdf6b2e2" containerName="extract"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528375    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43c3983a-60b4-408f-868d-8657bdf6b2e2" containerName="extract"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528381    4510 cpu_manager.go:414] "containerMap: removing container" podUID="1ec46cc8-a6ee-468d-a70c-ea0f57465802" containerName="util"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528387    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ec46cc8-a6ee-468d-a70c-ea0f57465802" containerName="util"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528394    4510 cpu_manager.go:414] "containerMap: removing container" podUID="43c3983a-60b4-408f-868d-8657bdf6b2e2" containerName="util"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528397    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="43c3983a-60b4-408f-868d-8657bdf6b2e2" containerName="util"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528404    4510 cpu_manager.go:414] "containerMap: removing container" podUID="d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c" containerName="pull"
Nov 04 03:21:30.528403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528408    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c" containerName="pull"
Nov 04 03:21:30.529746 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528449    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="9adff17e-e54f-49ff-81b8-ca15f741436f" containerName="extract"
Nov 04 03:21:30.529746 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528454    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef925236-de11-4c72-af67-fdac2cbb42e0" containerName="extract"
Nov 04 03:21:30.529746 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528461    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2d01a38-01fe-47e1-9ca0-a745aaaa0d1c" containerName="extract"
Nov 04 03:21:30.529746 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528466    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="bf6bef9e-71e7-4008-9d13-e28f96d691a3" containerName="extract"
Nov 04 03:21:30.529746 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528472    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="a8bc1d6f-8070-4737-9b53-0eead76cc3bc" containerName="extract"
Nov 04 03:21:30.529746 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528479    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ec46cc8-a6ee-468d-a70c-ea0f57465802" containerName="extract"
Nov 04 03:21:30.529746 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528485    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="55dc3a4e-e026-4207-87bb-d9ca844f4945" containerName="extract"
Nov 04 03:21:30.529746 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528490    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="d3259809-ebd8-411f-9bf2-4159939abd28" containerName="extract"
Nov 04 03:21:30.529746 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.528496    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="43c3983a-60b4-408f-868d-8657bdf6b2e2" containerName="extract"
Nov 04 03:21:30.530213 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.530198    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.593976 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.593944    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Nov 04 03:21:30.596759 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.596741    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 04 03:21:30.597042 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.597030    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-fqc69\""
Nov 04 03:21:30.597139 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.597051    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 04 03:21:30.597139 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.597058    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Nov 04 03:21:30.641045 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.641011    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c7f5043-a026-429c-8c2f-7cc2d54b885a-tmp\") pod \"opendatahub-operator-controller-manager-549fcdc555-t4pn8\" (UID: \"2c7f5043-a026-429c-8c2f-7cc2d54b885a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.641045 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.641060    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2c7f5043-a026-429c-8c2f-7cc2d54b885a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-549fcdc555-t4pn8\" (UID: \"2c7f5043-a026-429c-8c2f-7cc2d54b885a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.641310 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.641080    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2c7f5043-a026-429c-8c2f-7cc2d54b885a-manifests\") pod \"opendatahub-operator-controller-manager-549fcdc555-t4pn8\" (UID: \"2c7f5043-a026-429c-8c2f-7cc2d54b885a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.641310 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.641198    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfnpt\" (UniqueName: \"kubernetes.io/projected/2c7f5043-a026-429c-8c2f-7cc2d54b885a-kube-api-access-xfnpt\") pod \"opendatahub-operator-controller-manager-549fcdc555-t4pn8\" (UID: \"2c7f5043-a026-429c-8c2f-7cc2d54b885a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.641310 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.641267    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c7f5043-a026-429c-8c2f-7cc2d54b885a-metrics-cert\") pod \"opendatahub-operator-controller-manager-549fcdc555-t4pn8\" (UID: \"2c7f5043-a026-429c-8c2f-7cc2d54b885a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.641416 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.641337    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c7f5043-a026-429c-8c2f-7cc2d54b885a-webhook-cert\") pod \"opendatahub-operator-controller-manager-549fcdc555-t4pn8\" (UID: \"2c7f5043-a026-429c-8c2f-7cc2d54b885a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.694099 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.694056    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Nov 04 03:21:30.742583 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.742550    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c7f5043-a026-429c-8c2f-7cc2d54b885a-tmp\") pod \"opendatahub-operator-controller-manager-549fcdc555-t4pn8\" (UID: \"2c7f5043-a026-429c-8c2f-7cc2d54b885a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.742805 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.742597    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2c7f5043-a026-429c-8c2f-7cc2d54b885a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-549fcdc555-t4pn8\" (UID: \"2c7f5043-a026-429c-8c2f-7cc2d54b885a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.742805 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.742630    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2c7f5043-a026-429c-8c2f-7cc2d54b885a-manifests\") pod \"opendatahub-operator-controller-manager-549fcdc555-t4pn8\" (UID: \"2c7f5043-a026-429c-8c2f-7cc2d54b885a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.742805 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.742650    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfnpt\" (UniqueName: \"kubernetes.io/projected/2c7f5043-a026-429c-8c2f-7cc2d54b885a-kube-api-access-xfnpt\") pod \"opendatahub-operator-controller-manager-549fcdc555-t4pn8\" (UID: \"2c7f5043-a026-429c-8c2f-7cc2d54b885a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.742805 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.742705    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c7f5043-a026-429c-8c2f-7cc2d54b885a-metrics-cert\") pod \"opendatahub-operator-controller-manager-549fcdc555-t4pn8\" (UID: \"2c7f5043-a026-429c-8c2f-7cc2d54b885a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.742805 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.742744    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c7f5043-a026-429c-8c2f-7cc2d54b885a-webhook-cert\") pod \"opendatahub-operator-controller-manager-549fcdc555-t4pn8\" (UID: \"2c7f5043-a026-429c-8c2f-7cc2d54b885a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.743098 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.743069    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2c7f5043-a026-429c-8c2f-7cc2d54b885a-manifests\") pod \"opendatahub-operator-controller-manager-549fcdc555-t4pn8\" (UID: \"2c7f5043-a026-429c-8c2f-7cc2d54b885a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.745347 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.745316    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2c7f5043-a026-429c-8c2f-7cc2d54b885a-apiservice-cert\") pod \"opendatahub-operator-controller-manager-549fcdc555-t4pn8\" (UID: \"2c7f5043-a026-429c-8c2f-7cc2d54b885a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.745471 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.745344    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2c7f5043-a026-429c-8c2f-7cc2d54b885a-webhook-cert\") pod \"opendatahub-operator-controller-manager-549fcdc555-t4pn8\" (UID: \"2c7f5043-a026-429c-8c2f-7cc2d54b885a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.745513 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.745477    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2c7f5043-a026-429c-8c2f-7cc2d54b885a-tmp\") pod \"opendatahub-operator-controller-manager-549fcdc555-t4pn8\" (UID: \"2c7f5043-a026-429c-8c2f-7cc2d54b885a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.745834 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.745813    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/2c7f5043-a026-429c-8c2f-7cc2d54b885a-metrics-cert\") pod \"opendatahub-operator-controller-manager-549fcdc555-t4pn8\" (UID: \"2c7f5043-a026-429c-8c2f-7cc2d54b885a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.798395 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.798317    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"]
Nov 04 03:21:30.804500 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.804467    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfnpt\" (UniqueName: \"kubernetes.io/projected/2c7f5043-a026-429c-8c2f-7cc2d54b885a-kube-api-access-xfnpt\") pod \"opendatahub-operator-controller-manager-549fcdc555-t4pn8\" (UID: \"2c7f5043-a026-429c-8c2f-7cc2d54b885a\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:30.842472 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:30.842429    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:31.348984 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:31.348946    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"]
Nov 04 03:21:31.351673 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:21:31.351649    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c7f5043_a026_429c_8c2f_7cc2d54b885a.slice/crio-d0012c7abed08cf85a7a83824971eb8b134bf85ccfc78764a29fb17bd5259ef7 WatchSource:0}: Error finding container d0012c7abed08cf85a7a83824971eb8b134bf85ccfc78764a29fb17bd5259ef7: Status 404 returned error can't find the container with id d0012c7abed08cf85a7a83824971eb8b134bf85ccfc78764a29fb17bd5259ef7
Nov 04 03:21:32.235568 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:32.235534    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8" event={"ID":"2c7f5043-a026-429c-8c2f-7cc2d54b885a","Type":"ContainerStarted","Data":"d0012c7abed08cf85a7a83824971eb8b134bf85ccfc78764a29fb17bd5259ef7"}
Nov 04 03:21:35.253038 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:35.253007    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8" event={"ID":"2c7f5043-a026-429c-8c2f-7cc2d54b885a","Type":"ContainerStarted","Data":"5c1255532c54c98a372f81cbe3d1e374d3d657ea6e77fd2124b0586a6546b0b7"}
Nov 04 03:21:36.258841 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:36.258803    4510 generic.go:356] "Generic (PLEG): container finished" podID="2c7f5043-a026-429c-8c2f-7cc2d54b885a" containerID="5c1255532c54c98a372f81cbe3d1e374d3d657ea6e77fd2124b0586a6546b0b7" exitCode=0
Nov 04 03:21:36.259270 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:36.258876    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8" event={"ID":"2c7f5043-a026-429c-8c2f-7cc2d54b885a","Type":"ContainerDied","Data":"5c1255532c54c98a372f81cbe3d1e374d3d657ea6e77fd2124b0586a6546b0b7"}
Nov 04 03:21:37.264744 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:37.264707    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8" event={"ID":"2c7f5043-a026-429c-8c2f-7cc2d54b885a","Type":"ContainerStarted","Data":"f1c9f58450fe4e6250648b8d542d90a31295971e01d6bcecfc7f596cd872d653"}
Nov 04 03:21:37.265239 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:37.264788    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:37.453528 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:37.453409    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8" podStartSLOduration=2.602286571 podStartE2EDuration="7.453395534s" totalImagesPullingTime="4.432891576s" totalInitContainerRuntime="418.217387ms" isStatefulPod=false podCreationTimestamp="2026-11-04 03:21:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:21:37.451387181 +0000 UTC m=+272.715261488" watchObservedRunningTime="2026-11-04 03:21:37.453395534 +0000 UTC m=+272.717269841"
Nov 04 03:21:41.694880 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:41.694845    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p"]
Nov 04 03:21:41.701009 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:41.700990    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p"
Nov 04 03:21:41.754550 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:41.754519    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-d8rdr\""
Nov 04 03:21:41.755430 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:41.755393    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Nov 04 03:21:41.755536 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:41.755522    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Nov 04 03:21:41.836205 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:41.836170    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h4bh\" (UniqueName: \"kubernetes.io/projected/88f2b04a-dddf-48f5-85cc-d3b2188ef7a2-kube-api-access-9h4bh\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p\" (UID: \"88f2b04a-dddf-48f5-85cc-d3b2188ef7a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p"
Nov 04 03:21:41.836359 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:41.836299    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88f2b04a-dddf-48f5-85cc-d3b2188ef7a2-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p\" (UID: \"88f2b04a-dddf-48f5-85cc-d3b2188ef7a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p"
Nov 04 03:21:41.837818 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:41.837793    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p"]
Nov 04 03:21:41.937540 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:41.937501    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88f2b04a-dddf-48f5-85cc-d3b2188ef7a2-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p\" (UID: \"88f2b04a-dddf-48f5-85cc-d3b2188ef7a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p"
Nov 04 03:21:41.937796 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:41.937588    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h4bh\" (UniqueName: \"kubernetes.io/projected/88f2b04a-dddf-48f5-85cc-d3b2188ef7a2-kube-api-access-9h4bh\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p\" (UID: \"88f2b04a-dddf-48f5-85cc-d3b2188ef7a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p"
Nov 04 03:21:41.938054 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:41.938032    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88f2b04a-dddf-48f5-85cc-d3b2188ef7a2-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p\" (UID: \"88f2b04a-dddf-48f5-85cc-d3b2188ef7a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p"
Nov 04 03:21:41.999423 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:41.999388    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h4bh\" (UniqueName: \"kubernetes.io/projected/88f2b04a-dddf-48f5-85cc-d3b2188ef7a2-kube-api-access-9h4bh\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p\" (UID: \"88f2b04a-dddf-48f5-85cc-d3b2188ef7a2\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p"
Nov 04 03:21:42.012205 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:42.012171    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p"
Nov 04 03:21:42.445127 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:42.445103    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p"]
Nov 04 03:21:42.446623 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:21:42.446595    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88f2b04a_dddf_48f5_85cc_d3b2188ef7a2.slice/crio-d61b0ad54ec28e27ef05a235097a45fb8527ea0456c79f81a54f2a9d7205a8ac WatchSource:0}: Error finding container d61b0ad54ec28e27ef05a235097a45fb8527ea0456c79f81a54f2a9d7205a8ac: Status 404 returned error can't find the container with id d61b0ad54ec28e27ef05a235097a45fb8527ea0456c79f81a54f2a9d7205a8ac
Nov 04 03:21:43.291098 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:43.291066    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p" event={"ID":"88f2b04a-dddf-48f5-85cc-d3b2188ef7a2","Type":"ContainerStarted","Data":"d61b0ad54ec28e27ef05a235097a45fb8527ea0456c79f81a54f2a9d7205a8ac"}
Nov 04 03:21:48.270965 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:48.270929    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-549fcdc555-t4pn8"
Nov 04 03:21:53.315967 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:21:53.315933    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:21:55.204749 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:55.204714    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv"]
Nov 04 03:21:55.210355 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:55.210338    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv"
Nov 04 03:21:55.264431 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:55.264401    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv"]
Nov 04 03:21:55.269665 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:55.269633    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 04 03:21:55.269831 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:55.269740    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-82bwj\""
Nov 04 03:21:55.312435 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:55.312403    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 04 03:21:55.351809 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:55.351770    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5826f8d8-8023-4442-ad34-3cd28ca6f7c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-sm9xv\" (UID: \"5826f8d8-8023-4442-ad34-3cd28ca6f7c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv"
Nov 04 03:21:55.352013 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:55.351823    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nph66\" (UniqueName: \"kubernetes.io/projected/5826f8d8-8023-4442-ad34-3cd28ca6f7c1-kube-api-access-nph66\") pod \"kuadrant-operator-controller-manager-cf8469d7b-sm9xv\" (UID: \"5826f8d8-8023-4442-ad34-3cd28ca6f7c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv"
Nov 04 03:21:55.452966 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:55.452925    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5826f8d8-8023-4442-ad34-3cd28ca6f7c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-sm9xv\" (UID: \"5826f8d8-8023-4442-ad34-3cd28ca6f7c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv"
Nov 04 03:21:55.452966 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:55.452973    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nph66\" (UniqueName: \"kubernetes.io/projected/5826f8d8-8023-4442-ad34-3cd28ca6f7c1-kube-api-access-nph66\") pod \"kuadrant-operator-controller-manager-cf8469d7b-sm9xv\" (UID: \"5826f8d8-8023-4442-ad34-3cd28ca6f7c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv"
Nov 04 03:21:55.453362 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:55.453337    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5826f8d8-8023-4442-ad34-3cd28ca6f7c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-sm9xv\" (UID: \"5826f8d8-8023-4442-ad34-3cd28ca6f7c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv"
Nov 04 03:21:55.515023 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:55.514992    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nph66\" (UniqueName: \"kubernetes.io/projected/5826f8d8-8023-4442-ad34-3cd28ca6f7c1-kube-api-access-nph66\") pod \"kuadrant-operator-controller-manager-cf8469d7b-sm9xv\" (UID: \"5826f8d8-8023-4442-ad34-3cd28ca6f7c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv"
Nov 04 03:21:55.522730 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:55.522709    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv"
Nov 04 03:21:56.012087 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:56.012059    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv"]
Nov 04 03:21:56.015310 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:21:56.015278    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5826f8d8_8023_4442_ad34_3cd28ca6f7c1.slice/crio-96fedeceaa6579ec64f706482062171a66785c33c2f6cc3ced1a76b0d10d4a78 WatchSource:0}: Error finding container 96fedeceaa6579ec64f706482062171a66785c33c2f6cc3ced1a76b0d10d4a78: Status 404 returned error can't find the container with id 96fedeceaa6579ec64f706482062171a66785c33c2f6cc3ced1a76b0d10d4a78
Nov 04 03:21:56.348967 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:56.348879    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv" event={"ID":"5826f8d8-8023-4442-ad34-3cd28ca6f7c1","Type":"ContainerStarted","Data":"96fedeceaa6579ec64f706482062171a66785c33c2f6cc3ced1a76b0d10d4a78"}
Nov 04 03:21:57.354797 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:57.354760    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p" event={"ID":"88f2b04a-dddf-48f5-85cc-d3b2188ef7a2","Type":"ContainerStarted","Data":"0368d044851782a65f4aa3b2187a519934db4c5d52723a2b551edd759fd734ce"}
Nov 04 03:21:57.582385 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:57.582321    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-cfh7p" podStartSLOduration=2.496422105 podStartE2EDuration="16.582305016s" totalImagesPullingTime="14.085882911s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:21:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:21:57.531223565 +0000 UTC m=+292.795097869" watchObservedRunningTime="2026-11-04 03:21:57.582305016 +0000 UTC m=+292.846179322"
Nov 04 03:21:58.915796 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:58.914426    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-57xgd"]
Nov 04 03:21:58.924273 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:58.924242    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-57xgd"
Nov 04 03:21:58.998822 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:58.997506    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Nov 04 03:21:58.998822 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:58.997552    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-8wl8x\""
Nov 04 03:21:59.040825 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:59.040793    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-57xgd"]
Nov 04 03:21:59.085115 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:59.085073    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hc2rk\" (UniqueName: \"kubernetes.io/projected/b9cf3eee-3f53-4752-a9f7-cfb673fe6452-kube-api-access-hc2rk\") pod \"dns-operator-controller-manager-8557cbdb84-57xgd\" (UID: \"b9cf3eee-3f53-4752-a9f7-cfb673fe6452\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-57xgd"
Nov 04 03:21:59.186217 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:59.186132    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hc2rk\" (UniqueName: \"kubernetes.io/projected/b9cf3eee-3f53-4752-a9f7-cfb673fe6452-kube-api-access-hc2rk\") pod \"dns-operator-controller-manager-8557cbdb84-57xgd\" (UID: \"b9cf3eee-3f53-4752-a9f7-cfb673fe6452\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-57xgd"
Nov 04 03:21:59.248933 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:59.248904    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hc2rk\" (UniqueName: \"kubernetes.io/projected/b9cf3eee-3f53-4752-a9f7-cfb673fe6452-kube-api-access-hc2rk\") pod \"dns-operator-controller-manager-8557cbdb84-57xgd\" (UID: \"b9cf3eee-3f53-4752-a9f7-cfb673fe6452\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-57xgd"
Nov 04 03:21:59.543725 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:59.543670    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-57xgd"
Nov 04 03:21:59.935302 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:21:59.935226    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-57xgd"]
Nov 04 03:21:59.939334 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:21:59.939289    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9cf3eee_3f53_4752_a9f7_cfb673fe6452.slice/crio-652a565b7031ba5d7097f3b5dd559f0fb93e2767e053fe3f25035c566236b730 WatchSource:0}: Error finding container 652a565b7031ba5d7097f3b5dd559f0fb93e2767e053fe3f25035c566236b730: Status 404 returned error can't find the container with id 652a565b7031ba5d7097f3b5dd559f0fb93e2767e053fe3f25035c566236b730
Nov 04 03:22:00.373849 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:00.373802    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-57xgd" event={"ID":"b9cf3eee-3f53-4752-a9f7-cfb673fe6452","Type":"ContainerStarted","Data":"652a565b7031ba5d7097f3b5dd559f0fb93e2767e053fe3f25035c566236b730"}
Nov 04 03:22:01.260341 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.260319    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5d77786fb9-j8wzv"]
Nov 04 03:22:01.264969 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.264948    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d77786fb9-j8wzv"
Nov 04 03:22:01.361467 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.361432    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Nov 04 03:22:01.372498 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.372464    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-trx6p\""
Nov 04 03:22:01.372638 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.372513    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Nov 04 03:22:01.374348 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.374317    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d77786fb9-j8wzv"]
Nov 04 03:22:01.379392 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.379360    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv" event={"ID":"5826f8d8-8023-4442-ad34-3cd28ca6f7c1","Type":"ContainerStarted","Data":"1f2d5649f62d5ee4975b10f874f9e156b8fb7ab9ba4b96190360f82528785bfe"}
Nov 04 03:22:01.379547 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.379427    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv"
Nov 04 03:22:01.406141 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.406105    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8-tmp\") pod \"kube-auth-proxy-5d77786fb9-j8wzv\" (UID: \"47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8\") " pod="openshift-ingress/kube-auth-proxy-5d77786fb9-j8wzv"
Nov 04 03:22:01.406341 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.406162    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8-tls-certs\") pod \"kube-auth-proxy-5d77786fb9-j8wzv\" (UID: \"47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8\") " pod="openshift-ingress/kube-auth-proxy-5d77786fb9-j8wzv"
Nov 04 03:22:01.406341 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.406321    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdhlm\" (UniqueName: \"kubernetes.io/projected/47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8-kube-api-access-wdhlm\") pod \"kube-auth-proxy-5d77786fb9-j8wzv\" (UID: \"47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8\") " pod="openshift-ingress/kube-auth-proxy-5d77786fb9-j8wzv"
Nov 04 03:22:01.507213 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.507114    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8-tmp\") pod \"kube-auth-proxy-5d77786fb9-j8wzv\" (UID: \"47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8\") " pod="openshift-ingress/kube-auth-proxy-5d77786fb9-j8wzv"
Nov 04 03:22:01.507213 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.507173    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8-tls-certs\") pod \"kube-auth-proxy-5d77786fb9-j8wzv\" (UID: \"47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8\") " pod="openshift-ingress/kube-auth-proxy-5d77786fb9-j8wzv"
Nov 04 03:22:01.507627 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.507246    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdhlm\" (UniqueName: \"kubernetes.io/projected/47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8-kube-api-access-wdhlm\") pod \"kube-auth-proxy-5d77786fb9-j8wzv\" (UID: \"47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8\") " pod="openshift-ingress/kube-auth-proxy-5d77786fb9-j8wzv"
Nov 04 03:22:01.510162 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.510114    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv" podStartSLOduration=1.272882154 podStartE2EDuration="6.510097906s" totalImagesPullingTime="5.237215752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:21:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:22:01.507134549 +0000 UTC m=+296.771008852" watchObservedRunningTime="2026-11-04 03:22:01.510097906 +0000 UTC m=+296.773972216"
Nov 04 03:22:01.510414 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.510190    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8-tmp\") pod \"kube-auth-proxy-5d77786fb9-j8wzv\" (UID: \"47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8\") " pod="openshift-ingress/kube-auth-proxy-5d77786fb9-j8wzv"
Nov 04 03:22:01.510858 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.510831    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8-tls-certs\") pod \"kube-auth-proxy-5d77786fb9-j8wzv\" (UID: \"47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8\") " pod="openshift-ingress/kube-auth-proxy-5d77786fb9-j8wzv"
Nov 04 03:22:01.570253 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.570223    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdhlm\" (UniqueName: \"kubernetes.io/projected/47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8-kube-api-access-wdhlm\") pod \"kube-auth-proxy-5d77786fb9-j8wzv\" (UID: \"47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8\") " pod="openshift-ingress/kube-auth-proxy-5d77786fb9-j8wzv"
Nov 04 03:22:01.596794 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.596758    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5d77786fb9-j8wzv"
Nov 04 03:22:01.992323 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.992283    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5d77786fb9-j8wzv"]
Nov 04 03:22:01.995791 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:01.995756    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"]
Nov 04 03:22:02.000916 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.000887    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.007544 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:22:02.007504    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47b4d3a0_e1b5_444c_8524_1b6ec3b9cfb8.slice/crio-5158a7f89a22dcb6fd53989bdf074f89e5f1577f55c0226998b13cca2db20a8a WatchSource:0}: Error finding container 5158a7f89a22dcb6fd53989bdf074f89e5f1577f55c0226998b13cca2db20a8a: Status 404 returned error can't find the container with id 5158a7f89a22dcb6fd53989bdf074f89e5f1577f55c0226998b13cca2db20a8a
Nov 04 03:22:02.055003 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.054970    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-mrz9b\""
Nov 04 03:22:02.063881 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.063848    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"]
Nov 04 03:22:02.111847 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.111812    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4e94dfc-3d18-4966-b6cf-e06ed773939b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.112063 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.111865    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ncqq\" (UniqueName: \"kubernetes.io/projected/c4e94dfc-3d18-4966-b6cf-e06ed773939b-kube-api-access-4ncqq\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.112063 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.111896    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4e94dfc-3d18-4966-b6cf-e06ed773939b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.112063 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.111938    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4e94dfc-3d18-4966-b6cf-e06ed773939b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.112063 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.111979    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4e94dfc-3d18-4966-b6cf-e06ed773939b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.112295 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.112062    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4e94dfc-3d18-4966-b6cf-e06ed773939b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.112295 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.112103    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4e94dfc-3d18-4966-b6cf-e06ed773939b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.112295 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.112205    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4e94dfc-3d18-4966-b6cf-e06ed773939b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.112295 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.112232    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4e94dfc-3d18-4966-b6cf-e06ed773939b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.213313 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.213275    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4e94dfc-3d18-4966-b6cf-e06ed773939b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.213484 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.213322    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4e94dfc-3d18-4966-b6cf-e06ed773939b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.213484 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.213413    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4e94dfc-3d18-4966-b6cf-e06ed773939b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.213484 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.213452    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ncqq\" (UniqueName: \"kubernetes.io/projected/c4e94dfc-3d18-4966-b6cf-e06ed773939b-kube-api-access-4ncqq\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.213607 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.213501    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4e94dfc-3d18-4966-b6cf-e06ed773939b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.213607 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.213546    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4e94dfc-3d18-4966-b6cf-e06ed773939b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.213607 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.213577    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4e94dfc-3d18-4966-b6cf-e06ed773939b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.213607 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.213601    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4e94dfc-3d18-4966-b6cf-e06ed773939b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.213798 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.213628    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4e94dfc-3d18-4966-b6cf-e06ed773939b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.214621 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.213861    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4e94dfc-3d18-4966-b6cf-e06ed773939b-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.214621 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.214111    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4e94dfc-3d18-4966-b6cf-e06ed773939b-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.214621 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.214445    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4e94dfc-3d18-4966-b6cf-e06ed773939b-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.214621 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.214470    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4e94dfc-3d18-4966-b6cf-e06ed773939b-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.214955 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.214709    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4e94dfc-3d18-4966-b6cf-e06ed773939b-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.216551 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.216526    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4e94dfc-3d18-4966-b6cf-e06ed773939b-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.216778 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.216761    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4e94dfc-3d18-4966-b6cf-e06ed773939b-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.282366 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.282282    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ncqq\" (UniqueName: \"kubernetes.io/projected/c4e94dfc-3d18-4966-b6cf-e06ed773939b-kube-api-access-4ncqq\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.283295 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.283261    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4e94dfc-3d18-4966-b6cf-e06ed773939b-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4\" (UID: \"c4e94dfc-3d18-4966-b6cf-e06ed773939b\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.322714 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.322662    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:02.409795 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.408609    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d77786fb9-j8wzv" event={"ID":"47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8","Type":"ContainerStarted","Data":"5158a7f89a22dcb6fd53989bdf074f89e5f1577f55c0226998b13cca2db20a8a"}
Nov 04 03:22:02.774045 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.773330    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"]
Nov 04 03:22:02.776565 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.776534    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:22:02.776659 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.776601    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:22:02.776732 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:02.776715    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:22:03.418640 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:03.418597    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-57xgd" event={"ID":"b9cf3eee-3f53-4752-a9f7-cfb673fe6452","Type":"ContainerStarted","Data":"16f8895c33b6b885f295365d56cbea0a8c5a9bb3c613fad2c4f082a17495e3cc"}
Nov 04 03:22:03.419232 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:03.419210    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-57xgd"
Nov 04 03:22:03.421482 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:03.421446    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4" event={"ID":"c4e94dfc-3d18-4966-b6cf-e06ed773939b","Type":"ContainerStarted","Data":"6e3d3883c3047966f10664d9eaf4d076a349254f568afc0eb5c9a2cb93826439"}
Nov 04 03:22:03.421629 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:03.421499    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4" event={"ID":"c4e94dfc-3d18-4966-b6cf-e06ed773939b","Type":"ContainerStarted","Data":"e90d58a9247d82d5b93047a49ba55a79f27f38d2b1e0c31706c8ad49bbfca4f5"}
Nov 04 03:22:03.540532 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:03.540467    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-57xgd" podStartSLOduration=2.898475958 podStartE2EDuration="5.54044711s" totalImagesPullingTime="2.641971152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:22:03.53791435 +0000 UTC m=+298.801788659" watchObservedRunningTime="2026-11-04 03:22:03.54044711 +0000 UTC m=+298.804321420"
Nov 04 03:22:03.659561 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:03.659431    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4" podStartSLOduration=2.659414533 podStartE2EDuration="2.659414533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:22:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:22:03.6582912 +0000 UTC m=+298.922165508" watchObservedRunningTime="2026-11-04 03:22:03.659414533 +0000 UTC m=+298.923288843"
Nov 04 03:22:04.323313 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:04.323273    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:04.330360 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:04.330333    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:04.427351 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:04.427315    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:04.428777 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:04.428751    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4"
Nov 04 03:22:05.049921 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:05.049887    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Nov 04 03:22:05.433988 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:05.433892    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5d77786fb9-j8wzv" event={"ID":"47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8","Type":"ContainerStarted","Data":"42d63468e83267782e65c147f50c62ea2ed15256cddc97617157912e9d59b206"}
Nov 04 03:22:05.562744 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:05.562674    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5d77786fb9-j8wzv" podStartSLOduration=1.5787333719999999 podStartE2EDuration="4.562659609s" totalImagesPullingTime="2.983926237s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:22:05.561014914 +0000 UTC m=+300.824889220" watchObservedRunningTime="2026-11-04 03:22:05.562659609 +0000 UTC m=+300.826533916"
Nov 04 03:22:12.411857 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:12.411819    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv"
Nov 04 03:22:13.032141 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:13.032106    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s7xrk"]
Nov 04 03:22:13.039617 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:13.039594    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s7xrk"
Nov 04 03:22:13.117143 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:13.117098    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s42z5\" (UniqueName: \"kubernetes.io/projected/7d7e7a84-8013-47fa-9d1e-687af0d59f2c-kube-api-access-s42z5\") pod \"kuadrant-operator-controller-manager-678d87766f-s7xrk\" (UID: \"7d7e7a84-8013-47fa-9d1e-687af0d59f2c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s7xrk"
Nov 04 03:22:13.117331 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:13.117163    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d7e7a84-8013-47fa-9d1e-687af0d59f2c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-s7xrk\" (UID: \"7d7e7a84-8013-47fa-9d1e-687af0d59f2c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s7xrk"
Nov 04 03:22:13.135550 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:13.135518    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s7xrk"]
Nov 04 03:22:13.218367 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:13.218331    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d7e7a84-8013-47fa-9d1e-687af0d59f2c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-s7xrk\" (UID: \"7d7e7a84-8013-47fa-9d1e-687af0d59f2c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s7xrk"
Nov 04 03:22:13.218556 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:13.218407    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s42z5\" (UniqueName: \"kubernetes.io/projected/7d7e7a84-8013-47fa-9d1e-687af0d59f2c-kube-api-access-s42z5\") pod \"kuadrant-operator-controller-manager-678d87766f-s7xrk\" (UID: \"7d7e7a84-8013-47fa-9d1e-687af0d59f2c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s7xrk"
Nov 04 03:22:13.218757 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:13.218739    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d7e7a84-8013-47fa-9d1e-687af0d59f2c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-s7xrk\" (UID: \"7d7e7a84-8013-47fa-9d1e-687af0d59f2c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s7xrk"
Nov 04 03:22:13.279738 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:13.279698    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s42z5\" (UniqueName: \"kubernetes.io/projected/7d7e7a84-8013-47fa-9d1e-687af0d59f2c-kube-api-access-s42z5\") pod \"kuadrant-operator-controller-manager-678d87766f-s7xrk\" (UID: \"7d7e7a84-8013-47fa-9d1e-687af0d59f2c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s7xrk"
Nov 04 03:22:13.352357 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:13.352268    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s7xrk"
Nov 04 03:22:13.780833 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:13.780805    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s7xrk"]
Nov 04 03:22:13.783465 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:22:13.783434    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d7e7a84_8013_47fa_9d1e_687af0d59f2c.slice/crio-46ec6d27f67c6d061a34b549960596cf5fca615362f185fba3a30412bc4966fa WatchSource:0}: Error finding container 46ec6d27f67c6d061a34b549960596cf5fca615362f185fba3a30412bc4966fa: Status 404 returned error can't find the container with id 46ec6d27f67c6d061a34b549960596cf5fca615362f185fba3a30412bc4966fa
Nov 04 03:22:14.429713 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:14.429669    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-57xgd"
Nov 04 03:22:14.479432 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:14.479389    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s7xrk" event={"ID":"7d7e7a84-8013-47fa-9d1e-687af0d59f2c","Type":"ContainerStarted","Data":"60c230abd0cbf683d62ee499fe0a2b602bf144de9f0032b17991884b55af92bb"}
Nov 04 03:22:14.479613 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:14.479451    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s7xrk" event={"ID":"7d7e7a84-8013-47fa-9d1e-687af0d59f2c","Type":"ContainerStarted","Data":"46ec6d27f67c6d061a34b549960596cf5fca615362f185fba3a30412bc4966fa"}
Nov 04 03:22:14.479613 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:14.479472    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s7xrk"
Nov 04 03:22:14.666370 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:14.666317    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s7xrk" podStartSLOduration=2.66629989 podStartE2EDuration="2.66629989s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:22:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:22:14.665036499 +0000 UTC m=+309.928910806" watchObservedRunningTime="2026-11-04 03:22:14.66629989 +0000 UTC m=+309.930174196"
Nov 04 03:22:23.318734 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:22:23.318673    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:22:25.486249 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:25.486222    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-s7xrk"
Nov 04 03:22:25.709590 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:25.709556    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv"]
Nov 04 03:22:25.709905 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:25.709873    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv" podUID="5826f8d8-8023-4442-ad34-3cd28ca6f7c1" containerName="manager" containerID="cri-o://1f2d5649f62d5ee4975b10f874f9e156b8fb7ab9ba4b96190360f82528785bfe" gracePeriod=10
Nov 04 03:22:25.964039 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:25.964005    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv"
Nov 04 03:22:26.027739 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:26.027704    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5826f8d8-8023-4442-ad34-3cd28ca6f7c1-kube-api-access-nph66\" (UniqueName: \"kubernetes.io/projected/5826f8d8-8023-4442-ad34-3cd28ca6f7c1-kube-api-access-nph66\") pod \"5826f8d8-8023-4442-ad34-3cd28ca6f7c1\" (UID: \"5826f8d8-8023-4442-ad34-3cd28ca6f7c1\") "
Nov 04 03:22:26.027925 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:26.027759    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5826f8d8-8023-4442-ad34-3cd28ca6f7c1-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5826f8d8-8023-4442-ad34-3cd28ca6f7c1-extensions-socket-volume\") pod \"5826f8d8-8023-4442-ad34-3cd28ca6f7c1\" (UID: \"5826f8d8-8023-4442-ad34-3cd28ca6f7c1\") "
Nov 04 03:22:26.028168 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:26.028144    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5826f8d8-8023-4442-ad34-3cd28ca6f7c1-extensions-socket-volume" pod "5826f8d8-8023-4442-ad34-3cd28ca6f7c1" (UID: "5826f8d8-8023-4442-ad34-3cd28ca6f7c1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:22:26.030149 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:26.030122    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5826f8d8-8023-4442-ad34-3cd28ca6f7c1-kube-api-access-nph66" pod "5826f8d8-8023-4442-ad34-3cd28ca6f7c1" (UID: "5826f8d8-8023-4442-ad34-3cd28ca6f7c1"). InnerVolumeSpecName "kube-api-access-nph66". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:22:26.129473 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:26.129362    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nph66\" (UniqueName: \"kubernetes.io/projected/5826f8d8-8023-4442-ad34-3cd28ca6f7c1-kube-api-access-nph66\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:22:26.129473 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:26.129407    4510 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5826f8d8-8023-4442-ad34-3cd28ca6f7c1-extensions-socket-volume\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:22:26.534366 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:26.534331    4510 generic.go:356] "Generic (PLEG): container finished" podID="5826f8d8-8023-4442-ad34-3cd28ca6f7c1" containerID="1f2d5649f62d5ee4975b10f874f9e156b8fb7ab9ba4b96190360f82528785bfe" exitCode=0
Nov 04 03:22:26.534832 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:26.534389    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv"
Nov 04 03:22:26.534832 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:26.534418    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv" event={"ID":"5826f8d8-8023-4442-ad34-3cd28ca6f7c1","Type":"ContainerDied","Data":"1f2d5649f62d5ee4975b10f874f9e156b8fb7ab9ba4b96190360f82528785bfe"}
Nov 04 03:22:26.534832 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:26.534501    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv" event={"ID":"5826f8d8-8023-4442-ad34-3cd28ca6f7c1","Type":"ContainerDied","Data":"96fedeceaa6579ec64f706482062171a66785c33c2f6cc3ced1a76b0d10d4a78"}
Nov 04 03:22:26.534832 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:26.534525    4510 scope.go:122] "RemoveContainer" containerID="1f2d5649f62d5ee4975b10f874f9e156b8fb7ab9ba4b96190360f82528785bfe"
Nov 04 03:22:26.544244 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:26.544222    4510 scope.go:122] "RemoveContainer" containerID="1f2d5649f62d5ee4975b10f874f9e156b8fb7ab9ba4b96190360f82528785bfe"
Nov 04 03:22:26.544584 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:22:26.544564    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f2d5649f62d5ee4975b10f874f9e156b8fb7ab9ba4b96190360f82528785bfe\": container with ID starting with 1f2d5649f62d5ee4975b10f874f9e156b8fb7ab9ba4b96190360f82528785bfe not found: ID does not exist" containerID="1f2d5649f62d5ee4975b10f874f9e156b8fb7ab9ba4b96190360f82528785bfe"
Nov 04 03:22:26.544631 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:26.544596    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f2d5649f62d5ee4975b10f874f9e156b8fb7ab9ba4b96190360f82528785bfe"} err="failed to get container status \"1f2d5649f62d5ee4975b10f874f9e156b8fb7ab9ba4b96190360f82528785bfe\": rpc error: code = NotFound desc = could not find container \"1f2d5649f62d5ee4975b10f874f9e156b8fb7ab9ba4b96190360f82528785bfe\": container with ID starting with 1f2d5649f62d5ee4975b10f874f9e156b8fb7ab9ba4b96190360f82528785bfe not found: ID does not exist"
Nov 04 03:22:26.730078 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:26.730048    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv"]
Nov 04 03:22:26.780568 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:26.780532    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-sm9xv"]
Nov 04 03:22:26.865141 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:26.865063    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5826f8d8-8023-4442-ad34-3cd28ca6f7c1" path="/var/lib/kubelet/pods/5826f8d8-8023-4442-ad34-3cd28ca6f7c1/volumes"
Nov 04 03:22:50.226535 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.226496    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-kscfp"]
Nov 04 03:22:50.226984 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.226868    4510 cpu_manager.go:414] "containerMap: removing container" podUID="5826f8d8-8023-4442-ad34-3cd28ca6f7c1" containerName="manager"
Nov 04 03:22:50.226984 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.226880    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5826f8d8-8023-4442-ad34-3cd28ca6f7c1" containerName="manager"
Nov 04 03:22:50.226984 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.226953    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="5826f8d8-8023-4442-ad34-3cd28ca6f7c1" containerName="manager"
Nov 04 03:22:50.228793 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.228777    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kscfp"
Nov 04 03:22:50.281401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.281369    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rhb6m\""
Nov 04 03:22:50.331413 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.331376    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Nov 04 03:22:50.331593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.331436    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Nov 04 03:22:50.333704 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.333660    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-kscfp"]
Nov 04 03:22:50.333987 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.333971    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a00930d1-cbd5-4c54-a54f-599549dad6e3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-kscfp\" (UID: \"a00930d1-cbd5-4c54-a54f-599549dad6e3\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kscfp"
Nov 04 03:22:50.334024 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.334003    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx6mp\" (UniqueName: \"kubernetes.io/projected/a00930d1-cbd5-4c54-a54f-599549dad6e3-kube-api-access-hx6mp\") pod \"kuadrant-console-plugin-66c4fb575d-kscfp\" (UID: \"a00930d1-cbd5-4c54-a54f-599549dad6e3\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kscfp"
Nov 04 03:22:50.334057 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.334035    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a00930d1-cbd5-4c54-a54f-599549dad6e3-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-kscfp\" (UID: \"a00930d1-cbd5-4c54-a54f-599549dad6e3\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kscfp"
Nov 04 03:22:50.434467 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.434434    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a00930d1-cbd5-4c54-a54f-599549dad6e3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-kscfp\" (UID: \"a00930d1-cbd5-4c54-a54f-599549dad6e3\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kscfp"
Nov 04 03:22:50.434642 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.434482    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx6mp\" (UniqueName: \"kubernetes.io/projected/a00930d1-cbd5-4c54-a54f-599549dad6e3-kube-api-access-hx6mp\") pod \"kuadrant-console-plugin-66c4fb575d-kscfp\" (UID: \"a00930d1-cbd5-4c54-a54f-599549dad6e3\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kscfp"
Nov 04 03:22:50.434642 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.434538    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a00930d1-cbd5-4c54-a54f-599549dad6e3-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-kscfp\" (UID: \"a00930d1-cbd5-4c54-a54f-599549dad6e3\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kscfp"
Nov 04 03:22:50.435302 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.435224    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a00930d1-cbd5-4c54-a54f-599549dad6e3-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-kscfp\" (UID: \"a00930d1-cbd5-4c54-a54f-599549dad6e3\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kscfp"
Nov 04 03:22:50.437045 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.437021    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a00930d1-cbd5-4c54-a54f-599549dad6e3-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-kscfp\" (UID: \"a00930d1-cbd5-4c54-a54f-599549dad6e3\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kscfp"
Nov 04 03:22:50.495876 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.495785    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx6mp\" (UniqueName: \"kubernetes.io/projected/a00930d1-cbd5-4c54-a54f-599549dad6e3-kube-api-access-hx6mp\") pod \"kuadrant-console-plugin-66c4fb575d-kscfp\" (UID: \"a00930d1-cbd5-4c54-a54f-599549dad6e3\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kscfp"
Nov 04 03:22:50.546380 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.546345    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kscfp"
Nov 04 03:22:50.919854 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.919832    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-kscfp"]
Nov 04 03:22:50.922347 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:22:50.922313    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda00930d1_cbd5_4c54_a54f_599549dad6e3.slice/crio-24713b16097d892e1931bdfa7e399a93c89aab6a8206c281d901832b2ca6ff58 WatchSource:0}: Error finding container 24713b16097d892e1931bdfa7e399a93c89aab6a8206c281d901832b2ca6ff58: Status 404 returned error can't find the container with id 24713b16097d892e1931bdfa7e399a93c89aab6a8206c281d901832b2ca6ff58
Nov 04 03:22:50.923692 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:50.923663    4510 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 03:22:51.630190 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:51.630160    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-8tcrc"]
Nov 04 03:22:51.632773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:51.632756    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-8tcrc"
Nov 04 03:22:51.655710 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:51.655664    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kscfp" event={"ID":"a00930d1-cbd5-4c54-a54f-599549dad6e3","Type":"ContainerStarted","Data":"24713b16097d892e1931bdfa7e399a93c89aab6a8206c281d901832b2ca6ff58"}
Nov 04 03:22:51.692004 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:51.691967    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-8tcrc"]
Nov 04 03:22:51.737990 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:51.737951    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9ktvr\""
Nov 04 03:22:51.745418 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:51.745384    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfw99\" (UniqueName: \"kubernetes.io/projected/ace18317-5816-483e-9440-11469a67ed30-kube-api-access-gfw99\") pod \"authorino-57f7f8659f-8tcrc\" (UID: \"ace18317-5816-483e-9440-11469a67ed30\") " pod="kuadrant-system/authorino-57f7f8659f-8tcrc"
Nov 04 03:22:51.846848 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:51.846812    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfw99\" (UniqueName: \"kubernetes.io/projected/ace18317-5816-483e-9440-11469a67ed30-kube-api-access-gfw99\") pod \"authorino-57f7f8659f-8tcrc\" (UID: \"ace18317-5816-483e-9440-11469a67ed30\") " pod="kuadrant-system/authorino-57f7f8659f-8tcrc"
Nov 04 03:22:51.908355 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:51.908286    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfw99\" (UniqueName: \"kubernetes.io/projected/ace18317-5816-483e-9440-11469a67ed30-kube-api-access-gfw99\") pod \"authorino-57f7f8659f-8tcrc\" (UID: \"ace18317-5816-483e-9440-11469a67ed30\") " pod="kuadrant-system/authorino-57f7f8659f-8tcrc"
Nov 04 03:22:51.943137 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:51.943106    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-8tcrc"
Nov 04 03:22:52.316063 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:52.316039    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-8tcrc"]
Nov 04 03:22:52.318464 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:22:52.318431    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podace18317_5816_483e_9440_11469a67ed30.slice/crio-ed87698ea8b2349c612c4492b24559d73fd400ca15169979cf3d6c980b441abb WatchSource:0}: Error finding container ed87698ea8b2349c612c4492b24559d73fd400ca15169979cf3d6c980b441abb: Status 404 returned error can't find the container with id ed87698ea8b2349c612c4492b24559d73fd400ca15169979cf3d6c980b441abb
Nov 04 03:22:52.664037 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:52.663924    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-8tcrc" event={"ID":"ace18317-5816-483e-9440-11469a67ed30","Type":"ContainerStarted","Data":"ed87698ea8b2349c612c4492b24559d73fd400ca15169979cf3d6c980b441abb"}
Nov 04 03:22:53.321569 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:22:53.321528    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:22:55.684488 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:55.684017    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-8tcrc" event={"ID":"ace18317-5816-483e-9440-11469a67ed30","Type":"ContainerStarted","Data":"4dc1f6169799550942b79a3e82ab685830a288f003717192829ac68dee0008ad"}
Nov 04 03:22:55.800842 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:55.800791    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-8tcrc" podStartSLOduration=1.745855087 podStartE2EDuration="4.800775209s" totalImagesPullingTime="3.054920122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:22:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:22:55.797977773 +0000 UTC m=+351.061852081" watchObservedRunningTime="2026-11-04 03:22:55.800775209 +0000 UTC m=+351.064649515"
Nov 04 03:22:56.690433 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:56.690401    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kscfp" event={"ID":"a00930d1-cbd5-4c54-a54f-599549dad6e3","Type":"ContainerStarted","Data":"d5d75f1b550eef9057203dbec7098326ee4a833de6bba53496e01f931971e54d"}
Nov 04 03:22:56.805186 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:56.805086    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-kscfp" podStartSLOduration=1.236234843 podStartE2EDuration="6.805066813s" totalImagesPullingTime="5.56883197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:22:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:22:56.804358137 +0000 UTC m=+352.068232467" watchObservedRunningTime="2026-11-04 03:22:56.805066813 +0000 UTC m=+352.068941114"
Nov 04 03:22:57.315317 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:57.315276    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-8tcrc"]
Nov 04 03:22:57.697776 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:57.697157    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-8tcrc" podUID="ace18317-5816-483e-9440-11469a67ed30" containerName="authorino" containerID="cri-o://4dc1f6169799550942b79a3e82ab685830a288f003717192829ac68dee0008ad" gracePeriod=30
Nov 04 03:22:57.946039 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:57.946016    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-8tcrc"
Nov 04 03:22:58.109642 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:58.109600    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ace18317-5816-483e-9440-11469a67ed30-kube-api-access-gfw99\" (UniqueName: \"kubernetes.io/projected/ace18317-5816-483e-9440-11469a67ed30-kube-api-access-gfw99\") pod \"ace18317-5816-483e-9440-11469a67ed30\" (UID: \"ace18317-5816-483e-9440-11469a67ed30\") "
Nov 04 03:22:58.111903 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:58.111875    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ace18317-5816-483e-9440-11469a67ed30-kube-api-access-gfw99" pod "ace18317-5816-483e-9440-11469a67ed30" (UID: "ace18317-5816-483e-9440-11469a67ed30"). InnerVolumeSpecName "kube-api-access-gfw99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:22:58.210457 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:58.210409    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfw99\" (UniqueName: \"kubernetes.io/projected/ace18317-5816-483e-9440-11469a67ed30-kube-api-access-gfw99\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:22:58.703126 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:58.703094    4510 generic.go:356] "Generic (PLEG): container finished" podID="ace18317-5816-483e-9440-11469a67ed30" containerID="4dc1f6169799550942b79a3e82ab685830a288f003717192829ac68dee0008ad" exitCode=0
Nov 04 03:22:58.703617 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:58.703136    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-8tcrc" event={"ID":"ace18317-5816-483e-9440-11469a67ed30","Type":"ContainerDied","Data":"4dc1f6169799550942b79a3e82ab685830a288f003717192829ac68dee0008ad"}
Nov 04 03:22:58.703617 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:58.703142    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-8tcrc"
Nov 04 03:22:58.703617 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:58.703170    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-8tcrc" event={"ID":"ace18317-5816-483e-9440-11469a67ed30","Type":"ContainerDied","Data":"ed87698ea8b2349c612c4492b24559d73fd400ca15169979cf3d6c980b441abb"}
Nov 04 03:22:58.703617 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:58.703191    4510 scope.go:122] "RemoveContainer" containerID="4dc1f6169799550942b79a3e82ab685830a288f003717192829ac68dee0008ad"
Nov 04 03:22:58.712197 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:58.712176    4510 scope.go:122] "RemoveContainer" containerID="4dc1f6169799550942b79a3e82ab685830a288f003717192829ac68dee0008ad"
Nov 04 03:22:58.712478 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:22:58.712459    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dc1f6169799550942b79a3e82ab685830a288f003717192829ac68dee0008ad\": container with ID starting with 4dc1f6169799550942b79a3e82ab685830a288f003717192829ac68dee0008ad not found: ID does not exist" containerID="4dc1f6169799550942b79a3e82ab685830a288f003717192829ac68dee0008ad"
Nov 04 03:22:58.712546 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:58.712487    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dc1f6169799550942b79a3e82ab685830a288f003717192829ac68dee0008ad"} err="failed to get container status \"4dc1f6169799550942b79a3e82ab685830a288f003717192829ac68dee0008ad\": rpc error: code = NotFound desc = could not find container \"4dc1f6169799550942b79a3e82ab685830a288f003717192829ac68dee0008ad\": container with ID starting with 4dc1f6169799550942b79a3e82ab685830a288f003717192829ac68dee0008ad not found: ID does not exist"
Nov 04 03:22:58.867452 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:58.867420    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-8tcrc"]
Nov 04 03:22:58.917699 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:22:58.917648    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-8tcrc"]
Nov 04 03:23:00.861259 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:00.861223    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ace18317-5816-483e-9440-11469a67ed30" path="/var/lib/kubelet/pods/ace18317-5816-483e-9440-11469a67ed30/volumes"
Nov 04 03:23:08.805611 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:08.805574    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-7xvd6"]
Nov 04 03:23:08.806031 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:08.805916    4510 cpu_manager.go:414] "containerMap: removing container" podUID="ace18317-5816-483e-9440-11469a67ed30" containerName="authorino"
Nov 04 03:23:08.806031 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:08.805927    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ace18317-5816-483e-9440-11469a67ed30" containerName="authorino"
Nov 04 03:23:08.806031 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:08.805976    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="ace18317-5816-483e-9440-11469a67ed30" containerName="authorino"
Nov 04 03:23:08.808599 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:08.808574    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7xvd6"
Nov 04 03:23:08.868284 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:08.868242    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-7xvd6"]
Nov 04 03:23:08.868519 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:08.868499    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Nov 04 03:23:08.889980 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:08.889941    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7d9966f2-d52a-40d4-b1f1-7ea817b374ea-data\") pod \"postgres-7cdbf6dc44-7xvd6\" (UID: \"7d9966f2-d52a-40d4-b1f1-7ea817b374ea\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7xvd6"
Nov 04 03:23:08.889980 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:08.889982    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mx4sr\" (UniqueName: \"kubernetes.io/projected/7d9966f2-d52a-40d4-b1f1-7ea817b374ea-kube-api-access-mx4sr\") pod \"postgres-7cdbf6dc44-7xvd6\" (UID: \"7d9966f2-d52a-40d4-b1f1-7ea817b374ea\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7xvd6"
Nov 04 03:23:08.911188 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:08.911156    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 03:23:08.911302 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:08.911230    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 03:23:08.911340 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:08.911305    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-4vk5l\""
Nov 04 03:23:08.991255 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:08.991220    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7d9966f2-d52a-40d4-b1f1-7ea817b374ea-data\") pod \"postgres-7cdbf6dc44-7xvd6\" (UID: \"7d9966f2-d52a-40d4-b1f1-7ea817b374ea\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7xvd6"
Nov 04 03:23:08.991255 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:08.991260    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mx4sr\" (UniqueName: \"kubernetes.io/projected/7d9966f2-d52a-40d4-b1f1-7ea817b374ea-kube-api-access-mx4sr\") pod \"postgres-7cdbf6dc44-7xvd6\" (UID: \"7d9966f2-d52a-40d4-b1f1-7ea817b374ea\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7xvd6"
Nov 04 03:23:08.991618 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:08.991597    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/7d9966f2-d52a-40d4-b1f1-7ea817b374ea-data\") pod \"postgres-7cdbf6dc44-7xvd6\" (UID: \"7d9966f2-d52a-40d4-b1f1-7ea817b374ea\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7xvd6"
Nov 04 03:23:09.052415 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:09.052374    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mx4sr\" (UniqueName: \"kubernetes.io/projected/7d9966f2-d52a-40d4-b1f1-7ea817b374ea-kube-api-access-mx4sr\") pod \"postgres-7cdbf6dc44-7xvd6\" (UID: \"7d9966f2-d52a-40d4-b1f1-7ea817b374ea\") " pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7xvd6"
Nov 04 03:23:09.121492 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:09.121389    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7xvd6"
Nov 04 03:23:09.493544 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:09.493518    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-7cdbf6dc44-7xvd6"]
Nov 04 03:23:09.495635 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:23:09.495604    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d9966f2_d52a_40d4_b1f1_7ea817b374ea.slice/crio-03aa436d91c514cb0962cf758c5aa3b05e8fb4a3784272e8758fde7f5089405d WatchSource:0}: Error finding container 03aa436d91c514cb0962cf758c5aa3b05e8fb4a3784272e8758fde7f5089405d: Status 404 returned error can't find the container with id 03aa436d91c514cb0962cf758c5aa3b05e8fb4a3784272e8758fde7f5089405d
Nov 04 03:23:09.761044 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:09.760956    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7xvd6" event={"ID":"7d9966f2-d52a-40d4-b1f1-7ea817b374ea","Type":"ContainerStarted","Data":"03aa436d91c514cb0962cf758c5aa3b05e8fb4a3784272e8758fde7f5089405d"}
Nov 04 03:23:16.800435 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:16.800398    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7xvd6" event={"ID":"7d9966f2-d52a-40d4-b1f1-7ea817b374ea","Type":"ContainerStarted","Data":"cc2c008ea963e9a7ab34c380fae7ccb3d40118d5a6a322ff186f93189851fb4f"}
Nov 04 03:23:16.800844 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:16.800546    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7xvd6"
Nov 04 03:23:16.916606 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:16.916552    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7xvd6" podStartSLOduration=2.675902539 podStartE2EDuration="8.916538063s" totalImagesPullingTime="6.240635524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:23:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:23:16.915614619 +0000 UTC m=+372.179488927" watchObservedRunningTime="2026-11-04 03:23:16.916538063 +0000 UTC m=+372.180412369"
Nov 04 03:23:22.837465 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:22.837437    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-7cdbf6dc44-7xvd6"
Nov 04 03:23:23.315674 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:23:23.315635    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:23:35.861634 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:35.861596    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668"]
Nov 04 03:23:35.893105 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:35.893071    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668"
Nov 04 03:23:35.923382 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:35.923350    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668"]
Nov 04 03:23:35.962905 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:35.962876    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-czfbg\""
Nov 04 03:23:35.971028 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:35.970995    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Nov 04 03:23:35.993465 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:35.993432    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 04 03:23:36.012755 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:36.012718    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 04 03:23:36.034171 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:36.034136    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ba995a6-df39-4b56-9364-4ef857414cab-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-cc668\" (UID: \"2ba995a6-df39-4b56-9364-4ef857414cab\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668"
Nov 04 03:23:36.034316 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:36.034272    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5bhm\" (UniqueName: \"kubernetes.io/projected/2ba995a6-df39-4b56-9364-4ef857414cab-kube-api-access-j5bhm\") pod \"llmisvc-controller-manager-869d5dcc5d-cc668\" (UID: \"2ba995a6-df39-4b56-9364-4ef857414cab\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668"
Nov 04 03:23:36.135280 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:36.135175    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5bhm\" (UniqueName: \"kubernetes.io/projected/2ba995a6-df39-4b56-9364-4ef857414cab-kube-api-access-j5bhm\") pod \"llmisvc-controller-manager-869d5dcc5d-cc668\" (UID: \"2ba995a6-df39-4b56-9364-4ef857414cab\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668"
Nov 04 03:23:36.135280 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:36.135236    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ba995a6-df39-4b56-9364-4ef857414cab-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-cc668\" (UID: \"2ba995a6-df39-4b56-9364-4ef857414cab\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668"
Nov 04 03:23:36.137839 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:36.137809    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ba995a6-df39-4b56-9364-4ef857414cab-cert\") pod \"llmisvc-controller-manager-869d5dcc5d-cc668\" (UID: \"2ba995a6-df39-4b56-9364-4ef857414cab\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668"
Nov 04 03:23:36.197081 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:36.197051    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5bhm\" (UniqueName: \"kubernetes.io/projected/2ba995a6-df39-4b56-9364-4ef857414cab-kube-api-access-j5bhm\") pod \"llmisvc-controller-manager-869d5dcc5d-cc668\" (UID: \"2ba995a6-df39-4b56-9364-4ef857414cab\") " pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668"
Nov 04 03:23:36.206920 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:36.206889    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668"
Nov 04 03:23:36.578264 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:36.578237    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668"]
Nov 04 03:23:36.580495 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:23:36.580462    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod2ba995a6_df39_4b56_9364_4ef857414cab.slice/crio-29f84fb77329e26d84dcee32af4049c92be698fdf7230aa298299ac4d48a6e30 WatchSource:0}: Error finding container 29f84fb77329e26d84dcee32af4049c92be698fdf7230aa298299ac4d48a6e30: Status 404 returned error can't find the container with id 29f84fb77329e26d84dcee32af4049c92be698fdf7230aa298299ac4d48a6e30
Nov 04 03:23:36.904406 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:36.904319    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668" event={"ID":"2ba995a6-df39-4b56-9364-4ef857414cab","Type":"ContainerStarted","Data":"29f84fb77329e26d84dcee32af4049c92be698fdf7230aa298299ac4d48a6e30"}
Nov 04 03:23:38.916093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:38.916001    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668" event={"ID":"2ba995a6-df39-4b56-9364-4ef857414cab","Type":"ContainerStarted","Data":"ed5e30c8e2e06b822699540c0370b18dd4254315ac554023f1d6cf13ab2a6248"}
Nov 04 03:23:38.916461 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:38.916138    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668"
Nov 04 03:23:39.036212 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:23:39.036157    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668" podStartSLOduration=2.042371624 podStartE2EDuration="4.036142842s" totalImagesPullingTime="1.993771218s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:23:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:23:39.034966216 +0000 UTC m=+394.298840524" watchObservedRunningTime="2026-11-04 03:23:39.036142842 +0000 UTC m=+394.300017148"
Nov 04 03:23:53.317541 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:23:53.317503    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:24:09.923257 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:09.923226    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668"
Nov 04 03:24:23.315586 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:24:23.315547    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:24:51.271892 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.271798    4510 generic.go:356] "Generic (PLEG): container finished" podID="85cb4aab-7613-481a-af4c-228be87df8c9" containerID="7e46aa0f8ee424bbb32cfa7b40d63e269e06aadbaf6882763c634dc519a68632" exitCode=0
Nov 04 03:24:51.271892 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.271877    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf" event={"ID":"85cb4aab-7613-481a-af4c-228be87df8c9","Type":"ContainerDied","Data":"7e46aa0f8ee424bbb32cfa7b40d63e269e06aadbaf6882763c634dc519a68632"}
Nov 04 03:24:51.272373 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.272279    4510 scope.go:122] "RemoveContainer" containerID="7e46aa0f8ee424bbb32cfa7b40d63e269e06aadbaf6882763c634dc519a68632"
Nov 04 03:24:51.273403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.273375    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:24:51.273479 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.273443    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:24:51.273479 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.273474    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:24:51.670569 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.670480    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-k4vqp"]
Nov 04 03:24:51.673972 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.673948    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-k4vqp"
Nov 04 03:24:51.728564 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.728509    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9ktvr\""
Nov 04 03:24:51.730924 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.730893    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-k4vqp"]
Nov 04 03:24:51.817707 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.817143    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjfjr\" (UniqueName: \"kubernetes.io/projected/3fca2548-5d3c-4d55-8d60-997c1622c17c-kube-api-access-jjfjr\") pod \"authorino-6f6944bcdd-k4vqp\" (UID: \"3fca2548-5d3c-4d55-8d60-997c1622c17c\") " pod="kuadrant-system/authorino-6f6944bcdd-k4vqp"
Nov 04 03:24:51.857875 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.857840    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"]
Nov 04 03:24:51.861129 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.861113    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"
Nov 04 03:24:51.919266 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.919223    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjfjr\" (UniqueName: \"kubernetes.io/projected/3fca2548-5d3c-4d55-8d60-997c1622c17c-kube-api-access-jjfjr\") pod \"authorino-6f6944bcdd-k4vqp\" (UID: \"3fca2548-5d3c-4d55-8d60-997c1622c17c\") " pod="kuadrant-system/authorino-6f6944bcdd-k4vqp"
Nov 04 03:24:51.922140 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.922007    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"]
Nov 04 03:24:51.929631 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.929602    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-m6mdd\""
Nov 04 03:24:51.929631 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.929628    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Nov 04 03:24:51.929631 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.929630    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Nov 04 03:24:51.981098 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.981063    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjfjr\" (UniqueName: \"kubernetes.io/projected/3fca2548-5d3c-4d55-8d60-997c1622c17c-kube-api-access-jjfjr\") pod \"authorino-6f6944bcdd-k4vqp\" (UID: \"3fca2548-5d3c-4d55-8d60-997c1622c17c\") " pod="kuadrant-system/authorino-6f6944bcdd-k4vqp"
Nov 04 03:24:52.018709 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:51.997833    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-k4vqp"
Nov 04 03:24:52.020255 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.020213    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c383d916-fb50-48ef-9d54-0a24ad83ef07-maas-api-tls\") pod \"maas-api-59ffd9d8c6-h4rm5\" (UID: \"c383d916-fb50-48ef-9d54-0a24ad83ef07\") " pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"
Nov 04 03:24:52.020255 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.020221    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-k4vqp"]
Nov 04 03:24:52.020448 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.020293    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c383d916-fb50-48ef-9d54-0a24ad83ef07-metrics-certs\") pod \"maas-api-59ffd9d8c6-h4rm5\" (UID: \"c383d916-fb50-48ef-9d54-0a24ad83ef07\") " pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"
Nov 04 03:24:52.020448 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.020366    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftdkj\" (UniqueName: \"kubernetes.io/projected/c383d916-fb50-48ef-9d54-0a24ad83ef07-kube-api-access-ftdkj\") pod \"maas-api-59ffd9d8c6-h4rm5\" (UID: \"c383d916-fb50-48ef-9d54-0a24ad83ef07\") " pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"
Nov 04 03:24:52.020448 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.020440    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c383d916-fb50-48ef-9d54-0a24ad83ef07-openshift-service-ca\") pod \"maas-api-59ffd9d8c6-h4rm5\" (UID: \"c383d916-fb50-48ef-9d54-0a24ad83ef07\") " pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"
Nov 04 03:24:52.121431 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.121395    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftdkj\" (UniqueName: \"kubernetes.io/projected/c383d916-fb50-48ef-9d54-0a24ad83ef07-kube-api-access-ftdkj\") pod \"maas-api-59ffd9d8c6-h4rm5\" (UID: \"c383d916-fb50-48ef-9d54-0a24ad83ef07\") " pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"
Nov 04 03:24:52.121649 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.121455    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c383d916-fb50-48ef-9d54-0a24ad83ef07-openshift-service-ca\") pod \"maas-api-59ffd9d8c6-h4rm5\" (UID: \"c383d916-fb50-48ef-9d54-0a24ad83ef07\") " pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"
Nov 04 03:24:52.121649 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.121489    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c383d916-fb50-48ef-9d54-0a24ad83ef07-maas-api-tls\") pod \"maas-api-59ffd9d8c6-h4rm5\" (UID: \"c383d916-fb50-48ef-9d54-0a24ad83ef07\") " pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"
Nov 04 03:24:52.121649 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.121511    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c383d916-fb50-48ef-9d54-0a24ad83ef07-metrics-certs\") pod \"maas-api-59ffd9d8c6-h4rm5\" (UID: \"c383d916-fb50-48ef-9d54-0a24ad83ef07\") " pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"
Nov 04 03:24:52.122720 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.122669    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c383d916-fb50-48ef-9d54-0a24ad83ef07-openshift-service-ca\") pod \"maas-api-59ffd9d8c6-h4rm5\" (UID: \"c383d916-fb50-48ef-9d54-0a24ad83ef07\") " pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"
Nov 04 03:24:52.124748 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.124708    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c383d916-fb50-48ef-9d54-0a24ad83ef07-maas-api-tls\") pod \"maas-api-59ffd9d8c6-h4rm5\" (UID: \"c383d916-fb50-48ef-9d54-0a24ad83ef07\") " pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"
Nov 04 03:24:52.124846 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.124771    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c383d916-fb50-48ef-9d54-0a24ad83ef07-metrics-certs\") pod \"maas-api-59ffd9d8c6-h4rm5\" (UID: \"c383d916-fb50-48ef-9d54-0a24ad83ef07\") " pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"
Nov 04 03:24:52.184342 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.184268    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftdkj\" (UniqueName: \"kubernetes.io/projected/c383d916-fb50-48ef-9d54-0a24ad83ef07-kube-api-access-ftdkj\") pod \"maas-api-59ffd9d8c6-h4rm5\" (UID: \"c383d916-fb50-48ef-9d54-0a24ad83ef07\") " pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"
Nov 04 03:24:52.279828 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.279796    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf" event={"ID":"85cb4aab-7613-481a-af4c-228be87df8c9","Type":"ContainerStarted","Data":"f763177edfa06b4711fd496e7a77cac0c03b0b0721608124e0783e5d2253867d"}
Nov 04 03:24:52.390829 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.390615    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-k4vqp"]
Nov 04 03:24:52.393166 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:24:52.393136    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fca2548_5d3c_4d55_8d60_997c1622c17c.slice/crio-e18ef055fdfecf251bb4bb2da3e1161e69dc9af67ebe11e7fbbd82e55a7c18ae WatchSource:0}: Error finding container e18ef055fdfecf251bb4bb2da3e1161e69dc9af67ebe11e7fbbd82e55a7c18ae: Status 404 returned error can't find the container with id e18ef055fdfecf251bb4bb2da3e1161e69dc9af67ebe11e7fbbd82e55a7c18ae
Nov 04 03:24:52.473253 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.473221    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"
Nov 04 03:24:52.485219 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.485194    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85bcdc76cd-x98xg"]
Nov 04 03:24:52.522615 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.517034    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85bcdc76cd-x98xg"
Nov 04 03:24:52.547082 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.547039    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85bcdc76cd-x98xg"]
Nov 04 03:24:52.571605 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.571559    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Nov 04 03:24:52.626293 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.626247    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zshcr\" (UniqueName: \"kubernetes.io/projected/e0248ceb-d194-455c-ab2e-40b4d20ed5c4-kube-api-access-zshcr\") pod \"authorino-85bcdc76cd-x98xg\" (UID: \"e0248ceb-d194-455c-ab2e-40b4d20ed5c4\") " pod="kuadrant-system/authorino-85bcdc76cd-x98xg"
Nov 04 03:24:52.626293 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.626295    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e0248ceb-d194-455c-ab2e-40b4d20ed5c4-tls-cert\") pod \"authorino-85bcdc76cd-x98xg\" (UID: \"e0248ceb-d194-455c-ab2e-40b4d20ed5c4\") " pod="kuadrant-system/authorino-85bcdc76cd-x98xg"
Nov 04 03:24:52.727398 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.727287    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zshcr\" (UniqueName: \"kubernetes.io/projected/e0248ceb-d194-455c-ab2e-40b4d20ed5c4-kube-api-access-zshcr\") pod \"authorino-85bcdc76cd-x98xg\" (UID: \"e0248ceb-d194-455c-ab2e-40b4d20ed5c4\") " pod="kuadrant-system/authorino-85bcdc76cd-x98xg"
Nov 04 03:24:52.727398 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.727336    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e0248ceb-d194-455c-ab2e-40b4d20ed5c4-tls-cert\") pod \"authorino-85bcdc76cd-x98xg\" (UID: \"e0248ceb-d194-455c-ab2e-40b4d20ed5c4\") " pod="kuadrant-system/authorino-85bcdc76cd-x98xg"
Nov 04 03:24:52.729919 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.729898    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e0248ceb-d194-455c-ab2e-40b4d20ed5c4-tls-cert\") pod \"authorino-85bcdc76cd-x98xg\" (UID: \"e0248ceb-d194-455c-ab2e-40b4d20ed5c4\") " pod="kuadrant-system/authorino-85bcdc76cd-x98xg"
Nov 04 03:24:52.788993 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.788957    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zshcr\" (UniqueName: \"kubernetes.io/projected/e0248ceb-d194-455c-ab2e-40b4d20ed5c4-kube-api-access-zshcr\") pod \"authorino-85bcdc76cd-x98xg\" (UID: \"e0248ceb-d194-455c-ab2e-40b4d20ed5c4\") " pod="kuadrant-system/authorino-85bcdc76cd-x98xg"
Nov 04 03:24:52.833168 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.833127    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85bcdc76cd-x98xg"
Nov 04 03:24:52.857886 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.857849    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mpwlf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Nov 04 03:24:52.858047 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.857915    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf" podUID="85cb4aab-7613-481a-af4c-228be87df8c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Nov 04 03:24:52.862174 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.862149    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:24:52.885191 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:52.884933    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"]
Nov 04 03:24:52.888108 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:24:52.888076    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc383d916_fb50_48ef_9d54_0a24ad83ef07.slice/crio-2ea0353e30f3266e55172972615e90b956e6e55926e217e89156d98cb37a6081 WatchSource:0}: Error finding container 2ea0353e30f3266e55172972615e90b956e6e55926e217e89156d98cb37a6081: Status 404 returned error can't find the container with id 2ea0353e30f3266e55172972615e90b956e6e55926e217e89156d98cb37a6081
Nov 04 03:24:53.218807 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:53.218765    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85bcdc76cd-x98xg"]
Nov 04 03:24:53.224039 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:24:53.223997    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode0248ceb_d194_455c_ab2e_40b4d20ed5c4.slice/crio-c62a1cec285928b02e6689304bdc8ad516f72d2fda457777f2e2e7111a6ace15 WatchSource:0}: Error finding container c62a1cec285928b02e6689304bdc8ad516f72d2fda457777f2e2e7111a6ace15: Status 404 returned error can't find the container with id c62a1cec285928b02e6689304bdc8ad516f72d2fda457777f2e2e7111a6ace15
Nov 04 03:24:53.285605 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:53.285571    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85bcdc76cd-x98xg" event={"ID":"e0248ceb-d194-455c-ab2e-40b4d20ed5c4","Type":"ContainerStarted","Data":"c62a1cec285928b02e6689304bdc8ad516f72d2fda457777f2e2e7111a6ace15"}
Nov 04 03:24:53.286837 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:53.286810    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-k4vqp" event={"ID":"3fca2548-5d3c-4d55-8d60-997c1622c17c","Type":"ContainerStarted","Data":"e18ef055fdfecf251bb4bb2da3e1161e69dc9af67ebe11e7fbbd82e55a7c18ae"}
Nov 04 03:24:53.288024 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:53.287993    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5" event={"ID":"c383d916-fb50-48ef-9d54-0a24ad83ef07","Type":"ContainerStarted","Data":"2ea0353e30f3266e55172972615e90b956e6e55926e217e89156d98cb37a6081"}
Nov 04 03:24:53.341560 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:24:53.341526    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:24:53.858342 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:53.858298    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mpwlf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Nov 04 03:24:53.858548 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:53.858367    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf" podUID="85cb4aab-7613-481a-af4c-228be87df8c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Nov 04 03:24:54.326257 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:54.326221    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-k4vqp" event={"ID":"3fca2548-5d3c-4d55-8d60-997c1622c17c","Type":"ContainerStarted","Data":"0040d024a4e326193dc53bca2f889979e64c23321967cd3a67fe2dab80032324"}
Nov 04 03:24:54.326782 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:54.326319    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6f6944bcdd-k4vqp" podUID="3fca2548-5d3c-4d55-8d60-997c1622c17c" containerName="authorino" containerID="cri-o://0040d024a4e326193dc53bca2f889979e64c23321967cd3a67fe2dab80032324" gracePeriod=30
Nov 04 03:24:54.443210 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:54.443157    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6f6944bcdd-k4vqp" podStartSLOduration=1.897091069 podStartE2EDuration="3.443137194s" totalImagesPullingTime="1.546046125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:24:54.441519657 +0000 UTC m=+469.705393964" watchObservedRunningTime="2026-11-04 03:24:54.443137194 +0000 UTC m=+469.707011504"
Nov 04 03:24:54.639635 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:54.639614    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-k4vqp"
Nov 04 03:24:54.643286 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:54.643266    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3fca2548-5d3c-4d55-8d60-997c1622c17c-kube-api-access-jjfjr\" (UniqueName: \"kubernetes.io/projected/3fca2548-5d3c-4d55-8d60-997c1622c17c-kube-api-access-jjfjr\") pod \"3fca2548-5d3c-4d55-8d60-997c1622c17c\" (UID: \"3fca2548-5d3c-4d55-8d60-997c1622c17c\") "
Nov 04 03:24:54.651211 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:54.651178    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fca2548-5d3c-4d55-8d60-997c1622c17c-kube-api-access-jjfjr" pod "3fca2548-5d3c-4d55-8d60-997c1622c17c" (UID: "3fca2548-5d3c-4d55-8d60-997c1622c17c"). InnerVolumeSpecName "kube-api-access-jjfjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:24:54.744046 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:54.743995    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jjfjr\" (UniqueName: \"kubernetes.io/projected/3fca2548-5d3c-4d55-8d60-997c1622c17c-kube-api-access-jjfjr\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:24:54.857723 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:54.857604    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mpwlf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Nov 04 03:24:54.857723 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:54.857671    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf" podUID="85cb4aab-7613-481a-af4c-228be87df8c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Nov 04 03:24:55.332829 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:55.332798    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85bcdc76cd-x98xg" event={"ID":"e0248ceb-d194-455c-ab2e-40b4d20ed5c4","Type":"ContainerStarted","Data":"b6bf347c0cccbbf6b1dd16011b465836dbaa97d49bfc436e813b272d445ff62c"}
Nov 04 03:24:55.335047 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:55.335017    4510 generic.go:356] "Generic (PLEG): container finished" podID="3fca2548-5d3c-4d55-8d60-997c1622c17c" containerID="0040d024a4e326193dc53bca2f889979e64c23321967cd3a67fe2dab80032324" exitCode=0
Nov 04 03:24:55.335175 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:55.335094    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-k4vqp" event={"ID":"3fca2548-5d3c-4d55-8d60-997c1622c17c","Type":"ContainerDied","Data":"0040d024a4e326193dc53bca2f889979e64c23321967cd3a67fe2dab80032324"}
Nov 04 03:24:55.335175 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:55.335125    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-k4vqp" event={"ID":"3fca2548-5d3c-4d55-8d60-997c1622c17c","Type":"ContainerDied","Data":"e18ef055fdfecf251bb4bb2da3e1161e69dc9af67ebe11e7fbbd82e55a7c18ae"}
Nov 04 03:24:55.335175 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:55.335146    4510 scope.go:122] "RemoveContainer" containerID="0040d024a4e326193dc53bca2f889979e64c23321967cd3a67fe2dab80032324"
Nov 04 03:24:55.335295 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:55.335283    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-k4vqp"
Nov 04 03:24:55.352176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:55.352151    4510 scope.go:122] "RemoveContainer" containerID="0040d024a4e326193dc53bca2f889979e64c23321967cd3a67fe2dab80032324"
Nov 04 03:24:55.352566 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:24:55.352539    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0040d024a4e326193dc53bca2f889979e64c23321967cd3a67fe2dab80032324\": container with ID starting with 0040d024a4e326193dc53bca2f889979e64c23321967cd3a67fe2dab80032324 not found: ID does not exist" containerID="0040d024a4e326193dc53bca2f889979e64c23321967cd3a67fe2dab80032324"
Nov 04 03:24:55.352661 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:55.352579    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0040d024a4e326193dc53bca2f889979e64c23321967cd3a67fe2dab80032324"} err="failed to get container status \"0040d024a4e326193dc53bca2f889979e64c23321967cd3a67fe2dab80032324\": rpc error: code = NotFound desc = could not find container \"0040d024a4e326193dc53bca2f889979e64c23321967cd3a67fe2dab80032324\": container with ID starting with 0040d024a4e326193dc53bca2f889979e64c23321967cd3a67fe2dab80032324 not found: ID does not exist"
Nov 04 03:24:55.466365 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:55.466305    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-85bcdc76cd-x98xg" podStartSLOduration=2.199122307 podStartE2EDuration="3.466291329s" totalImagesPullingTime="1.267169022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:24:55.464053537 +0000 UTC m=+470.727927844" watchObservedRunningTime="2026-11-04 03:24:55.466291329 +0000 UTC m=+470.730165637"
Nov 04 03:24:55.579901 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:55.579865    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-k4vqp"]
Nov 04 03:24:55.583803 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:55.583736    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-k4vqp"]
Nov 04 03:24:55.858533 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:55.858449    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mpwlf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Nov 04 03:24:55.858533 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:55.858516    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf" podUID="85cb4aab-7613-481a-af4c-228be87df8c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Nov 04 03:24:56.392119 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:56.392080    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-82ql9"]
Nov 04 03:24:56.392673 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:56.392495    4510 cpu_manager.go:414] "containerMap: removing container" podUID="3fca2548-5d3c-4d55-8d60-997c1622c17c" containerName="authorino"
Nov 04 03:24:56.392673 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:56.392513    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3fca2548-5d3c-4d55-8d60-997c1622c17c" containerName="authorino"
Nov 04 03:24:56.392673 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:56.392601    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="3fca2548-5d3c-4d55-8d60-997c1622c17c" containerName="authorino"
Nov 04 03:24:56.420363 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:56.420332    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-82ql9"
Nov 04 03:24:56.453979 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:56.453944    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-82ql9"]
Nov 04 03:24:56.460009 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:56.459948    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss8mp\" (UniqueName: \"kubernetes.io/projected/37844287-506b-44bb-8d42-7c5c8b37f09e-kube-api-access-ss8mp\") pod \"llmisvc-controller-manager-6466c554d8-82ql9\" (UID: \"37844287-506b-44bb-8d42-7c5c8b37f09e\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-82ql9"
Nov 04 03:24:56.460189 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:56.460140    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37844287-506b-44bb-8d42-7c5c8b37f09e-cert\") pod \"llmisvc-controller-manager-6466c554d8-82ql9\" (UID: \"37844287-506b-44bb-8d42-7c5c8b37f09e\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-82ql9"
Nov 04 03:24:56.560965 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:56.560913    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss8mp\" (UniqueName: \"kubernetes.io/projected/37844287-506b-44bb-8d42-7c5c8b37f09e-kube-api-access-ss8mp\") pod \"llmisvc-controller-manager-6466c554d8-82ql9\" (UID: \"37844287-506b-44bb-8d42-7c5c8b37f09e\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-82ql9"
Nov 04 03:24:56.561158 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:56.561024    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37844287-506b-44bb-8d42-7c5c8b37f09e-cert\") pod \"llmisvc-controller-manager-6466c554d8-82ql9\" (UID: \"37844287-506b-44bb-8d42-7c5c8b37f09e\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-82ql9"
Nov 04 03:24:56.563974 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:56.563951    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/37844287-506b-44bb-8d42-7c5c8b37f09e-cert\") pod \"llmisvc-controller-manager-6466c554d8-82ql9\" (UID: \"37844287-506b-44bb-8d42-7c5c8b37f09e\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-82ql9"
Nov 04 03:24:56.623254 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:56.623216    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss8mp\" (UniqueName: \"kubernetes.io/projected/37844287-506b-44bb-8d42-7c5c8b37f09e-kube-api-access-ss8mp\") pod \"llmisvc-controller-manager-6466c554d8-82ql9\" (UID: \"37844287-506b-44bb-8d42-7c5c8b37f09e\") " pod="opendatahub/llmisvc-controller-manager-6466c554d8-82ql9"
Nov 04 03:24:56.735220 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:56.735182    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-6466c554d8-82ql9"
Nov 04 03:24:56.857926 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:56.857895    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mpwlf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Nov 04 03:24:56.858079 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:56.857970    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf" podUID="85cb4aab-7613-481a-af4c-228be87df8c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Nov 04 03:24:56.864517 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:56.864482    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3fca2548-5d3c-4d55-8d60-997c1622c17c" path="/var/lib/kubelet/pods/3fca2548-5d3c-4d55-8d60-997c1622c17c/volumes"
Nov 04 03:24:57.116285 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:57.116183    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-6466c554d8-82ql9"]
Nov 04 03:24:57.123052 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:24:57.123017    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37844287_506b_44bb_8d42_7c5c8b37f09e.slice/crio-92d9b3e38727e5e02b822d331aae454abdb0b55f17778df7bac96560dcd28aee WatchSource:0}: Error finding container 92d9b3e38727e5e02b822d331aae454abdb0b55f17778df7bac96560dcd28aee: Status 404 returned error can't find the container with id 92d9b3e38727e5e02b822d331aae454abdb0b55f17778df7bac96560dcd28aee
Nov 04 03:24:57.349979 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:57.349942    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5" event={"ID":"c383d916-fb50-48ef-9d54-0a24ad83ef07","Type":"ContainerStarted","Data":"8486b0900b8d9901745b96ca6ec124a56d1f7790ea0baeb09f63f70611715c7d"}
Nov 04 03:24:57.350148 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:57.350086    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"
Nov 04 03:24:57.351330 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:57.351308    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-82ql9" event={"ID":"37844287-506b-44bb-8d42-7c5c8b37f09e","Type":"ContainerStarted","Data":"92d9b3e38727e5e02b822d331aae454abdb0b55f17778df7bac96560dcd28aee"}
Nov 04 03:24:57.469325 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:57.469272    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5" podStartSLOduration=2.579162599 podStartE2EDuration="6.469256812s" totalImagesPullingTime="3.890094213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:24:57.467434078 +0000 UTC m=+472.731308385" watchObservedRunningTime="2026-11-04 03:24:57.469256812 +0000 UTC m=+472.733131119"
Nov 04 03:24:57.861782 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:57.861704    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:24:57.862148 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:57.862128    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:24:57.862917 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:57.862897    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:24:58.357950 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:58.357911    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-6466c554d8-82ql9" event={"ID":"37844287-506b-44bb-8d42-7c5c8b37f09e","Type":"ContainerStarted","Data":"a10084e0841d71301166757193326bc8b72b3d3beb17976eebef8876e712aa55"}
Nov 04 03:24:58.358154 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:58.357978    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-82ql9"
Nov 04 03:24:58.476137 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:24:58.476064    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-6466c554d8-82ql9" podStartSLOduration=1.694710935 podStartE2EDuration="2.476048487s" totalImagesPullingTime="781.337552ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:24:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:24:58.474728723 +0000 UTC m=+473.738603028" watchObservedRunningTime="2026-11-04 03:24:58.476048487 +0000 UTC m=+473.739922794"
Nov 04 03:25:03.364139 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:03.364112    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-59ffd9d8c6-h4rm5"
Nov 04 03:25:23.316143 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:25:23.316061    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:25:29.365601 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:29.365566    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-6466c554d8-82ql9"
Nov 04 03:25:29.534266 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:29.534227    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668"]
Nov 04 03:25:29.534470 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:29.534430    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668" podUID="2ba995a6-df39-4b56-9364-4ef857414cab" containerName="manager" containerID="cri-o://ed5e30c8e2e06b822699540c0370b18dd4254315ac554023f1d6cf13ab2a6248" gracePeriod=30
Nov 04 03:25:29.774438 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:29.774417    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668"
Nov 04 03:25:29.841041 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:29.841012    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2ba995a6-df39-4b56-9364-4ef857414cab-kube-api-access-j5bhm\" (UniqueName: \"kubernetes.io/projected/2ba995a6-df39-4b56-9364-4ef857414cab-kube-api-access-j5bhm\") pod \"2ba995a6-df39-4b56-9364-4ef857414cab\" (UID: \"2ba995a6-df39-4b56-9364-4ef857414cab\") "
Nov 04 03:25:29.841161 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:29.841052    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2ba995a6-df39-4b56-9364-4ef857414cab-cert\" (UniqueName: \"kubernetes.io/secret/2ba995a6-df39-4b56-9364-4ef857414cab-cert\") pod \"2ba995a6-df39-4b56-9364-4ef857414cab\" (UID: \"2ba995a6-df39-4b56-9364-4ef857414cab\") "
Nov 04 03:25:29.843273 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:29.843244    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ba995a6-df39-4b56-9364-4ef857414cab-kube-api-access-j5bhm" pod "2ba995a6-df39-4b56-9364-4ef857414cab" (UID: "2ba995a6-df39-4b56-9364-4ef857414cab"). InnerVolumeSpecName "kube-api-access-j5bhm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:25:29.843390 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:29.843277    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ba995a6-df39-4b56-9364-4ef857414cab-cert" pod "2ba995a6-df39-4b56-9364-4ef857414cab" (UID: "2ba995a6-df39-4b56-9364-4ef857414cab"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:25:29.941887 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:29.941818    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5bhm\" (UniqueName: \"kubernetes.io/projected/2ba995a6-df39-4b56-9364-4ef857414cab-kube-api-access-j5bhm\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:25:29.941887 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:29.941844    4510 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2ba995a6-df39-4b56-9364-4ef857414cab-cert\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:25:30.522263 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:30.522225    4510 generic.go:356] "Generic (PLEG): container finished" podID="2ba995a6-df39-4b56-9364-4ef857414cab" containerID="ed5e30c8e2e06b822699540c0370b18dd4254315ac554023f1d6cf13ab2a6248" exitCode=0
Nov 04 03:25:30.522715 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:30.522278    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668"
Nov 04 03:25:30.522715 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:30.522299    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668" event={"ID":"2ba995a6-df39-4b56-9364-4ef857414cab","Type":"ContainerDied","Data":"ed5e30c8e2e06b822699540c0370b18dd4254315ac554023f1d6cf13ab2a6248"}
Nov 04 03:25:30.522715 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:30.522372    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668" event={"ID":"2ba995a6-df39-4b56-9364-4ef857414cab","Type":"ContainerDied","Data":"29f84fb77329e26d84dcee32af4049c92be698fdf7230aa298299ac4d48a6e30"}
Nov 04 03:25:30.522715 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:30.522395    4510 scope.go:122] "RemoveContainer" containerID="ed5e30c8e2e06b822699540c0370b18dd4254315ac554023f1d6cf13ab2a6248"
Nov 04 03:25:30.531473 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:30.531455    4510 scope.go:122] "RemoveContainer" containerID="ed5e30c8e2e06b822699540c0370b18dd4254315ac554023f1d6cf13ab2a6248"
Nov 04 03:25:30.531760 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:25:30.531738    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed5e30c8e2e06b822699540c0370b18dd4254315ac554023f1d6cf13ab2a6248\": container with ID starting with ed5e30c8e2e06b822699540c0370b18dd4254315ac554023f1d6cf13ab2a6248 not found: ID does not exist" containerID="ed5e30c8e2e06b822699540c0370b18dd4254315ac554023f1d6cf13ab2a6248"
Nov 04 03:25:30.531840 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:30.531772    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed5e30c8e2e06b822699540c0370b18dd4254315ac554023f1d6cf13ab2a6248"} err="failed to get container status \"ed5e30c8e2e06b822699540c0370b18dd4254315ac554023f1d6cf13ab2a6248\": rpc error: code = NotFound desc = could not find container \"ed5e30c8e2e06b822699540c0370b18dd4254315ac554023f1d6cf13ab2a6248\": container with ID starting with ed5e30c8e2e06b822699540c0370b18dd4254315ac554023f1d6cf13ab2a6248 not found: ID does not exist"
Nov 04 03:25:30.772734 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:30.772664    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668"]
Nov 04 03:25:30.826921 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:30.826896    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/llmisvc-controller-manager-869d5dcc5d-cc668"]
Nov 04 03:25:30.861491 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:25:30.861465    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2ba995a6-df39-4b56-9364-4ef857414cab" path="/var/lib/kubelet/pods/2ba995a6-df39-4b56-9364-4ef857414cab/volumes"
Nov 04 03:25:53.315532 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:25:53.315495    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:26:23.316665 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:26:23.316624    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:26:53.320950 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:26:53.320905    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:27:03.432929 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.432895    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"]
Nov 04 03:27:03.433371 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.433306    4510 cpu_manager.go:414] "containerMap: removing container" podUID="2ba995a6-df39-4b56-9364-4ef857414cab" containerName="manager"
Nov 04 03:27:03.433371 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.433320    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2ba995a6-df39-4b56-9364-4ef857414cab" containerName="manager"
Nov 04 03:27:03.433451 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.433377    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="2ba995a6-df39-4b56-9364-4ef857414cab" containerName="manager"
Nov 04 03:27:03.436467 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.436448    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.536730 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.536655    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.536945 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.536739    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.536945 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.536837    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.536945 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.536876    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.536945 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.536907    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.537175 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.536956    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbs28\" (UniqueName: \"kubernetes.io/projected/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-kube-api-access-wbs28\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.537175 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.536986    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.537175 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.537025    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.537175 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.537051    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.542434 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.542395    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"]
Nov 04 03:27:03.638462 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.638421    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.638462 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.638461    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.638751 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.638483    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.638751 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.638614    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.638751 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.638648    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.638912 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.638893    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.638967 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.638917    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbs28\" (UniqueName: \"kubernetes.io/projected/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-kube-api-access-wbs28\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.638967 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.638944    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.639068 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.638954    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.639068 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.639053    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.639149 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.639088    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.639293 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.639265    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.639438 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.639319    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.639724 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.639703    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.641761 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.641743    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.642047 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.642025    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.700304 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.700232    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.700304 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.700273    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbs28\" (UniqueName: \"kubernetes.io/projected/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-kube-api-access-wbs28\") pod \"maas-default-gateway-openshift-default-6dcf757899-26fdx\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:03.749766 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:03.749733    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:04.180279 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:04.180255    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"]
Nov 04 03:27:04.182531 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:27:04.182509    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc4707c_e267_440a_8e5a_e8acbe2f14b9.slice/crio-55db15626d68a488a222c088eb3175bdc75daac4ae523b288246d1cb82c63496 WatchSource:0}: Error finding container 55db15626d68a488a222c088eb3175bdc75daac4ae523b288246d1cb82c63496: Status 404 returned error can't find the container with id 55db15626d68a488a222c088eb3175bdc75daac4ae523b288246d1cb82c63496
Nov 04 03:27:04.184647 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:04.184616    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:27:04.184749 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:04.184697    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:27:04.184749 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:04.184727    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:27:04.985878 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:04.985841    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx" event={"ID":"9cc4707c-e267-440a-8e5a-e8acbe2f14b9","Type":"ContainerStarted","Data":"fb8400813a82b48309870bbf70f0ac731b4a6916f532ff42933fe0ce8fee82b1"}
Nov 04 03:27:04.986261 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:04.985926    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx" event={"ID":"9cc4707c-e267-440a-8e5a-e8acbe2f14b9","Type":"ContainerStarted","Data":"55db15626d68a488a222c088eb3175bdc75daac4ae523b288246d1cb82c63496"}
Nov 04 03:27:05.218708 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:05.216765    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx" podStartSLOduration=2.216744507 podStartE2EDuration="2.216744507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:27:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:27:05.155730324 +0000 UTC m=+600.419604632" watchObservedRunningTime="2026-11-04 03:27:05.216744507 +0000 UTC m=+600.480618815"
Nov 04 03:27:05.750318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:05.750286    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:05.751823 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:05.751800    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-26fdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Nov 04 03:27:05.751941 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:05.751869    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx" podUID="9cc4707c-e267-440a-8e5a-e8acbe2f14b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Nov 04 03:27:06.750094 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:06.750052    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-26fdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Nov 04 03:27:06.750574 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:06.750103    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx" podUID="9cc4707c-e267-440a-8e5a-e8acbe2f14b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Nov 04 03:27:07.750834 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:07.750798    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-26fdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Nov 04 03:27:07.751248 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:07.750857    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx" podUID="9cc4707c-e267-440a-8e5a-e8acbe2f14b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Nov 04 03:27:08.750567 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:08.750534    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-26fdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Nov 04 03:27:08.750806 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:08.750590    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx" podUID="9cc4707c-e267-440a-8e5a-e8acbe2f14b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Nov 04 03:27:09.750225 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:09.750189    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-26fdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Nov 04 03:27:09.750623 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:09.750243    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx" podUID="9cc4707c-e267-440a-8e5a-e8acbe2f14b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Nov 04 03:27:10.750531 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:10.750490    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-26fdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Nov 04 03:27:10.751023 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:10.750553    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx" podUID="9cc4707c-e267-440a-8e5a-e8acbe2f14b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Nov 04 03:27:11.750535 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:11.750499    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-26fdx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused" start-of-body=
Nov 04 03:27:11.750971 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:11.750591    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx" podUID="9cc4707c-e267-440a-8e5a-e8acbe2f14b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.46:15021/healthz/ready\": dial tcp 10.133.0.46:15021: connect: connection refused"
Nov 04 03:27:12.756704 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:12.756642    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:12.757472 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:12.757432    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:12.758080 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:12.758059    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:27:23.316379 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:27:23.316342    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:27:24.695549 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:24.695509    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85bcdc76cd-x98xg"]
Nov 04 03:27:24.696224 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:24.695725    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-85bcdc76cd-x98xg" podUID="e0248ceb-d194-455c-ab2e-40b4d20ed5c4" containerName="authorino" containerID="cri-o://b6bf347c0cccbbf6b1dd16011b465836dbaa97d49bfc436e813b272d445ff62c" gracePeriod=30
Nov 04 03:27:24.947012 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:24.946955    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85bcdc76cd-x98xg"
Nov 04 03:27:25.045459 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:25.045423    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e0248ceb-d194-455c-ab2e-40b4d20ed5c4-tls-cert\" (UniqueName: \"kubernetes.io/secret/e0248ceb-d194-455c-ab2e-40b4d20ed5c4-tls-cert\") pod \"e0248ceb-d194-455c-ab2e-40b4d20ed5c4\" (UID: \"e0248ceb-d194-455c-ab2e-40b4d20ed5c4\") "
Nov 04 03:27:25.045639 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:25.045500    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e0248ceb-d194-455c-ab2e-40b4d20ed5c4-kube-api-access-zshcr\" (UniqueName: \"kubernetes.io/projected/e0248ceb-d194-455c-ab2e-40b4d20ed5c4-kube-api-access-zshcr\") pod \"e0248ceb-d194-455c-ab2e-40b4d20ed5c4\" (UID: \"e0248ceb-d194-455c-ab2e-40b4d20ed5c4\") "
Nov 04 03:27:25.047711 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:25.047667    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0248ceb-d194-455c-ab2e-40b4d20ed5c4-kube-api-access-zshcr" pod "e0248ceb-d194-455c-ab2e-40b4d20ed5c4" (UID: "e0248ceb-d194-455c-ab2e-40b4d20ed5c4"). InnerVolumeSpecName "kube-api-access-zshcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:27:25.055989 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:25.055960    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0248ceb-d194-455c-ab2e-40b4d20ed5c4-tls-cert" pod "e0248ceb-d194-455c-ab2e-40b4d20ed5c4" (UID: "e0248ceb-d194-455c-ab2e-40b4d20ed5c4"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:27:25.105040 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:25.105001    4510 generic.go:356] "Generic (PLEG): container finished" podID="e0248ceb-d194-455c-ab2e-40b4d20ed5c4" containerID="b6bf347c0cccbbf6b1dd16011b465836dbaa97d49bfc436e813b272d445ff62c" exitCode=0
Nov 04 03:27:25.105214 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:25.105060    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85bcdc76cd-x98xg"
Nov 04 03:27:25.105214 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:25.105089    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85bcdc76cd-x98xg" event={"ID":"e0248ceb-d194-455c-ab2e-40b4d20ed5c4","Type":"ContainerDied","Data":"b6bf347c0cccbbf6b1dd16011b465836dbaa97d49bfc436e813b272d445ff62c"}
Nov 04 03:27:25.105214 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:25.105143    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85bcdc76cd-x98xg" event={"ID":"e0248ceb-d194-455c-ab2e-40b4d20ed5c4","Type":"ContainerDied","Data":"c62a1cec285928b02e6689304bdc8ad516f72d2fda457777f2e2e7111a6ace15"}
Nov 04 03:27:25.105214 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:25.105166    4510 scope.go:122] "RemoveContainer" containerID="b6bf347c0cccbbf6b1dd16011b465836dbaa97d49bfc436e813b272d445ff62c"
Nov 04 03:27:25.116553 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:25.116537    4510 scope.go:122] "RemoveContainer" containerID="b6bf347c0cccbbf6b1dd16011b465836dbaa97d49bfc436e813b272d445ff62c"
Nov 04 03:27:25.116863 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:27:25.116835    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6bf347c0cccbbf6b1dd16011b465836dbaa97d49bfc436e813b272d445ff62c\": container with ID starting with b6bf347c0cccbbf6b1dd16011b465836dbaa97d49bfc436e813b272d445ff62c not found: ID does not exist" containerID="b6bf347c0cccbbf6b1dd16011b465836dbaa97d49bfc436e813b272d445ff62c"
Nov 04 03:27:25.116944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:25.116879    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6bf347c0cccbbf6b1dd16011b465836dbaa97d49bfc436e813b272d445ff62c"} err="failed to get container status \"b6bf347c0cccbbf6b1dd16011b465836dbaa97d49bfc436e813b272d445ff62c\": rpc error: code = NotFound desc = could not find container \"b6bf347c0cccbbf6b1dd16011b465836dbaa97d49bfc436e813b272d445ff62c\": container with ID starting with b6bf347c0cccbbf6b1dd16011b465836dbaa97d49bfc436e813b272d445ff62c not found: ID does not exist"
Nov 04 03:27:25.146931 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:25.146908    4510 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e0248ceb-d194-455c-ab2e-40b4d20ed5c4-tls-cert\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:27:25.147021 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:25.146934    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zshcr\" (UniqueName: \"kubernetes.io/projected/e0248ceb-d194-455c-ab2e-40b4d20ed5c4-kube-api-access-zshcr\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:27:25.269113 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:25.269081    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85bcdc76cd-x98xg"]
Nov 04 03:27:25.272894 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:25.272871    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-85bcdc76cd-x98xg"]
Nov 04 03:27:26.863135 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:27:26.863098    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e0248ceb-d194-455c-ab2e-40b4d20ed5c4" path="/var/lib/kubelet/pods/e0248ceb-d194-455c-ab2e-40b4d20ed5c4/volumes"
Nov 04 03:27:53.316005 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:27:53.315959    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:28:23.317635 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:28:23.317548    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:28:53.316873 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:28:53.316832    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:29:15.861008 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:15.860973    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4"]
Nov 04 03:29:15.861395 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:15.861312    4510 cpu_manager.go:414] "containerMap: removing container" podUID="e0248ceb-d194-455c-ab2e-40b4d20ed5c4" containerName="authorino"
Nov 04 03:29:15.861395 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:15.861324    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e0248ceb-d194-455c-ab2e-40b4d20ed5c4" containerName="authorino"
Nov 04 03:29:15.861395 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:15.861387    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="e0248ceb-d194-455c-ab2e-40b4d20ed5c4" containerName="authorino"
Nov 04 03:29:15.864396 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:15.864380    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4"
Nov 04 03:29:15.916752 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:15.916723    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-36ccd3\""
Nov 04 03:29:15.966744 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:15.966707    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-36ccd3-dockercfg-gn8wn\""
Nov 04 03:29:15.969657 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:15.969615    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4"]
Nov 04 03:29:16.012441 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.012402    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1e9672f-aa23-4c1b-ad67-e01f2ae0b993-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4\" (UID: \"d1e9672f-aa23-4c1b-ad67-e01f2ae0b993\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4"
Nov 04 03:29:16.012623 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.012476    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt2ch\" (UniqueName: \"kubernetes.io/projected/d1e9672f-aa23-4c1b-ad67-e01f2ae0b993-kube-api-access-dt2ch\") pod \"payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4\" (UID: \"d1e9672f-aa23-4c1b-ad67-e01f2ae0b993\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4"
Nov 04 03:29:16.018616 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.018589    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t"]
Nov 04 03:29:16.021911 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.021896    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t"
Nov 04 03:29:16.064648 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.064608    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t"]
Nov 04 03:29:16.113601 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.113508    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1e9672f-aa23-4c1b-ad67-e01f2ae0b993-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4\" (UID: \"d1e9672f-aa23-4c1b-ad67-e01f2ae0b993\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4"
Nov 04 03:29:16.113601 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.113553    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt2ch\" (UniqueName: \"kubernetes.io/projected/d1e9672f-aa23-4c1b-ad67-e01f2ae0b993-kube-api-access-dt2ch\") pod \"payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4\" (UID: \"d1e9672f-aa23-4c1b-ad67-e01f2ae0b993\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4"
Nov 04 03:29:16.114296 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.114269    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1e9672f-aa23-4c1b-ad67-e01f2ae0b993-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4\" (UID: \"d1e9672f-aa23-4c1b-ad67-e01f2ae0b993\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4"
Nov 04 03:29:16.175250 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.175223    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt2ch\" (UniqueName: \"kubernetes.io/projected/d1e9672f-aa23-4c1b-ad67-e01f2ae0b993-kube-api-access-dt2ch\") pod \"payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4\" (UID: \"d1e9672f-aa23-4c1b-ad67-e01f2ae0b993\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4"
Nov 04 03:29:16.177533 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.177511    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4"
Nov 04 03:29:16.214292 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.214245    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2dqt\" (UniqueName: \"kubernetes.io/projected/a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443-kube-api-access-v2dqt\") pod \"payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t\" (UID: \"a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t"
Nov 04 03:29:16.214471 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.214377    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t\" (UID: \"a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t"
Nov 04 03:29:16.315627 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.315585    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2dqt\" (UniqueName: \"kubernetes.io/projected/a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443-kube-api-access-v2dqt\") pod \"payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t\" (UID: \"a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t"
Nov 04 03:29:16.315857 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.315652    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t\" (UID: \"a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t"
Nov 04 03:29:16.316391 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.316365    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t\" (UID: \"a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t"
Nov 04 03:29:16.377466 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.377377    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2dqt\" (UniqueName: \"kubernetes.io/projected/a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443-kube-api-access-v2dqt\") pod \"payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t\" (UID: \"a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t"
Nov 04 03:29:16.562393 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.562365    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4"]
Nov 04 03:29:16.564578 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:29:16.564549    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1e9672f_aa23_4c1b_ad67_e01f2ae0b993.slice/crio-c58d2ac30e09bd1cb5d3cca975a71155f4a56978eec5b7363e16d93069dcbbeb WatchSource:0}: Error finding container c58d2ac30e09bd1cb5d3cca975a71155f4a56978eec5b7363e16d93069dcbbeb: Status 404 returned error can't find the container with id c58d2ac30e09bd1cb5d3cca975a71155f4a56978eec5b7363e16d93069dcbbeb
Nov 04 03:29:16.566364 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.566348    4510 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 03:29:16.634066 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.633984    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t"
Nov 04 03:29:16.647108 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:16.647073    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4" event={"ID":"d1e9672f-aa23-4c1b-ad67-e01f2ae0b993","Type":"ContainerStarted","Data":"c58d2ac30e09bd1cb5d3cca975a71155f4a56978eec5b7363e16d93069dcbbeb"}
Nov 04 03:29:17.011208 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:17.011167    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t"]
Nov 04 03:29:17.015457 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:29:17.015418    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7a3ce8c_36c4_4e7e_8bd0_8f9fb1c2f443.slice/crio-8df3f9637e2484bc7704c3b00f3108f10b14e0f31e1577a9f41e2237ac236766 WatchSource:0}: Error finding container 8df3f9637e2484bc7704c3b00f3108f10b14e0f31e1577a9f41e2237ac236766: Status 404 returned error can't find the container with id 8df3f9637e2484bc7704c3b00f3108f10b14e0f31e1577a9f41e2237ac236766
Nov 04 03:29:17.655219 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:17.655180    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t" event={"ID":"a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443","Type":"ContainerStarted","Data":"8df3f9637e2484bc7704c3b00f3108f10b14e0f31e1577a9f41e2237ac236766"}
Nov 04 03:29:19.673329 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:19.673300    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4" event={"ID":"d1e9672f-aa23-4c1b-ad67-e01f2ae0b993","Type":"ContainerStarted","Data":"b5c96147174ee7f4ff82e5f24d6441f0dc29bb9a0c837b0cd00a744b2e746489"}
Nov 04 03:29:19.673875 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:19.673405    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4"
Nov 04 03:29:19.791965 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:19.791906    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4" podStartSLOduration=2.048521441 podStartE2EDuration="4.791891058s" totalImagesPullingTime="2.743369617s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:29:19.790672819 +0000 UTC m=+735.054547127" watchObservedRunningTime="2026-11-04 03:29:19.791891058 +0000 UTC m=+735.055765364"
Nov 04 03:29:20.680762 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:20.680718    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t" event={"ID":"a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443","Type":"ContainerStarted","Data":"9aef7c5b814b4d1859036b82e547336e306e190c0615c473e7b2fbb2ff65fcb4"}
Nov 04 03:29:20.681172 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:20.680816    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t"
Nov 04 03:29:23.316580 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:29:23.316529    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:29:24.903143 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:24.903093    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t" podStartSLOduration=7.284194854 podStartE2EDuration="9.903080401s" totalImagesPullingTime="2.618885547s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:29:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:29:20.80900959 +0000 UTC m=+736.072883900" watchObservedRunningTime="2026-11-04 03:29:24.903080401 +0000 UTC m=+740.166954707"
Nov 04 03:29:24.905191 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:24.905170    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"]
Nov 04 03:29:24.908751 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:24.908731    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:29:24.961123 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:24.961083    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w2-af788a-serving-cert\""
Nov 04 03:29:25.000344 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.000308    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c943ec-886f-4198-bb58-f67c63173668-maas-api-tls\") pod \"maas-api-e2e-worker-w2-af788a-6c477456db-4gd68\" (UID: \"76c943ec-886f-4198-bb58-f67c63173668\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:29:25.000344 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.000343    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76c943ec-886f-4198-bb58-f67c63173668-metrics-certs\") pod \"maas-api-e2e-worker-w2-af788a-6c477456db-4gd68\" (UID: \"76c943ec-886f-4198-bb58-f67c63173668\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:29:25.000536 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.000424    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c943ec-886f-4198-bb58-f67c63173668-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-af788a-6c477456db-4gd68\" (UID: \"76c943ec-886f-4198-bb58-f67c63173668\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:29:25.000536 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.000471    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6d6v\" (UniqueName: \"kubernetes.io/projected/76c943ec-886f-4198-bb58-f67c63173668-kube-api-access-s6d6v\") pod \"maas-api-e2e-worker-w2-af788a-6c477456db-4gd68\" (UID: \"76c943ec-886f-4198-bb58-f67c63173668\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:29:25.013164 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.013130    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"]
Nov 04 03:29:25.101598 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.101557    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6d6v\" (UniqueName: \"kubernetes.io/projected/76c943ec-886f-4198-bb58-f67c63173668-kube-api-access-s6d6v\") pod \"maas-api-e2e-worker-w2-af788a-6c477456db-4gd68\" (UID: \"76c943ec-886f-4198-bb58-f67c63173668\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:29:25.101820 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.101635    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c943ec-886f-4198-bb58-f67c63173668-maas-api-tls\") pod \"maas-api-e2e-worker-w2-af788a-6c477456db-4gd68\" (UID: \"76c943ec-886f-4198-bb58-f67c63173668\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:29:25.101820 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.101662    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76c943ec-886f-4198-bb58-f67c63173668-metrics-certs\") pod \"maas-api-e2e-worker-w2-af788a-6c477456db-4gd68\" (UID: \"76c943ec-886f-4198-bb58-f67c63173668\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:29:25.101820 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.101729    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c943ec-886f-4198-bb58-f67c63173668-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-af788a-6c477456db-4gd68\" (UID: \"76c943ec-886f-4198-bb58-f67c63173668\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:29:25.101820 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:29:25.101793    4510 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-serving-cert: secret "maas-api-e2e-worker-w2-af788a-serving-cert" not found
Nov 04 03:29:25.102051 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:29:25.101898    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/76c943ec-886f-4198-bb58-f67c63173668-maas-api-tls podName:76c943ec-886f-4198-bb58-f67c63173668 nodeName:}" failed. No retries permitted until 2026-11-04 03:29:25.601876787 +0000 UTC m=+740.865751072 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/76c943ec-886f-4198-bb58-f67c63173668-maas-api-tls") pod "maas-api-e2e-worker-w2-af788a-6c477456db-4gd68" (UID: "76c943ec-886f-4198-bb58-f67c63173668") : secret "maas-api-e2e-worker-w2-af788a-serving-cert" not found
Nov 04 03:29:25.102473 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.102449    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c943ec-886f-4198-bb58-f67c63173668-openshift-service-ca\") pod \"maas-api-e2e-worker-w2-af788a-6c477456db-4gd68\" (UID: \"76c943ec-886f-4198-bb58-f67c63173668\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:29:25.104543 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.104518    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76c943ec-886f-4198-bb58-f67c63173668-metrics-certs\") pod \"maas-api-e2e-worker-w2-af788a-6c477456db-4gd68\" (UID: \"76c943ec-886f-4198-bb58-f67c63173668\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:29:25.173213 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.173132    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6d6v\" (UniqueName: \"kubernetes.io/projected/76c943ec-886f-4198-bb58-f67c63173668-kube-api-access-s6d6v\") pod \"maas-api-e2e-worker-w2-af788a-6c477456db-4gd68\" (UID: \"76c943ec-886f-4198-bb58-f67c63173668\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:29:25.607307 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.607273    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c943ec-886f-4198-bb58-f67c63173668-maas-api-tls\") pod \"maas-api-e2e-worker-w2-af788a-6c477456db-4gd68\" (UID: \"76c943ec-886f-4198-bb58-f67c63173668\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:29:25.609880 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.609851    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c943ec-886f-4198-bb58-f67c63173668-maas-api-tls\") pod \"maas-api-e2e-worker-w2-af788a-6c477456db-4gd68\" (UID: \"76c943ec-886f-4198-bb58-f67c63173668\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:29:25.801890 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.801851    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq"]
Nov 04 03:29:25.805493 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.805474    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq"
Nov 04 03:29:25.821898 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.821872    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:29:25.860648 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.860561    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w1-90051a\""
Nov 04 03:29:25.909407 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.909367    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/711e1966-9061-4246-951f-f99bd1963969-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq\" (UID: \"711e1966-9061-4246-951f-f99bd1963969\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq"
Nov 04 03:29:25.910004 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.909541    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfg7c\" (UniqueName: \"kubernetes.io/projected/711e1966-9061-4246-951f-f99bd1963969-kube-api-access-hfg7c\") pod \"payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq\" (UID: \"711e1966-9061-4246-951f-f99bd1963969\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq"
Nov 04 03:29:25.910489 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.910466    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w1-90051a-dockercfg-snxrv\""
Nov 04 03:29:25.913794 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:25.913769    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq"]
Nov 04 03:29:26.010284 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:26.010245    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/711e1966-9061-4246-951f-f99bd1963969-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq\" (UID: \"711e1966-9061-4246-951f-f99bd1963969\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq"
Nov 04 03:29:26.010472 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:26.010309    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfg7c\" (UniqueName: \"kubernetes.io/projected/711e1966-9061-4246-951f-f99bd1963969-kube-api-access-hfg7c\") pod \"payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq\" (UID: \"711e1966-9061-4246-951f-f99bd1963969\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq"
Nov 04 03:29:26.010980 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:26.010957    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/711e1966-9061-4246-951f-f99bd1963969-plugins-config-volume\") pod \"payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq\" (UID: \"711e1966-9061-4246-951f-f99bd1963969\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq"
Nov 04 03:29:26.071595 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:26.071563    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfg7c\" (UniqueName: \"kubernetes.io/projected/711e1966-9061-4246-951f-f99bd1963969-kube-api-access-hfg7c\") pod \"payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq\" (UID: \"711e1966-9061-4246-951f-f99bd1963969\") " pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq"
Nov 04 03:29:26.119442 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:26.119350    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq"
Nov 04 03:29:26.204609 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:26.204577    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"]
Nov 04 03:29:26.207565 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:29:26.207524    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76c943ec_886f_4198_bb58_f67c63173668.slice/crio-d7cf52737089f4bad49a1db1cdc5efc301e86a8c5a20df99b545d59b53d83d27 WatchSource:0}: Error finding container d7cf52737089f4bad49a1db1cdc5efc301e86a8c5a20df99b545d59b53d83d27: Status 404 returned error can't find the container with id d7cf52737089f4bad49a1db1cdc5efc301e86a8c5a20df99b545d59b53d83d27
Nov 04 03:29:26.496382 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:26.496352    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq"]
Nov 04 03:29:26.498772 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:29:26.498741    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod711e1966_9061_4246_951f_f99bd1963969.slice/crio-6c421a2b05d93e93126c9583f59fae775bb84c9a4d97bd9a1e0bcc4c01427812 WatchSource:0}: Error finding container 6c421a2b05d93e93126c9583f59fae775bb84c9a4d97bd9a1e0bcc4c01427812: Status 404 returned error can't find the container with id 6c421a2b05d93e93126c9583f59fae775bb84c9a4d97bd9a1e0bcc4c01427812
Nov 04 03:29:26.720124 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:26.720083    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68" event={"ID":"76c943ec-886f-4198-bb58-f67c63173668","Type":"ContainerStarted","Data":"d7cf52737089f4bad49a1db1cdc5efc301e86a8c5a20df99b545d59b53d83d27"}
Nov 04 03:29:26.721589 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:26.721567    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq" event={"ID":"711e1966-9061-4246-951f-f99bd1963969","Type":"ContainerStarted","Data":"bf6236bac59c2492b1ea9a3cbfd6279a423e0959dc56559b378b2f0d77c1903f"}
Nov 04 03:29:26.721739 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:26.721610    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq" event={"ID":"711e1966-9061-4246-951f-f99bd1963969","Type":"ContainerStarted","Data":"6c421a2b05d93e93126c9583f59fae775bb84c9a4d97bd9a1e0bcc4c01427812"}
Nov 04 03:29:26.721739 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:26.721730    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq"
Nov 04 03:29:26.839772 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:26.839642    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq" podStartSLOduration=1.839626112 podStartE2EDuration="1.839626112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:29:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:29:26.837307678 +0000 UTC m=+742.101181979" watchObservedRunningTime="2026-11-04 03:29:26.839626112 +0000 UTC m=+742.103500419"
Nov 04 03:29:27.728318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:27.728275    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68" event={"ID":"76c943ec-886f-4198-bb58-f67c63173668","Type":"ContainerStarted","Data":"3793af3dfd168ec366c470e4f73e2f489f9fa8bd10d34b5e9879754e76d45e09"}
Nov 04 03:29:27.728752 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:27.728557    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:29:27.847929 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:27.847865    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68" podStartSLOduration=3.065880376 podStartE2EDuration="3.847847159s" totalImagesPullingTime="781.966783ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:29:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:29:27.845934968 +0000 UTC m=+743.109809274" watchObservedRunningTime="2026-11-04 03:29:27.847847159 +0000 UTC m=+743.111721499"
Nov 04 03:29:30.686090 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:30.684898    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4"
Nov 04 03:29:31.688918 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:31.688885    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t"
Nov 04 03:29:32.060478 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.060440    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"]
Nov 04 03:29:32.064112 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.064087    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.117158 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.117130    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-10f834\"/\"default-dockercfg-k7tdv\""
Nov 04 03:29:32.117402 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.117260    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-10f834\"/\"simulator-w4-10f834-kserve-self-signed-certs\""
Nov 04 03:29:32.117474 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.117411    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-10f834\"/\"openshift-service-ca.crt\""
Nov 04 03:29:32.166724 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.166692    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-10f834\"/\"kube-root-ca.crt\""
Nov 04 03:29:32.169054 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.169028    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"]
Nov 04 03:29:32.169176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.169096    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-home\") pod \"simulator-w4-10f834-kserve-6bcb95d479-g8vlk\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") " pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.169176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.169137    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gs8t8\" (UniqueName: \"kubernetes.io/projected/5881ff60-a61f-416c-8034-a9991921631b-kube-api-access-gs8t8\") pod \"simulator-w4-10f834-kserve-6bcb95d479-g8vlk\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") " pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.169268 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.169171    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-model-cache\") pod \"simulator-w4-10f834-kserve-6bcb95d479-g8vlk\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") " pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.169333 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.169316    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-dshm\") pod \"simulator-w4-10f834-kserve-6bcb95d479-g8vlk\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") " pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.169368 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.169343    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-tmp-dir\") pod \"simulator-w4-10f834-kserve-6bcb95d479-g8vlk\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") " pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.169415 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.169364    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5881ff60-a61f-416c-8034-a9991921631b-tls-certs\") pod \"simulator-w4-10f834-kserve-6bcb95d479-g8vlk\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") " pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.271115 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.271073    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-home\") pod \"simulator-w4-10f834-kserve-6bcb95d479-g8vlk\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") " pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.271333 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.271125    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gs8t8\" (UniqueName: \"kubernetes.io/projected/5881ff60-a61f-416c-8034-a9991921631b-kube-api-access-gs8t8\") pod \"simulator-w4-10f834-kserve-6bcb95d479-g8vlk\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") " pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.271333 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.271163    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-model-cache\") pod \"simulator-w4-10f834-kserve-6bcb95d479-g8vlk\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") " pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.271333 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.271258    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-dshm\") pod \"simulator-w4-10f834-kserve-6bcb95d479-g8vlk\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") " pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.271333 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.271278    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-tmp-dir\") pod \"simulator-w4-10f834-kserve-6bcb95d479-g8vlk\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") " pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.271333 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.271301    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5881ff60-a61f-416c-8034-a9991921631b-tls-certs\") pod \"simulator-w4-10f834-kserve-6bcb95d479-g8vlk\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") " pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.271637 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.271606    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-home\") pod \"simulator-w4-10f834-kserve-6bcb95d479-g8vlk\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") " pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.271730 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.271628    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-model-cache\") pod \"simulator-w4-10f834-kserve-6bcb95d479-g8vlk\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") " pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.272074 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.271984    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-tmp-dir\") pod \"simulator-w4-10f834-kserve-6bcb95d479-g8vlk\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") " pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.273842 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.273811    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-dshm\") pod \"simulator-w4-10f834-kserve-6bcb95d479-g8vlk\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") " pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.274091 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.274073    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5881ff60-a61f-416c-8034-a9991921631b-tls-certs\") pod \"simulator-w4-10f834-kserve-6bcb95d479-g8vlk\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") " pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.337605 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.337515    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gs8t8\" (UniqueName: \"kubernetes.io/projected/5881ff60-a61f-416c-8034-a9991921631b-kube-api-access-gs8t8\") pod \"simulator-w4-10f834-kserve-6bcb95d479-g8vlk\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") " pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.382523 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.382481    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:32.769359 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:32.769331    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"]
Nov 04 03:29:32.771397 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:29:32.771365    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5881ff60_a61f_416c_8034_a9991921631b.slice/crio-4356e906a75b54a2d12b5183a3d75a4a3b2d7f7f1b19531cd4ab77e4c410ef78 WatchSource:0}: Error finding container 4356e906a75b54a2d12b5183a3d75a4a3b2d7f7f1b19531cd4ab77e4c410ef78: Status 404 returned error can't find the container with id 4356e906a75b54a2d12b5183a3d75a4a3b2d7f7f1b19531cd4ab77e4c410ef78
Nov 04 03:29:33.742076 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:33.742040    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:29:33.762210 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:33.762168    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk" event={"ID":"5881ff60-a61f-416c-8034-a9991921631b","Type":"ContainerStarted","Data":"4356e906a75b54a2d12b5183a3d75a4a3b2d7f7f1b19531cd4ab77e4c410ef78"}
Nov 04 03:29:34.769007 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:34.768969    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk" event={"ID":"5881ff60-a61f-416c-8034-a9991921631b","Type":"ContainerStarted","Data":"d77a76a4db5964c25e446e5fa74f9f4713d1e946242f940c1d70321c4c4b3564"}
Nov 04 03:29:34.903882 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:34.903832    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk" podStartSLOduration=1.356368695 podStartE2EDuration="2.903815699s" totalImagesPullingTime="1.547447004s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:29:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:29:34.903479403 +0000 UTC m=+750.167353710" watchObservedRunningTime="2026-11-04 03:29:34.903815699 +0000 UTC m=+750.167690005"
Nov 04 03:29:35.383413 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:35.383373    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:37.732265 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:37.732237    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq"
Nov 04 03:29:40.086348 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:40.086319    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"]
Nov 04 03:29:40.089887 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:40.089870    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:29:40.142236 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:40.142207    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-90051a-serving-cert\""
Nov 04 03:29:40.147313 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:40.147283    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37beb582-a33b-4214-a262-1f2ba08ce759-maas-api-tls\") pod \"maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n\" (UID: \"37beb582-a33b-4214-a262-1f2ba08ce759\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:29:40.147463 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:40.147341    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37beb582-a33b-4214-a262-1f2ba08ce759-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n\" (UID: \"37beb582-a33b-4214-a262-1f2ba08ce759\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:29:40.147463 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:40.147455    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37beb582-a33b-4214-a262-1f2ba08ce759-metrics-certs\") pod \"maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n\" (UID: \"37beb582-a33b-4214-a262-1f2ba08ce759\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:29:40.147605 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:40.147575    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkgff\" (UniqueName: \"kubernetes.io/projected/37beb582-a33b-4214-a262-1f2ba08ce759-kube-api-access-lkgff\") pod \"maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n\" (UID: \"37beb582-a33b-4214-a262-1f2ba08ce759\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:29:40.194306 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:40.194272    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"]
Nov 04 03:29:40.248510 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:40.248474    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkgff\" (UniqueName: \"kubernetes.io/projected/37beb582-a33b-4214-a262-1f2ba08ce759-kube-api-access-lkgff\") pod \"maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n\" (UID: \"37beb582-a33b-4214-a262-1f2ba08ce759\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:29:40.248723 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:40.248571    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37beb582-a33b-4214-a262-1f2ba08ce759-maas-api-tls\") pod \"maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n\" (UID: \"37beb582-a33b-4214-a262-1f2ba08ce759\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:29:40.248723 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:40.248605    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37beb582-a33b-4214-a262-1f2ba08ce759-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n\" (UID: \"37beb582-a33b-4214-a262-1f2ba08ce759\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:29:40.248723 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:40.248638    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37beb582-a33b-4214-a262-1f2ba08ce759-metrics-certs\") pod \"maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n\" (UID: \"37beb582-a33b-4214-a262-1f2ba08ce759\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:29:40.248904 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:29:40.248761    4510 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-serving-cert: secret "maas-api-e2e-worker-w1-90051a-serving-cert" not found
Nov 04 03:29:40.248904 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:29:40.248847    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/37beb582-a33b-4214-a262-1f2ba08ce759-maas-api-tls podName:37beb582-a33b-4214-a262-1f2ba08ce759 nodeName:}" failed. No retries permitted until 2026-11-04 03:29:40.748824388 +0000 UTC m=+756.012698694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/37beb582-a33b-4214-a262-1f2ba08ce759-maas-api-tls") pod "maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n" (UID: "37beb582-a33b-4214-a262-1f2ba08ce759") : secret "maas-api-e2e-worker-w1-90051a-serving-cert" not found
Nov 04 03:29:40.249307 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:40.249284    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37beb582-a33b-4214-a262-1f2ba08ce759-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n\" (UID: \"37beb582-a33b-4214-a262-1f2ba08ce759\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:29:40.251401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:40.251378    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37beb582-a33b-4214-a262-1f2ba08ce759-metrics-certs\") pod \"maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n\" (UID: \"37beb582-a33b-4214-a262-1f2ba08ce759\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:29:40.310582 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:40.310544    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkgff\" (UniqueName: \"kubernetes.io/projected/37beb582-a33b-4214-a262-1f2ba08ce759-kube-api-access-lkgff\") pod \"maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n\" (UID: \"37beb582-a33b-4214-a262-1f2ba08ce759\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:29:40.752979 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:40.752942    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37beb582-a33b-4214-a262-1f2ba08ce759-maas-api-tls\") pod \"maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n\" (UID: \"37beb582-a33b-4214-a262-1f2ba08ce759\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:29:40.755572 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:40.755539    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37beb582-a33b-4214-a262-1f2ba08ce759-maas-api-tls\") pod \"maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n\" (UID: \"37beb582-a33b-4214-a262-1f2ba08ce759\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:29:41.002491 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:41.002457    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:29:41.377921 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:41.377897    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"]
Nov 04 03:29:41.380024 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:29:41.379993    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37beb582_a33b_4214_a262_1f2ba08ce759.slice/crio-23dfe41cb7a7e58a3d477388114440feabaad0063259de7a1d64f45cd8469150 WatchSource:0}: Error finding container 23dfe41cb7a7e58a3d477388114440feabaad0063259de7a1d64f45cd8469150: Status 404 returned error can't find the container with id 23dfe41cb7a7e58a3d477388114440feabaad0063259de7a1d64f45cd8469150
Nov 04 03:29:41.808087 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:41.808047    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n" event={"ID":"37beb582-a33b-4214-a262-1f2ba08ce759","Type":"ContainerStarted","Data":"23dfe41cb7a7e58a3d477388114440feabaad0063259de7a1d64f45cd8469150"}
Nov 04 03:29:42.383182 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:42.383144    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:42.396124 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:42.396097    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:42.815546 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:42.815510    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n" event={"ID":"37beb582-a33b-4214-a262-1f2ba08ce759","Type":"ContainerStarted","Data":"2958fe0d3748258c8bf211328a447e5e1af231d6ed7a794038331dfdbe14c624"}
Nov 04 03:29:42.832903 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:42.832868    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:29:42.934301 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:42.934244    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n" podStartSLOduration=2.086266437 podStartE2EDuration="2.934228993s" totalImagesPullingTime="847.962556ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:29:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:29:42.932365989 +0000 UTC m=+758.196240296" watchObservedRunningTime="2026-11-04 03:29:42.934228993 +0000 UTC m=+758.198103299"
Nov 04 03:29:43.821375 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:43.821344    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:29:49.832397 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:49.832363    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:29:53.317806 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:29:53.317762    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:29:59.277846 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.277802    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"]
Nov 04 03:29:59.281551 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.281532    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.383743 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.383702    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-10f834\"/\"premium-w4-10f834-kserve-self-signed-certs\""
Nov 04 03:29:59.386162 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.386135    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"]
Nov 04 03:29:59.429131 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.429095    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfvzw\" (UniqueName: \"kubernetes.io/projected/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-kube-api-access-jfvzw\") pod \"premium-w4-10f834-kserve-c974589f4-l2sn8\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") " pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.429344 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.429302    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-model-cache\") pod \"premium-w4-10f834-kserve-c974589f4-l2sn8\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") " pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.429409 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.429347    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-tmp-dir\") pod \"premium-w4-10f834-kserve-c974589f4-l2sn8\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") " pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.429471 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.429404    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-home\") pod \"premium-w4-10f834-kserve-c974589f4-l2sn8\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") " pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.429471 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.429433    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-dshm\") pod \"premium-w4-10f834-kserve-c974589f4-l2sn8\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") " pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.429471 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.429453    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-tls-certs\") pod \"premium-w4-10f834-kserve-c974589f4-l2sn8\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") " pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.530753 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.530632    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-model-cache\") pod \"premium-w4-10f834-kserve-c974589f4-l2sn8\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") " pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.530753 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.530707    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-tmp-dir\") pod \"premium-w4-10f834-kserve-c974589f4-l2sn8\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") " pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.530753 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.530734    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-home\") pod \"premium-w4-10f834-kserve-c974589f4-l2sn8\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") " pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.530753 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.530764    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-dshm\") pod \"premium-w4-10f834-kserve-c974589f4-l2sn8\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") " pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.531076 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.530784    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-tls-certs\") pod \"premium-w4-10f834-kserve-c974589f4-l2sn8\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") " pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.531076 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.530803    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfvzw\" (UniqueName: \"kubernetes.io/projected/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-kube-api-access-jfvzw\") pod \"premium-w4-10f834-kserve-c974589f4-l2sn8\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") " pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.531176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.531120    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-model-cache\") pod \"premium-w4-10f834-kserve-c974589f4-l2sn8\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") " pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.531228 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.531175    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-tmp-dir\") pod \"premium-w4-10f834-kserve-c974589f4-l2sn8\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") " pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.531464 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.531436    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-home\") pod \"premium-w4-10f834-kserve-c974589f4-l2sn8\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") " pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.533523 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.533502    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-dshm\") pod \"premium-w4-10f834-kserve-c974589f4-l2sn8\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") " pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.533621 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.533558    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-tls-certs\") pod \"premium-w4-10f834-kserve-c974589f4-l2sn8\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") " pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.592575 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.592537    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfvzw\" (UniqueName: \"kubernetes.io/projected/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-kube-api-access-jfvzw\") pod \"premium-w4-10f834-kserve-c974589f4-l2sn8\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") " pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.592776 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.592754    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:29:59.994844 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:29:59.994822    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"]
Nov 04 03:29:59.996784 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:29:59.996755    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbbc02f97_cd51_49be_9dda_5c14d6beb6c6.slice/crio-5954538f616b8995c42e60d46f6078ea9e8d3f9102bcd62b7d433d5b7484dbab WatchSource:0}: Error finding container 5954538f616b8995c42e60d46f6078ea9e8d3f9102bcd62b7d433d5b7484dbab: Status 404 returned error can't find the container with id 5954538f616b8995c42e60d46f6078ea9e8d3f9102bcd62b7d433d5b7484dbab
Nov 04 03:30:00.199267 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:00.199226    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg"]
Nov 04 03:30:00.203016 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:00.202990    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg"
Nov 04 03:30:00.255415 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:00.255330    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-hlrnm\""
Nov 04 03:30:00.275363 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:00.275331    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg"]
Nov 04 03:30:00.339148 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:00.339113    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10f01ce0-5cb1-4f04-ac97-7de23e8f5637-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg\" (UID: \"10f01ce0-5cb1-4f04-ac97-7de23e8f5637\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg"
Nov 04 03:30:00.339668 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:00.339156    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd6mx\" (UniqueName: \"kubernetes.io/projected/10f01ce0-5cb1-4f04-ac97-7de23e8f5637-kube-api-access-qd6mx\") pod \"maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg\" (UID: \"10f01ce0-5cb1-4f04-ac97-7de23e8f5637\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg"
Nov 04 03:30:00.440579 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:00.440544    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10f01ce0-5cb1-4f04-ac97-7de23e8f5637-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg\" (UID: \"10f01ce0-5cb1-4f04-ac97-7de23e8f5637\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg"
Nov 04 03:30:00.440798 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:00.440587    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd6mx\" (UniqueName: \"kubernetes.io/projected/10f01ce0-5cb1-4f04-ac97-7de23e8f5637-kube-api-access-qd6mx\") pod \"maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg\" (UID: \"10f01ce0-5cb1-4f04-ac97-7de23e8f5637\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg"
Nov 04 03:30:00.441290 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:00.441267    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10f01ce0-5cb1-4f04-ac97-7de23e8f5637-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg\" (UID: \"10f01ce0-5cb1-4f04-ac97-7de23e8f5637\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg"
Nov 04 03:30:00.502206 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:00.502174    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd6mx\" (UniqueName: \"kubernetes.io/projected/10f01ce0-5cb1-4f04-ac97-7de23e8f5637-kube-api-access-qd6mx\") pod \"maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg\" (UID: \"10f01ce0-5cb1-4f04-ac97-7de23e8f5637\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg"
Nov 04 03:30:00.516072 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:00.515988    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg"
Nov 04 03:30:00.892219 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:00.892078    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg"]
Nov 04 03:30:00.894610 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:30:00.894583    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f01ce0_5cb1_4f04_ac97_7de23e8f5637.slice/crio-a26c31577552246d288d30e29afd9d435358efeaeb325318d1cb4b402759ca3c WatchSource:0}: Error finding container a26c31577552246d288d30e29afd9d435358efeaeb325318d1cb4b402759ca3c: Status 404 returned error can't find the container with id a26c31577552246d288d30e29afd9d435358efeaeb325318d1cb4b402759ca3c
Nov 04 03:30:00.910651 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:00.910616    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg" event={"ID":"10f01ce0-5cb1-4f04-ac97-7de23e8f5637","Type":"ContainerStarted","Data":"a26c31577552246d288d30e29afd9d435358efeaeb325318d1cb4b402759ca3c"}
Nov 04 03:30:00.912169 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:00.912140    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8" event={"ID":"bbc02f97-cd51-49be-9dda-5c14d6beb6c6","Type":"ContainerStarted","Data":"802dca74dc8d6b92d7fa155a173de3a1602759988b87be6032cac71ef8bf100b"}
Nov 04 03:30:00.912282 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:00.912182    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8" event={"ID":"bbc02f97-cd51-49be-9dda-5c14d6beb6c6","Type":"ContainerStarted","Data":"5954538f616b8995c42e60d46f6078ea9e8d3f9102bcd62b7d433d5b7484dbab"}
Nov 04 03:30:01.031092 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:01.031033    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8" podStartSLOduration=2.031019108 podStartE2EDuration="2.031019108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:29:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:30:01.029586437 +0000 UTC m=+776.293460759" watchObservedRunningTime="2026-11-04 03:30:01.031019108 +0000 UTC m=+776.294893415"
Nov 04 03:30:01.593178 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:01.593141    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:30:08.968738 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:08.968695    4510 generic.go:356] "Generic (PLEG): container finished" podID="10f01ce0-5cb1-4f04-ac97-7de23e8f5637" containerID="7e50148181ca4f4d5c357d751263f1c09798e5bf1ba777b7204aa1ba7f1b56de" exitCode=60
Nov 04 03:30:08.969271 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:08.968765    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg" event={"ID":"10f01ce0-5cb1-4f04-ac97-7de23e8f5637","Type":"ContainerDied","Data":"7e50148181ca4f4d5c357d751263f1c09798e5bf1ba777b7204aa1ba7f1b56de"}
Nov 04 03:30:08.969271 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:08.969068    4510 scope.go:122] "RemoveContainer" containerID="7e50148181ca4f4d5c357d751263f1c09798e5bf1ba777b7204aa1ba7f1b56de"
Nov 04 03:30:09.593511 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:09.593416    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:30:09.606167 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:09.606138    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:30:09.976417 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:09.976377    4510 generic.go:356] "Generic (PLEG): container finished" podID="10f01ce0-5cb1-4f04-ac97-7de23e8f5637" containerID="99b7524740b2aacfa56b99ea61f1f90287375033ce520b69eeaacd6da9a93757" exitCode=60
Nov 04 03:30:09.976906 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:09.976525    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg" event={"ID":"10f01ce0-5cb1-4f04-ac97-7de23e8f5637","Type":"ContainerDied","Data":"99b7524740b2aacfa56b99ea61f1f90287375033ce520b69eeaacd6da9a93757"}
Nov 04 03:30:09.976906 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:09.976579    4510 scope.go:122] "RemoveContainer" containerID="7e50148181ca4f4d5c357d751263f1c09798e5bf1ba777b7204aa1ba7f1b56de"
Nov 04 03:30:09.976906 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:09.976871    4510 scope.go:122] "RemoveContainer" containerID="99b7524740b2aacfa56b99ea61f1f90287375033ce520b69eeaacd6da9a93757"
Nov 04 03:30:09.977193 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:30:09.977166    4510 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg_odh-ai-gateway-infra(10f01ce0-5cb1-4f04-ac97-7de23e8f5637)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg" podUID="10f01ce0-5cb1-4f04-ac97-7de23e8f5637"
Nov 04 03:30:09.989302 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:09.989275    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:30:10.984561 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:10.984535    4510 scope.go:122] "RemoveContainer" containerID="99b7524740b2aacfa56b99ea61f1f90287375033ce520b69eeaacd6da9a93757"
Nov 04 03:30:10.984976 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:30:10.984807    4510 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg_odh-ai-gateway-infra(10f01ce0-5cb1-4f04-ac97-7de23e8f5637)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg" podUID="10f01ce0-5cb1-4f04-ac97-7de23e8f5637"
Nov 04 03:30:22.856397 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:22.856369    4510 scope.go:122] "RemoveContainer" containerID="99b7524740b2aacfa56b99ea61f1f90287375033ce520b69eeaacd6da9a93757"
Nov 04 03:30:23.317321 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:30:23.317286    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:30:24.057349 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.057249    4510 generic.go:356] "Generic (PLEG): container finished" podID="10f01ce0-5cb1-4f04-ac97-7de23e8f5637" containerID="6e3896455c295ce81f0f1111508544462cdfcb81657dd57b039fc4b1fff0cae2" exitCode=60
Nov 04 03:30:24.057349 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.057325    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg" event={"ID":"10f01ce0-5cb1-4f04-ac97-7de23e8f5637","Type":"ContainerDied","Data":"6e3896455c295ce81f0f1111508544462cdfcb81657dd57b039fc4b1fff0cae2"}
Nov 04 03:30:24.057919 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.057388    4510 scope.go:122] "RemoveContainer" containerID="99b7524740b2aacfa56b99ea61f1f90287375033ce520b69eeaacd6da9a93757"
Nov 04 03:30:24.057919 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.057798    4510 scope.go:122] "RemoveContainer" containerID="6e3896455c295ce81f0f1111508544462cdfcb81657dd57b039fc4b1fff0cae2"
Nov 04 03:30:24.058095 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:30:24.058073    4510 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg_odh-ai-gateway-infra(10f01ce0-5cb1-4f04-ac97-7de23e8f5637)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg" podUID="10f01ce0-5cb1-4f04-ac97-7de23e8f5637"
Nov 04 03:30:24.790194 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.790160    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"]
Nov 04 03:30:24.794896 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.794870    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:24.849517 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.849459    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-c5bec0\"/\"kube-root-ca.crt\""
Nov 04 03:30:24.860490 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.860455    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-model-cache\") pod \"simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") " pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:24.860663 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.860512    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-tmp-dir\") pod \"simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") " pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:24.860663 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.860603    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm87v\" (UniqueName: \"kubernetes.io/projected/207320d1-fa2f-4204-805a-ec84fec16b89-kube-api-access-sm87v\") pod \"simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") " pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:24.860663 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.860634    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-dshm\") pod \"simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") " pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:24.860847 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.860663    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/207320d1-fa2f-4204-805a-ec84fec16b89-tls-certs\") pod \"simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") " pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:24.860909 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.860847    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-home\") pod \"simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") " pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:24.899217 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.899176    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-c5bec0\"/\"openshift-service-ca.crt\""
Nov 04 03:30:24.899730 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.899708    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-c5bec0\"/\"default-dockercfg-s2smx\""
Nov 04 03:30:24.899730 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.899709    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-c5bec0\"/\"simulator-w3-c5bec0-kserve-self-signed-certs\""
Nov 04 03:30:24.902412 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.902388    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"]
Nov 04 03:30:24.961898 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.961861    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-model-cache\") pod \"simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") " pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:24.962096 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.961911    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-tmp-dir\") pod \"simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") " pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:24.962096 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.961937    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm87v\" (UniqueName: \"kubernetes.io/projected/207320d1-fa2f-4204-805a-ec84fec16b89-kube-api-access-sm87v\") pod \"simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") " pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:24.962096 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.961955    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-dshm\") pod \"simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") " pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:24.962096 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.961979    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/207320d1-fa2f-4204-805a-ec84fec16b89-tls-certs\") pod \"simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") " pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:24.962096 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.962002    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-home\") pod \"simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") " pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:24.962363 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.962342    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-model-cache\") pod \"simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") " pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:24.962363 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.962353    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-tmp-dir\") pod \"simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") " pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:24.962476 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.962453    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-home\") pod \"simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") " pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:24.964430 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.964404    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-dshm\") pod \"simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") " pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:24.964660 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:24.964631    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/207320d1-fa2f-4204-805a-ec84fec16b89-tls-certs\") pod \"simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") " pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:25.023477 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:25.023437    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm87v\" (UniqueName: \"kubernetes.io/projected/207320d1-fa2f-4204-805a-ec84fec16b89-kube-api-access-sm87v\") pod \"simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") " pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:25.111503 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:25.111393    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:25.186014 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:25.185979    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg"]
Nov 04 03:30:25.324043 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:25.324013    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg"
Nov 04 03:30:25.365997 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:25.365896    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/10f01ce0-5cb1-4f04-ac97-7de23e8f5637-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10f01ce0-5cb1-4f04-ac97-7de23e8f5637-maas-api-service-ca\") pod \"10f01ce0-5cb1-4f04-ac97-7de23e8f5637\" (UID: \"10f01ce0-5cb1-4f04-ac97-7de23e8f5637\") "
Nov 04 03:30:25.365997 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:25.365946    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/10f01ce0-5cb1-4f04-ac97-7de23e8f5637-kube-api-access-qd6mx\" (UniqueName: \"kubernetes.io/projected/10f01ce0-5cb1-4f04-ac97-7de23e8f5637-kube-api-access-qd6mx\") pod \"10f01ce0-5cb1-4f04-ac97-7de23e8f5637\" (UID: \"10f01ce0-5cb1-4f04-ac97-7de23e8f5637\") "
Nov 04 03:30:25.366348 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:25.366320    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10f01ce0-5cb1-4f04-ac97-7de23e8f5637-maas-api-service-ca" pod "10f01ce0-5cb1-4f04-ac97-7de23e8f5637" (UID: "10f01ce0-5cb1-4f04-ac97-7de23e8f5637"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:30:25.368316 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:25.368292    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10f01ce0-5cb1-4f04-ac97-7de23e8f5637-kube-api-access-qd6mx" pod "10f01ce0-5cb1-4f04-ac97-7de23e8f5637" (UID: "10f01ce0-5cb1-4f04-ac97-7de23e8f5637"). InnerVolumeSpecName "kube-api-access-qd6mx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:30:25.467527 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:25.467482    4510 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/10f01ce0-5cb1-4f04-ac97-7de23e8f5637-maas-api-service-ca\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:30:25.467527 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:25.467512    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qd6mx\" (UniqueName: \"kubernetes.io/projected/10f01ce0-5cb1-4f04-ac97-7de23e8f5637-kube-api-access-qd6mx\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:30:25.506213 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:25.506187    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"]
Nov 04 03:30:25.507665 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:30:25.507644    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod207320d1_fa2f_4204_805a_ec84fec16b89.slice/crio-70f80fbd57ae23ffef79d2bab63939ec698295d3ae6a4de464aec0382f79d752 WatchSource:0}: Error finding container 70f80fbd57ae23ffef79d2bab63939ec698295d3ae6a4de464aec0382f79d752: Status 404 returned error can't find the container with id 70f80fbd57ae23ffef79d2bab63939ec698295d3ae6a4de464aec0382f79d752
Nov 04 03:30:26.073156 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:26.073102    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r" event={"ID":"207320d1-fa2f-4204-805a-ec84fec16b89","Type":"ContainerStarted","Data":"e9e5b868b58f59ca3f18dba43fcca7798fbb024285d5c6168a0bb29f6a646bd6"}
Nov 04 03:30:26.073376 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:26.073174    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r" event={"ID":"207320d1-fa2f-4204-805a-ec84fec16b89","Type":"ContainerStarted","Data":"70f80fbd57ae23ffef79d2bab63939ec698295d3ae6a4de464aec0382f79d752"}
Nov 04 03:30:26.074901 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:26.074867    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg" event={"ID":"10f01ce0-5cb1-4f04-ac97-7de23e8f5637","Type":"ContainerDied","Data":"a26c31577552246d288d30e29afd9d435358efeaeb325318d1cb4b402759ca3c"}
Nov 04 03:30:26.075028 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:26.074922    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg"
Nov 04 03:30:26.075028 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:26.074940    4510 scope.go:122] "RemoveContainer" containerID="6e3896455c295ce81f0f1111508544462cdfcb81657dd57b039fc4b1fff0cae2"
Nov 04 03:30:26.112017 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:26.111982    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:26.192889 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:26.192829    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r" podStartSLOduration=2.19281186 podStartE2EDuration="2.19281186s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:30:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:30:26.192148725 +0000 UTC m=+801.456023027" watchObservedRunningTime="2026-11-04 03:30:26.19281186 +0000 UTC m=+801.456686167"
Nov 04 03:30:26.310580 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:26.310479    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg"]
Nov 04 03:30:26.315172 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:26.315134    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-af788a-29896050-4wsfg"]
Nov 04 03:30:26.862514 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:26.862478    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="10f01ce0-5cb1-4f04-ac97-7de23e8f5637" path="/var/lib/kubelet/pods/10f01ce0-5cb1-4f04-ac97-7de23e8f5637/volumes"
Nov 04 03:30:35.111890 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:35.111850    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:35.124899 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:35.124858    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:35.140537 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:35.140504    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:30:37.786007 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.785971    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"]
Nov 04 03:30:37.786412 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.786358    4510 cpu_manager.go:414] "containerMap: removing container" podUID="10f01ce0-5cb1-4f04-ac97-7de23e8f5637" containerName="cleanup"
Nov 04 03:30:37.786412 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.786368    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="10f01ce0-5cb1-4f04-ac97-7de23e8f5637" containerName="cleanup"
Nov 04 03:30:37.786412 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.786383    4510 cpu_manager.go:414] "containerMap: removing container" podUID="10f01ce0-5cb1-4f04-ac97-7de23e8f5637" containerName="cleanup"
Nov 04 03:30:37.786412 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.786389    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="10f01ce0-5cb1-4f04-ac97-7de23e8f5637" containerName="cleanup"
Nov 04 03:30:37.786412 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.786401    4510 cpu_manager.go:414] "containerMap: removing container" podUID="10f01ce0-5cb1-4f04-ac97-7de23e8f5637" containerName="cleanup"
Nov 04 03:30:37.786412 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.786406    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="10f01ce0-5cb1-4f04-ac97-7de23e8f5637" containerName="cleanup"
Nov 04 03:30:37.786600 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.786469    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="10f01ce0-5cb1-4f04-ac97-7de23e8f5637" containerName="cleanup"
Nov 04 03:30:37.786600 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.786478    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="10f01ce0-5cb1-4f04-ac97-7de23e8f5637" containerName="cleanup"
Nov 04 03:30:37.786600 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.786486    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="10f01ce0-5cb1-4f04-ac97-7de23e8f5637" containerName="cleanup"
Nov 04 03:30:37.790830 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.790806    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:37.850284 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.850250    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"]
Nov 04 03:30:37.891562 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.891520    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d55jb\" (UniqueName: \"kubernetes.io/projected/0431ba98-4ab2-4820-867c-fead8f7f5fc9-kube-api-access-d55jb\") pod \"simulator-w0-36ccd3-kserve-5554887bb9-mv4mk\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") " pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:37.891783 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.891577    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-home\") pod \"simulator-w0-36ccd3-kserve-5554887bb9-mv4mk\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") " pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:37.891783 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.891652    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-tmp-dir\") pod \"simulator-w0-36ccd3-kserve-5554887bb9-mv4mk\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") " pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:37.891783 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.891708    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0431ba98-4ab2-4820-867c-fead8f7f5fc9-tls-certs\") pod \"simulator-w0-36ccd3-kserve-5554887bb9-mv4mk\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") " pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:37.891974 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.891822    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-model-cache\") pod \"simulator-w0-36ccd3-kserve-5554887bb9-mv4mk\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") " pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:37.891974 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.891869    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-dshm\") pod \"simulator-w0-36ccd3-kserve-5554887bb9-mv4mk\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") " pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:37.896209 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.896171    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-36ccd3\"/\"simulator-w0-36ccd3-kserve-self-signed-certs\""
Nov 04 03:30:37.896209 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.896181    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-36ccd3\"/\"openshift-service-ca.crt\""
Nov 04 03:30:37.896382 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.896250    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-36ccd3\"/\"kube-root-ca.crt\""
Nov 04 03:30:37.896382 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.896321    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-36ccd3\"/\"default-dockercfg-t28c2\""
Nov 04 03:30:37.993112 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.993082    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-model-cache\") pod \"simulator-w0-36ccd3-kserve-5554887bb9-mv4mk\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") " pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:37.993315 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.993120    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-dshm\") pod \"simulator-w0-36ccd3-kserve-5554887bb9-mv4mk\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") " pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:37.993315 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.993159    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d55jb\" (UniqueName: \"kubernetes.io/projected/0431ba98-4ab2-4820-867c-fead8f7f5fc9-kube-api-access-d55jb\") pod \"simulator-w0-36ccd3-kserve-5554887bb9-mv4mk\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") " pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:37.993315 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.993194    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-home\") pod \"simulator-w0-36ccd3-kserve-5554887bb9-mv4mk\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") " pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:37.993315 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.993214    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-tmp-dir\") pod \"simulator-w0-36ccd3-kserve-5554887bb9-mv4mk\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") " pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:37.993315 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.993291    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0431ba98-4ab2-4820-867c-fead8f7f5fc9-tls-certs\") pod \"simulator-w0-36ccd3-kserve-5554887bb9-mv4mk\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") " pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:37.993588 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.993521    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-model-cache\") pod \"simulator-w0-36ccd3-kserve-5554887bb9-mv4mk\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") " pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:37.993588 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.993555    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-home\") pod \"simulator-w0-36ccd3-kserve-5554887bb9-mv4mk\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") " pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:37.993908 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.993853    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-tmp-dir\") pod \"simulator-w0-36ccd3-kserve-5554887bb9-mv4mk\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") " pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:37.996060 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.996033    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-dshm\") pod \"simulator-w0-36ccd3-kserve-5554887bb9-mv4mk\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") " pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:37.996564 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:37.996542    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0431ba98-4ab2-4820-867c-fead8f7f5fc9-tls-certs\") pod \"simulator-w0-36ccd3-kserve-5554887bb9-mv4mk\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") " pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:38.055950 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:38.055865    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d55jb\" (UniqueName: \"kubernetes.io/projected/0431ba98-4ab2-4820-867c-fead8f7f5fc9-kube-api-access-d55jb\") pod \"simulator-w0-36ccd3-kserve-5554887bb9-mv4mk\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") " pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:38.104035 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:38.103986    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:38.490376 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:38.490346    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"]
Nov 04 03:30:38.492487 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:30:38.492453    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0431ba98_4ab2_4820_867c_fead8f7f5fc9.slice/crio-ed52a2747b8e3a23e1724cc72b95694b1ce2227f5894556fe3f83065b66d6b8e WatchSource:0}: Error finding container ed52a2747b8e3a23e1724cc72b95694b1ce2227f5894556fe3f83065b66d6b8e: Status 404 returned error can't find the container with id ed52a2747b8e3a23e1724cc72b95694b1ce2227f5894556fe3f83065b66d6b8e
Nov 04 03:30:39.155450 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:39.155408    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk" event={"ID":"0431ba98-4ab2-4820-867c-fead8f7f5fc9","Type":"ContainerStarted","Data":"e387c29825f8abbab63446ae1bc5767d434748f23d8edead0dfa3b9a76a76b76"}
Nov 04 03:30:39.155450 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:39.155455    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk" event={"ID":"0431ba98-4ab2-4820-867c-fead8f7f5fc9","Type":"ContainerStarted","Data":"ed52a2747b8e3a23e1724cc72b95694b1ce2227f5894556fe3f83065b66d6b8e"}
Nov 04 03:30:39.272643 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:39.272588    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk" podStartSLOduration=2.272574081 podStartE2EDuration="2.272574081s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:30:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:30:39.272020506 +0000 UTC m=+814.535894810" watchObservedRunningTime="2026-11-04 03:30:39.272574081 +0000 UTC m=+814.536448387"
Nov 04 03:30:40.104101 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:40.104072    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:48.104514 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:48.104452    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:48.122343 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:48.122318    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:48.214415 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:30:48.214385    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:30:53.317220 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:30:53.317173    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:31:17.065888 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.065798    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"]
Nov 04 03:31:17.070772 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.070751    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.174819 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.174791    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-c5bec0\"/\"premium-w3-c5bec0-kserve-self-signed-certs\""
Nov 04 03:31:17.177294 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.177260    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"]
Nov 04 03:31:17.184293 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.184263    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dbq5\" (UniqueName: \"kubernetes.io/projected/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-kube-api-access-6dbq5\") pod \"premium-w3-c5bec0-kserve-7c4d8558d5-t428f\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") " pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.184415 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.184313    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-dshm\") pod \"premium-w3-c5bec0-kserve-7c4d8558d5-t428f\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") " pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.184492 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.184414    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-tmp-dir\") pod \"premium-w3-c5bec0-kserve-7c4d8558d5-t428f\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") " pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.184492 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.184450    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-tls-certs\") pod \"premium-w3-c5bec0-kserve-7c4d8558d5-t428f\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") " pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.184608 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.184555    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-model-cache\") pod \"premium-w3-c5bec0-kserve-7c4d8558d5-t428f\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") " pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.184661 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.184606    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-home\") pod \"premium-w3-c5bec0-kserve-7c4d8558d5-t428f\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") " pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.286120 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.286087    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dbq5\" (UniqueName: \"kubernetes.io/projected/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-kube-api-access-6dbq5\") pod \"premium-w3-c5bec0-kserve-7c4d8558d5-t428f\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") " pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.286311 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.286139    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-dshm\") pod \"premium-w3-c5bec0-kserve-7c4d8558d5-t428f\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") " pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.286357 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.286317    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-tmp-dir\") pod \"premium-w3-c5bec0-kserve-7c4d8558d5-t428f\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") " pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.286393 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.286358    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-tls-certs\") pod \"premium-w3-c5bec0-kserve-7c4d8558d5-t428f\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") " pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.286445 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.286399    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-model-cache\") pod \"premium-w3-c5bec0-kserve-7c4d8558d5-t428f\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") " pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.286497 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.286451    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-home\") pod \"premium-w3-c5bec0-kserve-7c4d8558d5-t428f\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") " pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.286822 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.286794    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-tmp-dir\") pod \"premium-w3-c5bec0-kserve-7c4d8558d5-t428f\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") " pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.286822 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.286814    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-model-cache\") pod \"premium-w3-c5bec0-kserve-7c4d8558d5-t428f\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") " pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.286990 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.286873    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-home\") pod \"premium-w3-c5bec0-kserve-7c4d8558d5-t428f\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") " pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.288620 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.288595    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-dshm\") pod \"premium-w3-c5bec0-kserve-7c4d8558d5-t428f\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") " pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.288997 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.288976    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-tls-certs\") pod \"premium-w3-c5bec0-kserve-7c4d8558d5-t428f\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") " pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.347813 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.347732    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dbq5\" (UniqueName: \"kubernetes.io/projected/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-kube-api-access-6dbq5\") pod \"premium-w3-c5bec0-kserve-7c4d8558d5-t428f\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") " pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.404578 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.404539    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:17.801016 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:17.800986    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"]
Nov 04 03:31:17.803034 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:31:17.802996    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddd9ea1b1_0b00_4c30_a4d5_e2de30e12496.slice/crio-c34f374a0118e9a9ef23aef45291ea09ea3f9a143908f6fad1e5d64f1297222a WatchSource:0}: Error finding container c34f374a0118e9a9ef23aef45291ea09ea3f9a143908f6fad1e5d64f1297222a: Status 404 returned error can't find the container with id c34f374a0118e9a9ef23aef45291ea09ea3f9a143908f6fad1e5d64f1297222a
Nov 04 03:31:18.384425 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:18.384390    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f" event={"ID":"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496","Type":"ContainerStarted","Data":"9b7b949dd094a49d43922345fc17873f359130750889c78260bbc1339deb4d0c"}
Nov 04 03:31:18.384888 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:18.384439    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f" event={"ID":"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496","Type":"ContainerStarted","Data":"c34f374a0118e9a9ef23aef45291ea09ea3f9a143908f6fad1e5d64f1297222a"}
Nov 04 03:31:18.404844 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:18.404814    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:18.504054 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:18.503994    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f" podStartSLOduration=1.503981124 podStartE2EDuration="1.503981124s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:31:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:31:18.500780237 +0000 UTC m=+853.764654542" watchObservedRunningTime="2026-11-04 03:31:18.503981124 +0000 UTC m=+853.767855431"
Nov 04 03:31:23.317466 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:31:23.317432    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:31:27.405531 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:27.405491    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:27.419088 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:27.419058    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:27.450263 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:31:27.450235    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:31:53.318498 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:31:53.318453    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:32:23.319639 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:32:23.319587    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:32:53.316333 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:32:53.316299    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:33:23.316412 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:33:23.316375    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:33:42.200377 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.200341    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"]
Nov 04 03:33:42.203924 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.203891    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.274887 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.274858    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-36ccd3\"/\"distinct-w0-36ccd3-kserve-self-signed-certs\""
Nov 04 03:33:42.308309 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.308277    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddh8c\" (UniqueName: \"kubernetes.io/projected/b9de2297-f797-4439-9e0e-2f5555ef676d-kube-api-access-ddh8c\") pod \"distinct-w0-36ccd3-kserve-85795c66ff-xdbsc\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") " pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.308486 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.308321    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9de2297-f797-4439-9e0e-2f5555ef676d-tls-certs\") pod \"distinct-w0-36ccd3-kserve-85795c66ff-xdbsc\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") " pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.308486 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.308414    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-dshm\") pod \"distinct-w0-36ccd3-kserve-85795c66ff-xdbsc\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") " pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.308486 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.308463    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-home\") pod \"distinct-w0-36ccd3-kserve-85795c66ff-xdbsc\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") " pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.308605 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.308559    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-tmp-dir\") pod \"distinct-w0-36ccd3-kserve-85795c66ff-xdbsc\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") " pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.308649 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.308604    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-model-cache\") pod \"distinct-w0-36ccd3-kserve-85795c66ff-xdbsc\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") " pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.313135 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.313109    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"]
Nov 04 03:33:42.409258 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.409193    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-tmp-dir\") pod \"distinct-w0-36ccd3-kserve-85795c66ff-xdbsc\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") " pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.409435 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.409296    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-model-cache\") pod \"distinct-w0-36ccd3-kserve-85795c66ff-xdbsc\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") " pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.409435 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.409341    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddh8c\" (UniqueName: \"kubernetes.io/projected/b9de2297-f797-4439-9e0e-2f5555ef676d-kube-api-access-ddh8c\") pod \"distinct-w0-36ccd3-kserve-85795c66ff-xdbsc\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") " pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.409435 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.409386    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9de2297-f797-4439-9e0e-2f5555ef676d-tls-certs\") pod \"distinct-w0-36ccd3-kserve-85795c66ff-xdbsc\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") " pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.409435 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.409426    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-dshm\") pod \"distinct-w0-36ccd3-kserve-85795c66ff-xdbsc\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") " pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.409665 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.409497    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-home\") pod \"distinct-w0-36ccd3-kserve-85795c66ff-xdbsc\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") " pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.409755 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.409674    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-tmp-dir\") pod \"distinct-w0-36ccd3-kserve-85795c66ff-xdbsc\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") " pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.410017 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.409996    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-model-cache\") pod \"distinct-w0-36ccd3-kserve-85795c66ff-xdbsc\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") " pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.410160 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.410139    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-home\") pod \"distinct-w0-36ccd3-kserve-85795c66ff-xdbsc\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") " pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.412481 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.412453    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-dshm\") pod \"distinct-w0-36ccd3-kserve-85795c66ff-xdbsc\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") " pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.412977 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.412957    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9de2297-f797-4439-9e0e-2f5555ef676d-tls-certs\") pod \"distinct-w0-36ccd3-kserve-85795c66ff-xdbsc\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") " pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.472740 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.472710    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddh8c\" (UniqueName: \"kubernetes.io/projected/b9de2297-f797-4439-9e0e-2f5555ef676d-kube-api-access-ddh8c\") pod \"distinct-w0-36ccd3-kserve-85795c66ff-xdbsc\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") " pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.515160 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.515130    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:42.910500 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:42.910471    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"]
Nov 04 03:33:42.911978 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:33:42.911952    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb9de2297_f797_4439_9e0e_2f5555ef676d.slice/crio-746179791ed39f958bc2fcbebaffda4840ee868a90b0369912d2944420f57813 WatchSource:0}: Error finding container 746179791ed39f958bc2fcbebaffda4840ee868a90b0369912d2944420f57813: Status 404 returned error can't find the container with id 746179791ed39f958bc2fcbebaffda4840ee868a90b0369912d2944420f57813
Nov 04 03:33:43.190735 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:43.190632    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc" event={"ID":"b9de2297-f797-4439-9e0e-2f5555ef676d","Type":"ContainerStarted","Data":"f32b9d6f815a374fde42fc4ef853872925855cc54a85d1c4d791c7d419ee2353"}
Nov 04 03:33:43.190735 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:43.190676    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc" event={"ID":"b9de2297-f797-4439-9e0e-2f5555ef676d","Type":"ContainerStarted","Data":"746179791ed39f958bc2fcbebaffda4840ee868a90b0369912d2944420f57813"}
Nov 04 03:33:43.308324 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:43.308248    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc" podStartSLOduration=1.308232657 podStartE2EDuration="1.308232657s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:33:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:33:43.307359428 +0000 UTC m=+998.571233734" watchObservedRunningTime="2026-11-04 03:33:43.308232657 +0000 UTC m=+998.572106963"
Nov 04 03:33:43.515477 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:43.515434    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:52.515807 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:52.515775    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:52.528520 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:52.528491    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:53.263162 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:33:53.263130    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:33:53.317281 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:33:53.317251    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:34:02.351894 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.351858    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"]
Nov 04 03:34:02.355617 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.355595    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.379137 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.379112    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7e091e0-5112-49c2-8801-d0c6a46e8e01-tls-certs\") pod \"distinct-w2-af788a-kserve-5cddc85cbd-6bcrq\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.379257 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.379144    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-home\") pod \"distinct-w2-af788a-kserve-5cddc85cbd-6bcrq\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.379257 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.379238    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-model-cache\") pod \"distinct-w2-af788a-kserve-5cddc85cbd-6bcrq\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.379396 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.379376    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-tmp-dir\") pod \"distinct-w2-af788a-kserve-5cddc85cbd-6bcrq\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.379457 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.379432    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4mqd\" (UniqueName: \"kubernetes.io/projected/b7e091e0-5112-49c2-8801-d0c6a46e8e01-kube-api-access-w4mqd\") pod \"distinct-w2-af788a-kserve-5cddc85cbd-6bcrq\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.379511 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.379476    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-dshm\") pod \"distinct-w2-af788a-kserve-5cddc85cbd-6bcrq\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.460847 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.460800    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-af788a\"/\"openshift-service-ca.crt\""
Nov 04 03:34:02.460847 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.460835    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-af788a\"/\"default-dockercfg-22bhm\""
Nov 04 03:34:02.461103 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.460897    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-af788a\"/\"kube-root-ca.crt\""
Nov 04 03:34:02.461103 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.460984    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-af788a\"/\"distinct-w2-af788a-kserve-self-signed-certs\""
Nov 04 03:34:02.463309 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.463291    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"]
Nov 04 03:34:02.480246 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.480220    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4mqd\" (UniqueName: \"kubernetes.io/projected/b7e091e0-5112-49c2-8801-d0c6a46e8e01-kube-api-access-w4mqd\") pod \"distinct-w2-af788a-kserve-5cddc85cbd-6bcrq\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.480375 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.480259    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-dshm\") pod \"distinct-w2-af788a-kserve-5cddc85cbd-6bcrq\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.480375 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.480334    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7e091e0-5112-49c2-8801-d0c6a46e8e01-tls-certs\") pod \"distinct-w2-af788a-kserve-5cddc85cbd-6bcrq\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.480375 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.480357    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-home\") pod \"distinct-w2-af788a-kserve-5cddc85cbd-6bcrq\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.480519 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.480393    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-model-cache\") pod \"distinct-w2-af788a-kserve-5cddc85cbd-6bcrq\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.480519 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.480463    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-tmp-dir\") pod \"distinct-w2-af788a-kserve-5cddc85cbd-6bcrq\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.480834 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.480814    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-home\") pod \"distinct-w2-af788a-kserve-5cddc85cbd-6bcrq\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.480944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.480857    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-model-cache\") pod \"distinct-w2-af788a-kserve-5cddc85cbd-6bcrq\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.480944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.480867    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-tmp-dir\") pod \"distinct-w2-af788a-kserve-5cddc85cbd-6bcrq\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.482823 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.482804    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-dshm\") pod \"distinct-w2-af788a-kserve-5cddc85cbd-6bcrq\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.483066 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.483050    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7e091e0-5112-49c2-8801-d0c6a46e8e01-tls-certs\") pod \"distinct-w2-af788a-kserve-5cddc85cbd-6bcrq\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.541389 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.541351    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4mqd\" (UniqueName: \"kubernetes.io/projected/b7e091e0-5112-49c2-8801-d0c6a46e8e01-kube-api-access-w4mqd\") pod \"distinct-w2-af788a-kserve-5cddc85cbd-6bcrq\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:02.667763 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:02.667564    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:03.069176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:03.069155    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"]
Nov 04 03:34:03.070905 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:34:03.070877    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7e091e0_5112_49c2_8801_d0c6a46e8e01.slice/crio-53374e23df8c277c168fc8a66f68201c97e8ced61f779474df1f1a2b3333582c WatchSource:0}: Error finding container 53374e23df8c277c168fc8a66f68201c97e8ced61f779474df1f1a2b3333582c: Status 404 returned error can't find the container with id 53374e23df8c277c168fc8a66f68201c97e8ced61f779474df1f1a2b3333582c
Nov 04 03:34:03.315702 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:03.315658    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq" event={"ID":"b7e091e0-5112-49c2-8801-d0c6a46e8e01","Type":"ContainerStarted","Data":"106675e774a7b40b2354b3ac1122b099394f7ffa29525cacdd290a3331cc1ac6"}
Nov 04 03:34:03.315895 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:03.315723    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq" event={"ID":"b7e091e0-5112-49c2-8801-d0c6a46e8e01","Type":"ContainerStarted","Data":"53374e23df8c277c168fc8a66f68201c97e8ced61f779474df1f1a2b3333582c"}
Nov 04 03:34:03.433431 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:03.433321    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq" podStartSLOduration=1.433302531 podStartE2EDuration="1.433302531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:34:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:34:03.432264465 +0000 UTC m=+1018.696138772" watchObservedRunningTime="2026-11-04 03:34:03.433302531 +0000 UTC m=+1018.697176838"
Nov 04 03:34:03.668455 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:03.668422    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:12.668736 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:12.668703    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:12.681330 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:12.681307    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:13.380599 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:13.380567    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:34:23.134464 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.134359    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"]
Nov 04 03:34:23.138186 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.138161    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.213110 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.213078    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"]
Nov 04 03:34:23.243004 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.242968    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-c5bec0\"/\"distinct-2-w3-c5bec0-kserve-self-signed-certs\""
Nov 04 03:34:23.289862 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.289825    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-dshm\") pod \"distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") " pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.290051 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.289891    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5gmn\" (UniqueName: \"kubernetes.io/projected/ba15e83e-3b7c-4f87-9513-dad698c4147b-kube-api-access-m5gmn\") pod \"distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") " pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.290111 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.290068    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-tmp-dir\") pod \"distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") " pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.290199 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.290178    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-model-cache\") pod \"distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") " pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.290246 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.290220    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-home\") pod \"distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") " pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.290291 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.290263    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba15e83e-3b7c-4f87-9513-dad698c4147b-tls-certs\") pod \"distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") " pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.317942 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:34:23.317906    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:34:23.390825 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.390738    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-home\") pod \"distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") " pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.390825 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.390783    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba15e83e-3b7c-4f87-9513-dad698c4147b-tls-certs\") pod \"distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") " pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.391047 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.390904    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-dshm\") pod \"distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") " pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.391047 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.390956    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5gmn\" (UniqueName: \"kubernetes.io/projected/ba15e83e-3b7c-4f87-9513-dad698c4147b-kube-api-access-m5gmn\") pod \"distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") " pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.391047 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.391024    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-tmp-dir\") pod \"distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") " pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.391209 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.391123    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-model-cache\") pod \"distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") " pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.391275 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.391218    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-home\") pod \"distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") " pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.391398 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.391372    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-tmp-dir\") pod \"distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") " pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.391487 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.391443    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-model-cache\") pod \"distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") " pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.393486 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.393465    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-dshm\") pod \"distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") " pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.394107 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.394075    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba15e83e-3b7c-4f87-9513-dad698c4147b-tls-certs\") pod \"distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") " pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.452663 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.452623    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5gmn\" (UniqueName: \"kubernetes.io/projected/ba15e83e-3b7c-4f87-9513-dad698c4147b-kube-api-access-m5gmn\") pod \"distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") " pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:23.756739 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:23.756671    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:24.136655 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:24.136577    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"]
Nov 04 03:34:24.140062 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:34:24.140032    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podba15e83e_3b7c_4f87_9513_dad698c4147b.slice/crio-57bd774d103b26d25575224d8477aa3ebb9e3acaa6029df52983b0407b97a2f2 WatchSource:0}: Error finding container 57bd774d103b26d25575224d8477aa3ebb9e3acaa6029df52983b0407b97a2f2: Status 404 returned error can't find the container with id 57bd774d103b26d25575224d8477aa3ebb9e3acaa6029df52983b0407b97a2f2
Nov 04 03:34:24.435446 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:24.435362    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs" event={"ID":"ba15e83e-3b7c-4f87-9513-dad698c4147b","Type":"ContainerStarted","Data":"146f83caa1e9b7a310c6008c676596348bba781354b664c6a67d9b6362b98452"}
Nov 04 03:34:24.435446 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:24.435403    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs" event={"ID":"ba15e83e-3b7c-4f87-9513-dad698c4147b","Type":"ContainerStarted","Data":"57bd774d103b26d25575224d8477aa3ebb9e3acaa6029df52983b0407b97a2f2"}
Nov 04 03:34:24.553642 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:24.553584    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs" podStartSLOduration=1.553567556 podStartE2EDuration="1.553567556s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:34:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:34:24.5507754 +0000 UTC m=+1039.814649707" watchObservedRunningTime="2026-11-04 03:34:24.553567556 +0000 UTC m=+1039.817442139"
Nov 04 03:34:24.757012 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:24.756982    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:33.757860 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:33.757822    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:33.770266 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:33.770238    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:34.501359 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:34.501325    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:34:52.080957 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:52.080924    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"]
Nov 04 03:34:52.081356 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:52.081173    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx" podUID="9cc4707c-e267-440a-8e5a-e8acbe2f14b9" containerName="istio-proxy" containerID="cri-o://fb8400813a82b48309870bbf70f0ac731b4a6916f532ff42933fe0ce8fee82b1" gracePeriod=30
Nov 04 03:34:53.317421 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:34:53.317362    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:34:57.350783 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.350713    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:34:57.448211 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.448165    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-credential-socket\") pod \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") "
Nov 04 03:34:57.448403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.448270    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-token\" (UniqueName: \"kubernetes.io/projected/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-token\") pod \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") "
Nov 04 03:34:57.448403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.448369    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-podinfo\") pod \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") "
Nov 04 03:34:57.448523 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.448413    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-workload-socket\") pod \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") "
Nov 04 03:34:57.448523 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.448466    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istiod-ca-cert\") pod \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") "
Nov 04 03:34:57.448523 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.448502    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-data\") pod \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") "
Nov 04 03:34:57.448704 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.448538    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-kube-api-access-wbs28\" (UniqueName: \"kubernetes.io/projected/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-kube-api-access-wbs28\") pod \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") "
Nov 04 03:34:57.448704 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.448580    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-envoy\") pod \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") "
Nov 04 03:34:57.448704 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.448608    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-workload-certs\") pod \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\" (UID: \"9cc4707c-e267-440a-8e5a-e8acbe2f14b9\") "
Nov 04 03:34:57.449785 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.449096    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-workload-socket" pod "9cc4707c-e267-440a-8e5a-e8acbe2f14b9" (UID: "9cc4707c-e267-440a-8e5a-e8acbe2f14b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:34:57.449785 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.449109    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-data" pod "9cc4707c-e267-440a-8e5a-e8acbe2f14b9" (UID: "9cc4707c-e267-440a-8e5a-e8acbe2f14b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:34:57.449785 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.449365    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-credential-socket" pod "9cc4707c-e267-440a-8e5a-e8acbe2f14b9" (UID: "9cc4707c-e267-440a-8e5a-e8acbe2f14b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:34:57.449785 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.449436    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istiod-ca-cert" pod "9cc4707c-e267-440a-8e5a-e8acbe2f14b9" (UID: "9cc4707c-e267-440a-8e5a-e8acbe2f14b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:34:57.450069 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.450019    4510 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-credential-socket\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:34:57.450069 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.450043    4510 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-workload-socket\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:34:57.450069 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.450059    4510 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istiod-ca-cert\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:34:57.450348 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.450074    4510 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-data\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:34:57.450348 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.450331    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-workload-certs" pod "9cc4707c-e267-440a-8e5a-e8acbe2f14b9" (UID: "9cc4707c-e267-440a-8e5a-e8acbe2f14b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:34:57.453126 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.453006    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-podinfo" pod "9cc4707c-e267-440a-8e5a-e8acbe2f14b9" (UID: "9cc4707c-e267-440a-8e5a-e8acbe2f14b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 03:34:57.453126 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.453100    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-envoy" pod "9cc4707c-e267-440a-8e5a-e8acbe2f14b9" (UID: "9cc4707c-e267-440a-8e5a-e8acbe2f14b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:34:57.454334 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.454278    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-token" pod "9cc4707c-e267-440a-8e5a-e8acbe2f14b9" (UID: "9cc4707c-e267-440a-8e5a-e8acbe2f14b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:34:57.456046 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.456017    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-kube-api-access-wbs28" pod "9cc4707c-e267-440a-8e5a-e8acbe2f14b9" (UID: "9cc4707c-e267-440a-8e5a-e8acbe2f14b9"). InnerVolumeSpecName "kube-api-access-wbs28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:34:57.551094 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.551058    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbs28\" (UniqueName: \"kubernetes.io/projected/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-kube-api-access-wbs28\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:34:57.551094 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.551096    4510 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-envoy\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:34:57.551353 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.551111    4510 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-workload-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:34:57.551353 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.551125    4510 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-token\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:34:57.551353 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.551138    4510 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9cc4707c-e267-440a-8e5a-e8acbe2f14b9-istio-podinfo\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:34:57.639469 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.639387    4510 generic.go:356] "Generic (PLEG): container finished" podID="9cc4707c-e267-440a-8e5a-e8acbe2f14b9" containerID="fb8400813a82b48309870bbf70f0ac731b4a6916f532ff42933fe0ce8fee82b1" exitCode=0
Nov 04 03:34:57.639469 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.639453    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"
Nov 04 03:34:57.639659 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.639474    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx" event={"ID":"9cc4707c-e267-440a-8e5a-e8acbe2f14b9","Type":"ContainerDied","Data":"fb8400813a82b48309870bbf70f0ac731b4a6916f532ff42933fe0ce8fee82b1"}
Nov 04 03:34:57.639659 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.639553    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx" event={"ID":"9cc4707c-e267-440a-8e5a-e8acbe2f14b9","Type":"ContainerDied","Data":"55db15626d68a488a222c088eb3175bdc75daac4ae523b288246d1cb82c63496"}
Nov 04 03:34:57.639659 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.639578    4510 scope.go:122] "RemoveContainer" containerID="fb8400813a82b48309870bbf70f0ac731b4a6916f532ff42933fe0ce8fee82b1"
Nov 04 03:34:57.649144 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.649126    4510 scope.go:122] "RemoveContainer" containerID="fb8400813a82b48309870bbf70f0ac731b4a6916f532ff42933fe0ce8fee82b1"
Nov 04 03:34:57.649447 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:34:57.649422    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb8400813a82b48309870bbf70f0ac731b4a6916f532ff42933fe0ce8fee82b1\": container with ID starting with fb8400813a82b48309870bbf70f0ac731b4a6916f532ff42933fe0ce8fee82b1 not found: ID does not exist" containerID="fb8400813a82b48309870bbf70f0ac731b4a6916f532ff42933fe0ce8fee82b1"
Nov 04 03:34:57.649578 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.649456    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb8400813a82b48309870bbf70f0ac731b4a6916f532ff42933fe0ce8fee82b1"} err="failed to get container status \"fb8400813a82b48309870bbf70f0ac731b4a6916f532ff42933fe0ce8fee82b1\": rpc error: code = NotFound desc = could not find container \"fb8400813a82b48309870bbf70f0ac731b4a6916f532ff42933fe0ce8fee82b1\": container with ID starting with fb8400813a82b48309870bbf70f0ac731b4a6916f532ff42933fe0ce8fee82b1 not found: ID does not exist"
Nov 04 03:34:57.804352 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.804322    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"]
Nov 04 03:34:57.809059 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:57.809036    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-26fdx"]
Nov 04 03:34:58.862161 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:34:58.862130    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9cc4707c-e267-440a-8e5a-e8acbe2f14b9" path="/var/lib/kubelet/pods/9cc4707c-e267-440a-8e5a-e8acbe2f14b9/volumes"
Nov 04 03:35:00.443710 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.443664    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"]
Nov 04 03:35:00.444129 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.444095    4510 cpu_manager.go:414] "containerMap: removing container" podUID="9cc4707c-e267-440a-8e5a-e8acbe2f14b9" containerName="istio-proxy"
Nov 04 03:35:00.444129 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.444107    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9cc4707c-e267-440a-8e5a-e8acbe2f14b9" containerName="istio-proxy"
Nov 04 03:35:00.444202 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.444175    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="9cc4707c-e267-440a-8e5a-e8acbe2f14b9" containerName="istio-proxy"
Nov 04 03:35:00.448730 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.448703    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.507703 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.506715    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-b-491fe7-openshift-default-dockercfg-fpm7q\""
Nov 04 03:35:00.560978 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.560947    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"]
Nov 04 03:35:00.581516 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.581489    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-workload-socket\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.581667 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.581528    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-credential-socket\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.581667 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.581554    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-podinfo\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.581775 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.581753    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7512762-8459-4fe2-a5e6-bcf32b17a181-istiod-ca-cert\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.581812 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.581777    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-data\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.581812 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.581801    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-token\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.581920 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.581901    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-envoy\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.581955 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.581934    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-workload-certs\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.581988 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.581954    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fvp8\" (UniqueName: \"kubernetes.io/projected/e7512762-8459-4fe2-a5e6-bcf32b17a181-kube-api-access-5fvp8\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.682837 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.682802    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7512762-8459-4fe2-a5e6-bcf32b17a181-istiod-ca-cert\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.683033 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.682852    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-data\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.683033 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.682897    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-token\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.683033 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.682944    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-envoy\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.683033 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.682973    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-workload-certs\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.683279 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.683210    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fvp8\" (UniqueName: \"kubernetes.io/projected/e7512762-8459-4fe2-a5e6-bcf32b17a181-kube-api-access-5fvp8\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.683340 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.683294    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-workload-socket\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.683340 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.683319    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-credential-socket\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.683445 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.683317    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-data\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.683445 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.683352    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-podinfo\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.683715 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.683669    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-workload-certs\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.684141 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.684009    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-credential-socket\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.684496 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.684469    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7512762-8459-4fe2-a5e6-bcf32b17a181-istiod-ca-cert\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.684614 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.684586    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-workload-socket\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.685949 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.685929    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-envoy\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.686161 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.686141    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-podinfo\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.745129 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.745099    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fvp8\" (UniqueName: \"kubernetes.io/projected/e7512762-8459-4fe2-a5e6-bcf32b17a181-kube-api-access-5fvp8\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.745271 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.745143    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-token\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:00.763702 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:00.763668    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:01.195172 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:01.195146    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"]
Nov 04 03:35:01.197105 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:35:01.197083    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7512762_8459_4fe2_a5e6_bcf32b17a181.slice/crio-c689043f996abbd7c2b7752f1fe834bdd7fc3ea2910bbe21a6fc820dd5aa2c57 WatchSource:0}: Error finding container c689043f996abbd7c2b7752f1fe834bdd7fc3ea2910bbe21a6fc820dd5aa2c57: Status 404 returned error can't find the container with id c689043f996abbd7c2b7752f1fe834bdd7fc3ea2910bbe21a6fc820dd5aa2c57
Nov 04 03:35:01.199670 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:01.199640    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:35:01.199780 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:01.199734    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:35:01.199820 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:01.199781    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:35:01.669247 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:01.669212    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn" event={"ID":"e7512762-8459-4fe2-a5e6-bcf32b17a181","Type":"ContainerStarted","Data":"da2ff17cb1540a1de7adac9afd8eb569004003ab221ab0f7918185f5494ec487"}
Nov 04 03:35:01.669654 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:01.669304    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn" event={"ID":"e7512762-8459-4fe2-a5e6-bcf32b17a181","Type":"ContainerStarted","Data":"c689043f996abbd7c2b7752f1fe834bdd7fc3ea2910bbe21a6fc820dd5aa2c57"}
Nov 04 03:35:01.764794 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:01.764766    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:01.791266 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:01.791216    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn" podStartSLOduration=1.7912024039999999 podStartE2EDuration="1.791202404s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:35:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:35:01.789387239 +0000 UTC m=+1077.053261547" watchObservedRunningTime="2026-11-04 03:35:01.791202404 +0000 UTC m=+1077.055076710"
Nov 04 03:35:02.673206 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:02.673167    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v"]
Nov 04 03:35:02.677278 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:02.677257    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v"
Nov 04 03:35:02.732812 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:02.732787    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-extmod-a-13190c\""
Nov 04 03:35:02.737005 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:02.736982    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v"]
Nov 04 03:35:02.774051 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:02.774020    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-extmod-a-13190c-dockercfg-8xqrh\""
Nov 04 03:35:02.783830 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:02.783806    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:02.806368 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:02.806333    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8e768db-6b1c-43ae-9b85-0c0427ef4c66-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v\" (UID: \"e8e768db-6b1c-43ae-9b85-0c0427ef4c66\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v"
Nov 04 03:35:02.806497 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:02.806379    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn4bq\" (UniqueName: \"kubernetes.io/projected/e8e768db-6b1c-43ae-9b85-0c0427ef4c66-kube-api-access-qn4bq\") pod \"payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v\" (UID: \"e8e768db-6b1c-43ae-9b85-0c0427ef4c66\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v"
Nov 04 03:35:02.819228 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:02.819207    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr"]
Nov 04 03:35:02.822662 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:02.822648    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr"
Nov 04 03:35:02.880618 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:02.880591    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr"]
Nov 04 03:35:02.908030 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:02.908004    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26f637a4-444a-4725-b7cf-eab47dd1e7b9-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr\" (UID: \"26f637a4-444a-4725-b7cf-eab47dd1e7b9\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr"
Nov 04 03:35:02.908193 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:02.908037    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f298c\" (UniqueName: \"kubernetes.io/projected/26f637a4-444a-4725-b7cf-eab47dd1e7b9-kube-api-access-f298c\") pod \"payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr\" (UID: \"26f637a4-444a-4725-b7cf-eab47dd1e7b9\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr"
Nov 04 03:35:02.908193 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:02.908140    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8e768db-6b1c-43ae-9b85-0c0427ef4c66-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v\" (UID: \"e8e768db-6b1c-43ae-9b85-0c0427ef4c66\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v"
Nov 04 03:35:02.908314 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:02.908193    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qn4bq\" (UniqueName: \"kubernetes.io/projected/e8e768db-6b1c-43ae-9b85-0c0427ef4c66-kube-api-access-qn4bq\") pod \"payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v\" (UID: \"e8e768db-6b1c-43ae-9b85-0c0427ef4c66\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v"
Nov 04 03:35:02.908886 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:02.908864    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8e768db-6b1c-43ae-9b85-0c0427ef4c66-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v\" (UID: \"e8e768db-6b1c-43ae-9b85-0c0427ef4c66\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v"
Nov 04 03:35:02.969422 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:02.969400    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn4bq\" (UniqueName: \"kubernetes.io/projected/e8e768db-6b1c-43ae-9b85-0c0427ef4c66-kube-api-access-qn4bq\") pod \"payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v\" (UID: \"e8e768db-6b1c-43ae-9b85-0c0427ef4c66\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v"
Nov 04 03:35:02.991278 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:02.991244    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v"
Nov 04 03:35:03.009636 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:03.009609    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26f637a4-444a-4725-b7cf-eab47dd1e7b9-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr\" (UID: \"26f637a4-444a-4725-b7cf-eab47dd1e7b9\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr"
Nov 04 03:35:03.009792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:03.009651    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f298c\" (UniqueName: \"kubernetes.io/projected/26f637a4-444a-4725-b7cf-eab47dd1e7b9-kube-api-access-f298c\") pod \"payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr\" (UID: \"26f637a4-444a-4725-b7cf-eab47dd1e7b9\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr"
Nov 04 03:35:03.010308 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:03.010288    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26f637a4-444a-4725-b7cf-eab47dd1e7b9-plugins-config-volume\") pod \"payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr\" (UID: \"26f637a4-444a-4725-b7cf-eab47dd1e7b9\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr"
Nov 04 03:35:03.071422 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:03.071396    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f298c\" (UniqueName: \"kubernetes.io/projected/26f637a4-444a-4725-b7cf-eab47dd1e7b9-kube-api-access-f298c\") pod \"payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr\" (UID: \"26f637a4-444a-4725-b7cf-eab47dd1e7b9\") " pod="openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr"
Nov 04 03:35:03.138425 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:03.138392    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr"
Nov 04 03:35:03.365374 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:03.365350    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v"]
Nov 04 03:35:03.366953 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:35:03.366922    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8e768db_6b1c_43ae_9b85_0c0427ef4c66.slice/crio-2fb2d151b8dfa4c16fb7400717e6e36d2841d459428ad8b0701f21af05bcf3fb WatchSource:0}: Error finding container 2fb2d151b8dfa4c16fb7400717e6e36d2841d459428ad8b0701f21af05bcf3fb: Status 404 returned error can't find the container with id 2fb2d151b8dfa4c16fb7400717e6e36d2841d459428ad8b0701f21af05bcf3fb
Nov 04 03:35:03.513124 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:03.513092    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr"]
Nov 04 03:35:03.514514 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:35:03.514491    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26f637a4_444a_4725_b7cf_eab47dd1e7b9.slice/crio-6ddcd839591b124f6eff6b02b419d1c3ee8ac72b4b6fe958c56ea570c5bf4595 WatchSource:0}: Error finding container 6ddcd839591b124f6eff6b02b419d1c3ee8ac72b4b6fe958c56ea570c5bf4595: Status 404 returned error can't find the container with id 6ddcd839591b124f6eff6b02b419d1c3ee8ac72b4b6fe958c56ea570c5bf4595
Nov 04 03:35:03.683985 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:03.683872    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr" event={"ID":"26f637a4-444a-4725-b7cf-eab47dd1e7b9","Type":"ContainerStarted","Data":"9f66612ebc5cfa02b28c6a56883693126af18e29fff85c71725569d50585ce9e"}
Nov 04 03:35:03.683985 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:03.683940    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr"
Nov 04 03:35:03.683985 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:03.683966    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr" event={"ID":"26f637a4-444a-4725-b7cf-eab47dd1e7b9","Type":"ContainerStarted","Data":"6ddcd839591b124f6eff6b02b419d1c3ee8ac72b4b6fe958c56ea570c5bf4595"}
Nov 04 03:35:03.685482 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:03.685454    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v" event={"ID":"e8e768db-6b1c-43ae-9b85-0c0427ef4c66","Type":"ContainerStarted","Data":"f09295754be9948b106b8c2c5c8c9d7dff7eba8a0522a91cb107ebbdde30b0dc"}
Nov 04 03:35:03.685610 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:03.685504    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v" event={"ID":"e8e768db-6b1c-43ae-9b85-0c0427ef4c66","Type":"ContainerStarted","Data":"2fb2d151b8dfa4c16fb7400717e6e36d2841d459428ad8b0701f21af05bcf3fb"}
Nov 04 03:35:03.685610 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:03.685532    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v"
Nov 04 03:35:03.685747 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:03.685712    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:03.686861 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:03.686847    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:35:03.823247 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:03.823194    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr" podStartSLOduration=1.823181503 podStartE2EDuration="1.823181503s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:35:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:35:03.822096236 +0000 UTC m=+1079.085970544" watchObservedRunningTime="2026-11-04 03:35:03.823181503 +0000 UTC m=+1079.087055842"
Nov 04 03:35:03.945421 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:03.944855    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v" podStartSLOduration=1.94483268 podStartE2EDuration="1.94483268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:35:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:35:03.937495654 +0000 UTC m=+1079.201369965" watchObservedRunningTime="2026-11-04 03:35:03.94483268 +0000 UTC m=+1079.208706988"
Nov 04 03:35:14.694486 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:14.694457    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr"
Nov 04 03:35:14.694999 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:14.694534    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v"
Nov 04 03:35:19.101829 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.101789    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"]
Nov 04 03:35:19.106833 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.106810    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.164785 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.164753    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"]
Nov 04 03:35:19.168521 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.168495    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b117874-604c-468c-817d-d479546de869-tls-certs\") pod \"distinct-2-w2-af788a-kserve-849c84b975-cmt5z\" (UID: \"2b117874-604c-468c-817d-d479546de869\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.168702 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.168550    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-home\") pod \"distinct-2-w2-af788a-kserve-849c84b975-cmt5z\" (UID: \"2b117874-604c-468c-817d-d479546de869\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.168771 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.168704    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbm4d\" (UniqueName: \"kubernetes.io/projected/2b117874-604c-468c-817d-d479546de869-kube-api-access-xbm4d\") pod \"distinct-2-w2-af788a-kserve-849c84b975-cmt5z\" (UID: \"2b117874-604c-468c-817d-d479546de869\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.168771 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.168756    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-tmp-dir\") pod \"distinct-2-w2-af788a-kserve-849c84b975-cmt5z\" (UID: \"2b117874-604c-468c-817d-d479546de869\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.168849 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.168804    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-model-cache\") pod \"distinct-2-w2-af788a-kserve-849c84b975-cmt5z\" (UID: \"2b117874-604c-468c-817d-d479546de869\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.168911 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.168894    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-dshm\") pod \"distinct-2-w2-af788a-kserve-849c84b975-cmt5z\" (UID: \"2b117874-604c-468c-817d-d479546de869\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.210831 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.210795    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-af788a\"/\"distinct-2-w2-af788a-kserve-self-signed-certs\""
Nov 04 03:35:19.270439 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.270411    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b117874-604c-468c-817d-d479546de869-tls-certs\") pod \"distinct-2-w2-af788a-kserve-849c84b975-cmt5z\" (UID: \"2b117874-604c-468c-817d-d479546de869\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.270604 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.270457    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-home\") pod \"distinct-2-w2-af788a-kserve-849c84b975-cmt5z\" (UID: \"2b117874-604c-468c-817d-d479546de869\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.270604 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.270496    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbm4d\" (UniqueName: \"kubernetes.io/projected/2b117874-604c-468c-817d-d479546de869-kube-api-access-xbm4d\") pod \"distinct-2-w2-af788a-kserve-849c84b975-cmt5z\" (UID: \"2b117874-604c-468c-817d-d479546de869\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.270604 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.270519    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-tmp-dir\") pod \"distinct-2-w2-af788a-kserve-849c84b975-cmt5z\" (UID: \"2b117874-604c-468c-817d-d479546de869\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.270604 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.270550    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-model-cache\") pod \"distinct-2-w2-af788a-kserve-849c84b975-cmt5z\" (UID: \"2b117874-604c-468c-817d-d479546de869\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.270829 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.270633    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-dshm\") pod \"distinct-2-w2-af788a-kserve-849c84b975-cmt5z\" (UID: \"2b117874-604c-468c-817d-d479546de869\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.271003 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.270984    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-tmp-dir\") pod \"distinct-2-w2-af788a-kserve-849c84b975-cmt5z\" (UID: \"2b117874-604c-468c-817d-d479546de869\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.271092 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.271016    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-model-cache\") pod \"distinct-2-w2-af788a-kserve-849c84b975-cmt5z\" (UID: \"2b117874-604c-468c-817d-d479546de869\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.271092 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.271067    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-home\") pod \"distinct-2-w2-af788a-kserve-849c84b975-cmt5z\" (UID: \"2b117874-604c-468c-817d-d479546de869\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.273808 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.273783    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-dshm\") pod \"distinct-2-w2-af788a-kserve-849c84b975-cmt5z\" (UID: \"2b117874-604c-468c-817d-d479546de869\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.273913 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.273830    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b117874-604c-468c-817d-d479546de869-tls-certs\") pod \"distinct-2-w2-af788a-kserve-849c84b975-cmt5z\" (UID: \"2b117874-604c-468c-817d-d479546de869\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.331691 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.331641    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbm4d\" (UniqueName: \"kubernetes.io/projected/2b117874-604c-468c-817d-d479546de869-kube-api-access-xbm4d\") pod \"distinct-2-w2-af788a-kserve-849c84b975-cmt5z\" (UID: \"2b117874-604c-468c-817d-d479546de869\") " pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.419009 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.418923    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:19.837838 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:35:19.837808    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2b117874_604c_468c_817d_d479546de869.slice/crio-712e7fbc3419bf2e71190a4f3bb212b51a37159bfca477a09f6a5cc3096aa1b5 WatchSource:0}: Error finding container 712e7fbc3419bf2e71190a4f3bb212b51a37159bfca477a09f6a5cc3096aa1b5: Status 404 returned error can't find the container with id 712e7fbc3419bf2e71190a4f3bb212b51a37159bfca477a09f6a5cc3096aa1b5
Nov 04 03:35:19.839232 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:19.839201    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"]
Nov 04 03:35:20.783380 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:20.783345    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z" event={"ID":"2b117874-604c-468c-817d-d479546de869","Type":"ContainerStarted","Data":"4289f0ca19b7615a80f79f3784fd889b00d8a60b61aec15be0d7bd3ef6f9ebc7"}
Nov 04 03:35:20.783804 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:20.783394    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z" event={"ID":"2b117874-604c-468c-817d-d479546de869","Type":"ContainerStarted","Data":"712e7fbc3419bf2e71190a4f3bb212b51a37159bfca477a09f6a5cc3096aa1b5"}
Nov 04 03:35:20.901731 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:20.901654    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z" podStartSLOduration=1.901637139 podStartE2EDuration="1.901637139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:35:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:35:20.897926083 +0000 UTC m=+1096.161800417" watchObservedRunningTime="2026-11-04 03:35:20.901637139 +0000 UTC m=+1096.165511447"
Nov 04 03:35:21.419989 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:21.419953    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:23.317657 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:35:23.317619    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:35:29.419875 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:29.419837    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:29.432939 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:29.432910    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:29.851980 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:35:29.851954    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:35:53.320000 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:35:53.319945    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:36:00.756225 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.756193    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"]
Nov 04 03:36:00.760009 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.759991    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"
Nov 04 03:36:00.815867 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.815844    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"agc-cred-bd5d7d46b00c\""
Nov 04 03:36:00.816105 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.816087    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"agc-cred-f2c682677175\""
Nov 04 03:36:00.865726 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.865664    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"openshift-service-ca.crt\""
Nov 04 03:36:00.865726 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.865670    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"routing-overlay\""
Nov 04 03:36:00.865927 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.865774    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"kube-root-ca.crt\""
Nov 04 03:36:00.865927 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.865841    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"payload-processing-external-model-plugins\""
Nov 04 03:36:00.865927 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.865878    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"payload-processing-external-model-dockercfg-d2hb5\""
Nov 04 03:36:00.868909 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.868890    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"]
Nov 04 03:36:00.897174 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.897152    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials\") pod \"payload-processing-external-model-86b659c8d5-hjmv6\" (UID: \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\") " pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"
Nov 04 03:36:00.897260 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.897200    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8q7mz\" (UniqueName: \"kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-kube-api-access-8q7mz\") pod \"payload-processing-external-model-86b659c8d5-hjmv6\" (UID: \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\") " pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"
Nov 04 03:36:00.897307 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.897286    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-plugins-config-volume\") pod \"payload-processing-external-model-86b659c8d5-hjmv6\" (UID: \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\") " pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"
Nov 04 03:36:00.897389 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.897370    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-routing-overlay-volume\") pod \"payload-processing-external-model-86b659c8d5-hjmv6\" (UID: \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\") " pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"
Nov 04 03:36:00.998786 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.998752    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials\") pod \"payload-processing-external-model-86b659c8d5-hjmv6\" (UID: \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\") " pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"
Nov 04 03:36:00.998955 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.998815    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8q7mz\" (UniqueName: \"kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-kube-api-access-8q7mz\") pod \"payload-processing-external-model-86b659c8d5-hjmv6\" (UID: \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\") " pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"
Nov 04 03:36:00.998955 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.998852    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-plugins-config-volume\") pod \"payload-processing-external-model-86b659c8d5-hjmv6\" (UID: \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\") " pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"
Nov 04 03:36:00.998955 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.998904    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-routing-overlay-volume\") pod \"payload-processing-external-model-86b659c8d5-hjmv6\" (UID: \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\") " pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"
Nov 04 03:36:00.999620 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:00.999596    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-routing-overlay-volume\") pod \"payload-processing-external-model-86b659c8d5-hjmv6\" (UID: \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\") " pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"
Nov 04 03:36:01.000081 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:01.000053    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-plugins-config-volume\") pod \"payload-processing-external-model-86b659c8d5-hjmv6\" (UID: \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\") " pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"
Nov 04 03:36:01.001739 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:01.001711    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials\") pod \"payload-processing-external-model-86b659c8d5-hjmv6\" (UID: \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\") " pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"
Nov 04 03:36:01.060024 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:01.059956    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8q7mz\" (UniqueName: \"kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-kube-api-access-8q7mz\") pod \"payload-processing-external-model-86b659c8d5-hjmv6\" (UID: \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\") " pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"
Nov 04 03:36:01.072817 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:01.072796    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"
Nov 04 03:36:01.459395 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:01.459368    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"]
Nov 04 03:36:01.461057 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:36:01.461031    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8307d11_d8a0_49c1_b3eb_d6b238871f5c.slice/crio-83e31b263b3a826044427de55da005309fe47cdab9106ba056fd7c670d6196cb WatchSource:0}: Error finding container 83e31b263b3a826044427de55da005309fe47cdab9106ba056fd7c670d6196cb: Status 404 returned error can't find the container with id 83e31b263b3a826044427de55da005309fe47cdab9106ba056fd7c670d6196cb
Nov 04 03:36:02.030819 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:02.030779    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6" event={"ID":"a8307d11-d8a0-49c1-b3eb-d6b238871f5c","Type":"ContainerStarted","Data":"3e45021450aa4103372b32aed05c7dfb23b6b619e2dba74a427faf37c6ebe852"}
Nov 04 03:36:02.031193 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:02.030846    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6" event={"ID":"a8307d11-d8a0-49c1-b3eb-d6b238871f5c","Type":"ContainerStarted","Data":"83e31b263b3a826044427de55da005309fe47cdab9106ba056fd7c670d6196cb"}
Nov 04 03:36:02.031193 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:02.030886    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"
Nov 04 03:36:02.149471 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:02.149409    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6" podStartSLOduration=2.149393376 podStartE2EDuration="2.149393376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:36:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:36:02.146897081 +0000 UTC m=+1137.410771388" watchObservedRunningTime="2026-11-04 03:36:02.149393376 +0000 UTC m=+1137.413267714"
Nov 04 03:36:13.041959 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:13.041924    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"
Nov 04 03:36:22.818708 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.814494    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"]
Nov 04 03:36:22.825618 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.825591    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.848515 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.848489    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.848659 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.848535    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.848659 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.848611    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.848773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.848743    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.848818 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.848804    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.848949 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.848922    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.849036 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.849022    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.849095 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.849062    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf9xq\" (UniqueName: \"kubernetes.io/projected/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-kube-api-access-tf9xq\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.849139 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.849115    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.931401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.931368    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"]
Nov 04 03:36:22.949945 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.949919    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.949945 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.949947    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.950146 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.950004    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.950146 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.950052    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.950146 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.950072    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf9xq\" (UniqueName: \"kubernetes.io/projected/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-kube-api-access-tf9xq\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.950146 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.950092    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.950146 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.950114    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.950146 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.950139    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.950491 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.950154    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.950491 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.950372    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.950878 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.950852    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.950968 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.950887    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.950968 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.950915    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.950968 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.950937    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.952560 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.952538    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:22.953095 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:22.953074    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:23.020088 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:23.020019    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf9xq\" (UniqueName: \"kubernetes.io/projected/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-kube-api-access-tf9xq\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:23.021209 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:23.021184    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-zsxt6\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:23.139523 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:23.139430    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:23.345757 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:36:23.345720    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:36:23.618973 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:23.618931    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"]
Nov 04 03:36:23.621442 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:23.621401    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:36:23.621545 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:23.621493    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:36:23.621545 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:23.621537    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:36:24.176097 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:24.176063    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6" event={"ID":"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7","Type":"ContainerStarted","Data":"42b665ddb2d3a24c087183030680306ea13be3239ba65a284e36b30ab18fc2bb"}
Nov 04 03:36:24.176655 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:24.176123    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6" event={"ID":"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7","Type":"ContainerStarted","Data":"4cb4fb0400dc013ff3287d4fc1ea6f762f317210a351bffcbe6d4b04ced87a94"}
Nov 04 03:36:24.323880 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:24.307388    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6" podStartSLOduration=2.307351665 podStartE2EDuration="2.307351665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:36:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:36:24.304397745 +0000 UTC m=+1159.568272053" watchObservedRunningTime="2026-11-04 03:36:24.307351665 +0000 UTC m=+1159.571225974"
Nov 04 03:36:25.145557 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:25.145524    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:25.145981 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:25.145959    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-zsxt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 04 03:36:25.146152 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:25.146128    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6" podUID="0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 04 03:36:26.140491 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:26.140457    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-zsxt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 04 03:36:26.140983 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:26.140510    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6" podUID="0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 04 03:36:27.140403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:27.140368    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-zsxt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 04 03:36:27.140617 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:27.140431    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6" podUID="0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 04 03:36:28.139883 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:28.139845    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-zsxt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 04 03:36:28.140093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:28.139929    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6" podUID="0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 04 03:36:29.140120 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:29.140083    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-zsxt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 04 03:36:29.140611 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:29.140165    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6" podUID="0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 04 03:36:30.140139 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:30.140106    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-zsxt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 04 03:36:30.142415 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:30.140181    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6" podUID="0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 04 03:36:31.140004 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.139963    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-zsxt6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Nov 04 03:36:31.140247 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.140037    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6" podUID="0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Nov 04 03:36:31.248326 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.248295    4510 generic.go:356] "Generic (PLEG): container finished" podID="e7512762-8459-4fe2-a5e6-bcf32b17a181" containerID="da2ff17cb1540a1de7adac9afd8eb569004003ab221ab0f7918185f5494ec487" exitCode=0
Nov 04 03:36:31.248508 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.248342    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn" event={"ID":"e7512762-8459-4fe2-a5e6-bcf32b17a181","Type":"ContainerDied","Data":"da2ff17cb1540a1de7adac9afd8eb569004003ab221ab0f7918185f5494ec487"}
Nov 04 03:36:31.248728 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.248713    4510 scope.go:122] "RemoveContainer" containerID="da2ff17cb1540a1de7adac9afd8eb569004003ab221ab0f7918185f5494ec487"
Nov 04 03:36:31.249998 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.249973    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:36:31.250058 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.250038    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:36:31.250093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.250070    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:36:31.355870 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.355838    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"]
Nov 04 03:36:31.360214 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.360191    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.423108 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.423025    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"]
Nov 04 03:36:31.456288 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.456253    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-podinfo\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.456574 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.456552    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-workload-certs\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.456826 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.456802    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-workload-socket\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.457067 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.457045    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-token\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.457586 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.457242    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b9608b1-179d-4740-bffe-ba998cdea67b-istiod-ca-cert\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.457586 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.457289    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-envoy\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.457586 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.457323    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-credential-socket\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.457586 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.457375    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnhrg\" (UniqueName: \"kubernetes.io/projected/8b9608b1-179d-4740-bffe-ba998cdea67b-kube-api-access-hnhrg\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.457586 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.457445    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-data\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.558736 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.558698    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-credential-socket\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.558932 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.558752    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnhrg\" (UniqueName: \"kubernetes.io/projected/8b9608b1-179d-4740-bffe-ba998cdea67b-kube-api-access-hnhrg\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.558932 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.558807    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-data\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.558932 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.558834    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-podinfo\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.558932 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.558875    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-workload-certs\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.558932 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.558896    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-workload-socket\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.559250 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.558961    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-token\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.559250 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.558988    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b9608b1-179d-4740-bffe-ba998cdea67b-istiod-ca-cert\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.559250 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.559011    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-envoy\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.559250 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.559065    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-credential-socket\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.559250 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.559158    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-data\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.559542 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.559368    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-workload-socket\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.559791 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.559650    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-workload-certs\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.559882 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.559817    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b9608b1-179d-4740-bffe-ba998cdea67b-istiod-ca-cert\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.561328 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.561307    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-envoy\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.561951 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.561936    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-podinfo\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.620312 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.620282    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-token\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.620459 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.620316    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnhrg\" (UniqueName: \"kubernetes.io/projected/8b9608b1-179d-4740-bffe-ba998cdea67b-kube-api-access-hnhrg\") pod \"e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") " pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:31.685703 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:31.685601    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:32.127118 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:32.126405    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"]
Nov 04 03:36:32.128626 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:36:32.128582    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b9608b1_179d_4740_bffe_ba998cdea67b.slice/crio-07fc0753263ffbe03b0a98600d5a16c3f75b7ac0d251eec091de1669051166aa WatchSource:0}: Error finding container 07fc0753263ffbe03b0a98600d5a16c3f75b7ac0d251eec091de1669051166aa: Status 404 returned error can't find the container with id 07fc0753263ffbe03b0a98600d5a16c3f75b7ac0d251eec091de1669051166aa
Nov 04 03:36:32.134910 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:32.132140    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:36:32.134910 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:32.132214    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:36:32.134910 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:32.132254    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:36:32.261706 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:32.258730    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn" event={"ID":"e7512762-8459-4fe2-a5e6-bcf32b17a181","Type":"ContainerStarted","Data":"73f1572423c56508c6374c28b4666b04a30304ad76881f2b8095d043677fb8dc"}
Nov 04 03:36:32.261706 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:32.260492    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9" event={"ID":"8b9608b1-179d-4740-bffe-ba998cdea67b","Type":"ContainerStarted","Data":"165a81998f44c166f09e2654ef5b57c4f949db1a22ec5b232d7102936cd78f57"}
Nov 04 03:36:32.261706 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:32.260532    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9" event={"ID":"8b9608b1-179d-4740-bffe-ba998cdea67b","Type":"ContainerStarted","Data":"07fc0753263ffbe03b0a98600d5a16c3f75b7ac0d251eec091de1669051166aa"}
Nov 04 03:36:32.503709 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:32.503627    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9" podStartSLOduration=1.5036062289999998 podStartE2EDuration="1.503606229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:36:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:36:32.49916278 +0000 UTC m=+1167.763037090" watchObservedRunningTime="2026-11-04 03:36:32.503606229 +0000 UTC m=+1167.767480541"
Nov 04 03:36:32.687703 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:32.686666    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:32.764842 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:32.764146    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:36:32.766222 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:32.766193    4510 patch_prober.go:29] interesting pod/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 03:36:32.766335 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:32.766262    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn" podUID="e7512762-8459-4fe2-a5e6-bcf32b17a181" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 03:36:32.945636 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:32.945607    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:32.946148 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:32.946120    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:32.947061 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:32.947033    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:36:33.686136 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:33.686091    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:36:33.688010 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:33.687981    4510 patch_prober.go:29] interesting pod/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 03:36:33.688159 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:33.688040    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9" podUID="8b9608b1-179d-4740-bffe-ba998cdea67b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 03:36:33.764962 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:33.764926    4510 patch_prober.go:29] interesting pod/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 03:36:33.765135 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:33.764974    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn" podUID="e7512762-8459-4fe2-a5e6-bcf32b17a181" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 03:36:34.686563 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:34.686524    4510 patch_prober.go:29] interesting pod/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 03:36:34.687002 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:34.686578    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9" podUID="8b9608b1-179d-4740-bffe-ba998cdea67b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 03:36:34.764790 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:34.764759    4510 patch_prober.go:29] interesting pod/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 03:36:34.764961 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:34.764811    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn" podUID="e7512762-8459-4fe2-a5e6-bcf32b17a181" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 03:36:35.686030 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:35.685981    4510 patch_prober.go:29] interesting pod/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 03:36:35.686194 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:35.686048    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9" podUID="8b9608b1-179d-4740-bffe-ba998cdea67b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 03:36:35.764537 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:35.764498    4510 patch_prober.go:29] interesting pod/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 03:36:35.764962 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:35.764556    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn" podUID="e7512762-8459-4fe2-a5e6-bcf32b17a181" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 03:36:36.686384 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:36.686350    4510 patch_prober.go:29] interesting pod/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 03:36:36.686550 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:36.686412    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9" podUID="8b9608b1-179d-4740-bffe-ba998cdea67b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 03:36:36.764067 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:36.764035    4510 patch_prober.go:29] interesting pod/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 03:36:36.764328 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:36.764291    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn" podUID="e7512762-8459-4fe2-a5e6-bcf32b17a181" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 03:36:37.686700 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:37.686645    4510 patch_prober.go:29] interesting pod/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 03:36:37.687125 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:37.686730    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9" podUID="8b9608b1-179d-4740-bffe-ba998cdea67b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 03:36:37.764905 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:37.764868    4510 patch_prober.go:29] interesting pod/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Nov 04 03:36:37.765101 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:37.764922    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn" podUID="e7512762-8459-4fe2-a5e6-bcf32b17a181" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Nov 04 03:36:38.686798 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:38.686759    4510 patch_prober.go:29] interesting pod/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 03:36:38.687192 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:38.686822    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9" podUID="8b9608b1-179d-4740-bffe-ba998cdea67b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 03:36:38.773747 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:38.773715    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:36:38.774788 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:38.774766    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:36:39.691153 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:39.691128    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:39.691552 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:39.691531    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:39.692300 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:39.692279    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:36:51.834069 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:51.834029    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp"]
Nov 04 03:36:51.838044 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:51.838019    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp"
Nov 04 03:36:51.937194 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:51.937146    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7w7x\" (UniqueName: \"kubernetes.io/projected/001d5e6a-505a-4f19-abe8-22c8cbb53704-kube-api-access-b7w7x\") pod \"payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp\" (UID: \"001d5e6a-505a-4f19-abe8-22c8cbb53704\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp"
Nov 04 03:36:51.937448 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:51.937424    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/001d5e6a-505a-4f19-abe8-22c8cbb53704-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp\" (UID: \"001d5e6a-505a-4f19-abe8-22c8cbb53704\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp"
Nov 04 03:36:51.941132 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:51.941110    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-extmod-b-5d459a\""
Nov 04 03:36:51.941439 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:51.941420    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-extmod-b-5d459a-dockercfg-4mrs5\""
Nov 04 03:36:51.945079 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:51.945056    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp"]
Nov 04 03:36:51.995463 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:51.995431    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9"]
Nov 04 03:36:51.999942 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:51.999920    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9"
Nov 04 03:36:52.039034 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:52.039001    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e58c8f3e-b840-4a6c-9592-888c2d03ee78-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9\" (UID: \"e58c8f3e-b840-4a6c-9592-888c2d03ee78\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9"
Nov 04 03:36:52.039173 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:52.039070    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/001d5e6a-505a-4f19-abe8-22c8cbb53704-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp\" (UID: \"001d5e6a-505a-4f19-abe8-22c8cbb53704\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp"
Nov 04 03:36:52.039173 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:52.039129    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsv86\" (UniqueName: \"kubernetes.io/projected/e58c8f3e-b840-4a6c-9592-888c2d03ee78-kube-api-access-lsv86\") pod \"payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9\" (UID: \"e58c8f3e-b840-4a6c-9592-888c2d03ee78\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9"
Nov 04 03:36:52.039300 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:52.039256    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7w7x\" (UniqueName: \"kubernetes.io/projected/001d5e6a-505a-4f19-abe8-22c8cbb53704-kube-api-access-b7w7x\") pod \"payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp\" (UID: \"001d5e6a-505a-4f19-abe8-22c8cbb53704\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp"
Nov 04 03:36:52.039844 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:52.039826    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/001d5e6a-505a-4f19-abe8-22c8cbb53704-plugins-config-volume\") pod \"payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp\" (UID: \"001d5e6a-505a-4f19-abe8-22c8cbb53704\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp"
Nov 04 03:36:52.044690 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:52.044652    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9"]
Nov 04 03:36:52.101066 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:52.100995    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7w7x\" (UniqueName: \"kubernetes.io/projected/001d5e6a-505a-4f19-abe8-22c8cbb53704-kube-api-access-b7w7x\") pod \"payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp\" (UID: \"001d5e6a-505a-4f19-abe8-22c8cbb53704\") " pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp"
Nov 04 03:36:52.141509 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:52.141133    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e58c8f3e-b840-4a6c-9592-888c2d03ee78-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9\" (UID: \"e58c8f3e-b840-4a6c-9592-888c2d03ee78\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9"
Nov 04 03:36:52.141509 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:52.141251    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsv86\" (UniqueName: \"kubernetes.io/projected/e58c8f3e-b840-4a6c-9592-888c2d03ee78-kube-api-access-lsv86\") pod \"payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9\" (UID: \"e58c8f3e-b840-4a6c-9592-888c2d03ee78\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9"
Nov 04 03:36:52.142726 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:52.142668    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e58c8f3e-b840-4a6c-9592-888c2d03ee78-plugins-config-volume\") pod \"payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9\" (UID: \"e58c8f3e-b840-4a6c-9592-888c2d03ee78\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9"
Nov 04 03:36:52.154103 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:52.154068    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp"
Nov 04 03:36:52.205065 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:52.205028    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsv86\" (UniqueName: \"kubernetes.io/projected/e58c8f3e-b840-4a6c-9592-888c2d03ee78-kube-api-access-lsv86\") pod \"payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9\" (UID: \"e58c8f3e-b840-4a6c-9592-888c2d03ee78\") " pod="openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9"
Nov 04 03:36:52.314411 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:52.314369    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9"
Nov 04 03:36:52.551773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:52.551749    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp"]
Nov 04 03:36:52.553290 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:36:52.553267    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod001d5e6a_505a_4f19_abe8_22c8cbb53704.slice/crio-220f8975329f20f627c1e2cd1a4617c1b39fa5e64319da296c2fb17ba49966a3 WatchSource:0}: Error finding container 220f8975329f20f627c1e2cd1a4617c1b39fa5e64319da296c2fb17ba49966a3: Status 404 returned error can't find the container with id 220f8975329f20f627c1e2cd1a4617c1b39fa5e64319da296c2fb17ba49966a3
Nov 04 03:36:52.692885 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:52.692857    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9"]
Nov 04 03:36:52.696777 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:36:52.696747    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode58c8f3e_b840_4a6c_9592_888c2d03ee78.slice/crio-9a410ee3259520363a7aa61385bd5dd0ba97a5e8293ac5eb1395346648069ace WatchSource:0}: Error finding container 9a410ee3259520363a7aa61385bd5dd0ba97a5e8293ac5eb1395346648069ace: Status 404 returned error can't find the container with id 9a410ee3259520363a7aa61385bd5dd0ba97a5e8293ac5eb1395346648069ace
Nov 04 03:36:53.317669 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:36:53.317633    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:36:53.393727 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:53.393668    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp" event={"ID":"001d5e6a-505a-4f19-abe8-22c8cbb53704","Type":"ContainerStarted","Data":"de5bae4504a323944a40a0ab663c722e767b03f7946a9577b17cca775bbfecb9"}
Nov 04 03:36:53.393924 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:53.393755    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp" event={"ID":"001d5e6a-505a-4f19-abe8-22c8cbb53704","Type":"ContainerStarted","Data":"220f8975329f20f627c1e2cd1a4617c1b39fa5e64319da296c2fb17ba49966a3"}
Nov 04 03:36:53.393924 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:53.393868    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp"
Nov 04 03:36:53.395375 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:53.395350    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9" event={"ID":"e58c8f3e-b840-4a6c-9592-888c2d03ee78","Type":"ContainerStarted","Data":"c90c735988d7510b5e31b004774c801ca659be38d13f8f0998406f2fbd96df71"}
Nov 04 03:36:53.395508 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:53.395395    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9" event={"ID":"e58c8f3e-b840-4a6c-9592-888c2d03ee78","Type":"ContainerStarted","Data":"9a410ee3259520363a7aa61385bd5dd0ba97a5e8293ac5eb1395346648069ace"}
Nov 04 03:36:53.395508 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:53.395419    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9"
Nov 04 03:36:53.511847 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:53.511790    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp" podStartSLOduration=2.511772349 podStartE2EDuration="2.511772349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:36:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:36:53.509342943 +0000 UTC m=+1188.773217250" watchObservedRunningTime="2026-11-04 03:36:53.511772349 +0000 UTC m=+1188.775646658"
Nov 04 03:36:53.628765 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:36:53.628641    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9" podStartSLOduration=2.628623174 podStartE2EDuration="2.628623174s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:36:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:36:53.624540173 +0000 UTC m=+1188.888414482" watchObservedRunningTime="2026-11-04 03:36:53.628623174 +0000 UTC m=+1188.892497481"
Nov 04 03:37:01.393592 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:01.393560    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"]
Nov 04 03:37:01.443552 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:01.443523    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"]
Nov 04 03:37:04.405319 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:04.405290    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9"
Nov 04 03:37:04.405769 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:04.405420    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp"
Nov 04 03:37:13.935038 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:13.935002    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"]
Nov 04 03:37:13.940320 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:13.940304    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"
Nov 04 03:37:14.044499 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.044466    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-extmod-b-491fe7\"/\"payload-processing-external-model-e2e--1a4897a2-dockercfg-7hgxc\""
Nov 04 03:37:14.044499 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.044469    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-extmod-b-491fe7\"/\"agc-cred-12d1e06f5e21\""
Nov 04 03:37:14.044751 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.044502    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-491fe7\"/\"routing-overlay\""
Nov 04 03:37:14.044751 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.044564    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-491fe7\"/\"openshift-service-ca.crt\""
Nov 04 03:37:14.044826 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.044762    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-491fe7\"/\"payload-processing-external-model-plugins-e2e-extmod-b-491fe7\""
Nov 04 03:37:14.044826 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.044801    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-extmod-b-491fe7\"/\"kube-root-ca.crt\""
Nov 04 03:37:14.047476 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.047456    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"]
Nov 04 03:37:14.082929 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.082901    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c49160c5-aeac-464e-9a7f-8e436aa1e90e-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56\" (UID: \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\") " pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"
Nov 04 03:37:14.083061 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.082952    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7swcc\" (UniqueName: \"kubernetes.io/projected/c49160c5-aeac-464e-9a7f-8e436aa1e90e-kube-api-access-7swcc\") pod \"payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56\" (UID: \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\") " pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"
Nov 04 03:37:14.083061 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.083010    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/c49160c5-aeac-464e-9a7f-8e436aa1e90e-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56\" (UID: \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\") " pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"
Nov 04 03:37:14.083147 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.083062    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/c49160c5-aeac-464e-9a7f-8e436aa1e90e-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56\" (UID: \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\") " pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"
Nov 04 03:37:14.184319 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.184204    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7swcc\" (UniqueName: \"kubernetes.io/projected/c49160c5-aeac-464e-9a7f-8e436aa1e90e-kube-api-access-7swcc\") pod \"payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56\" (UID: \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\") " pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"
Nov 04 03:37:14.184319 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.184266    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/c49160c5-aeac-464e-9a7f-8e436aa1e90e-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56\" (UID: \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\") " pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"
Nov 04 03:37:14.184580 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.184349    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/c49160c5-aeac-464e-9a7f-8e436aa1e90e-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56\" (UID: \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\") " pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"
Nov 04 03:37:14.184580 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.184510    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c49160c5-aeac-464e-9a7f-8e436aa1e90e-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56\" (UID: \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\") " pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"
Nov 04 03:37:14.185352 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.185243    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/c49160c5-aeac-464e-9a7f-8e436aa1e90e-routing-overlay-volume\") pod \"payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56\" (UID: \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\") " pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"
Nov 04 03:37:14.185476 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.185441    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c49160c5-aeac-464e-9a7f-8e436aa1e90e-plugins-config-volume\") pod \"payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56\" (UID: \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\") " pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"
Nov 04 03:37:14.187369 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.187349    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/c49160c5-aeac-464e-9a7f-8e436aa1e90e-provider-credentials\") pod \"payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56\" (UID: \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\") " pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"
Nov 04 03:37:14.245600 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.245572    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7swcc\" (UniqueName: \"kubernetes.io/projected/c49160c5-aeac-464e-9a7f-8e436aa1e90e-kube-api-access-7swcc\") pod \"payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56\" (UID: \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\") " pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"
Nov 04 03:37:14.253797 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.253768    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"
Nov 04 03:37:14.655721 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:14.652382    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"]
Nov 04 03:37:14.657552 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:37:14.657522    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc49160c5_aeac_464e_9a7f_8e436aa1e90e.slice/crio-95a1eaeccda5afebf8794ceb33df5db11f61ff032121a11223c55200dfd8d6e5 WatchSource:0}: Error finding container 95a1eaeccda5afebf8794ceb33df5db11f61ff032121a11223c55200dfd8d6e5: Status 404 returned error can't find the container with id 95a1eaeccda5afebf8794ceb33df5db11f61ff032121a11223c55200dfd8d6e5
Nov 04 03:37:15.548905 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:15.548872    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56" event={"ID":"c49160c5-aeac-464e-9a7f-8e436aa1e90e","Type":"ContainerStarted","Data":"a91b183abb928da49cd24cfe4f0d517069e66ec35c1a21a2c17f44030ff2dee2"}
Nov 04 03:37:15.549418 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:15.548935    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56" event={"ID":"c49160c5-aeac-464e-9a7f-8e436aa1e90e","Type":"ContainerStarted","Data":"95a1eaeccda5afebf8794ceb33df5db11f61ff032121a11223c55200dfd8d6e5"}
Nov 04 03:37:15.549418 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:15.548984    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"
Nov 04 03:37:15.669137 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:15.669073    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56" podStartSLOduration=2.6690530409999997 podStartE2EDuration="2.669053041s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:37:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:37:15.66577814 +0000 UTC m=+1210.929652448" watchObservedRunningTime="2026-11-04 03:37:15.669053041 +0000 UTC m=+1210.932927350"
Nov 04 03:37:16.414304 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.414259    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc" podUID="b9de2297-f797-4439-9e0e-2f5555ef676d" containerName="main" containerID="cri-o://f32b9d6f815a374fde42fc4ef853872925855cc54a85d1c4d791c7d419ee2353" gracePeriod=45
Nov 04 03:37:16.464180 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.464150    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk" podUID="0431ba98-4ab2-4820-867c-fead8f7f5fc9" containerName="main" containerID="cri-o://e387c29825f8abbab63446ae1bc5767d434748f23d8edead0dfa3b9a76a76b76" gracePeriod=45
Nov 04 03:37:16.556773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.556742    4510 generic.go:356] "Generic (PLEG): container finished" podID="b9de2297-f797-4439-9e0e-2f5555ef676d" containerID="f32b9d6f815a374fde42fc4ef853872925855cc54a85d1c4d791c7d419ee2353" exitCode=0
Nov 04 03:37:16.557200 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.556814    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc" event={"ID":"b9de2297-f797-4439-9e0e-2f5555ef676d","Type":"ContainerDied","Data":"f32b9d6f815a374fde42fc4ef853872925855cc54a85d1c4d791c7d419ee2353"}
Nov 04 03:37:16.718399 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.718375    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:37:16.742104 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.742084    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:37:16.811742 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.811715    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b9de2297-f797-4439-9e0e-2f5555ef676d-tls-certs\" (UniqueName: \"kubernetes.io/secret/b9de2297-f797-4439-9e0e-2f5555ef676d-tls-certs\") pod \"b9de2297-f797-4439-9e0e-2f5555ef676d\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") "
Nov 04 03:37:16.811893 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.811761    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b9de2297-f797-4439-9e0e-2f5555ef676d-kube-api-access-ddh8c\" (UniqueName: \"kubernetes.io/projected/b9de2297-f797-4439-9e0e-2f5555ef676d-kube-api-access-ddh8c\") pod \"b9de2297-f797-4439-9e0e-2f5555ef676d\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") "
Nov 04 03:37:16.811965 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.811927    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-model-cache\") pod \"b9de2297-f797-4439-9e0e-2f5555ef676d\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") "
Nov 04 03:37:16.812022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.811977    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-home\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-home\") pod \"b9de2297-f797-4439-9e0e-2f5555ef676d\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") "
Nov 04 03:37:16.812022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.812006    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-tmp-dir\") pod \"b9de2297-f797-4439-9e0e-2f5555ef676d\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") "
Nov 04 03:37:16.812130 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.812063    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-dshm\") pod \"b9de2297-f797-4439-9e0e-2f5555ef676d\" (UID: \"b9de2297-f797-4439-9e0e-2f5555ef676d\") "
Nov 04 03:37:16.812213 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.812183    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-model-cache" pod "b9de2297-f797-4439-9e0e-2f5555ef676d" (UID: "b9de2297-f797-4439-9e0e-2f5555ef676d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:37:16.812351 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.812324    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-tmp-dir" pod "b9de2297-f797-4439-9e0e-2f5555ef676d" (UID: "b9de2297-f797-4439-9e0e-2f5555ef676d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:37:16.812511 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.812381    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-home" pod "b9de2297-f797-4439-9e0e-2f5555ef676d" (UID: "b9de2297-f797-4439-9e0e-2f5555ef676d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:37:16.812511 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.812500    4510 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-model-cache\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:37:16.812610 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.812520    4510 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-home\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:37:16.812610 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.812534    4510 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-tmp-dir\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:37:16.814418 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.814393    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-dshm" pod "b9de2297-f797-4439-9e0e-2f5555ef676d" (UID: "b9de2297-f797-4439-9e0e-2f5555ef676d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:37:16.814575 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.814556    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9de2297-f797-4439-9e0e-2f5555ef676d-tls-certs" pod "b9de2297-f797-4439-9e0e-2f5555ef676d" (UID: "b9de2297-f797-4439-9e0e-2f5555ef676d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:37:16.814638 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.814574    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9de2297-f797-4439-9e0e-2f5555ef676d-kube-api-access-ddh8c" pod "b9de2297-f797-4439-9e0e-2f5555ef676d" (UID: "b9de2297-f797-4439-9e0e-2f5555ef676d"). InnerVolumeSpecName "kube-api-access-ddh8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:37:16.913007 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.912978    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-model-cache\") pod \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") "
Nov 04 03:37:16.913148 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.913059    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0431ba98-4ab2-4820-867c-fead8f7f5fc9-kube-api-access-d55jb\" (UniqueName: \"kubernetes.io/projected/0431ba98-4ab2-4820-867c-fead8f7f5fc9-kube-api-access-d55jb\") pod \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") "
Nov 04 03:37:16.913148 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.913083    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0431ba98-4ab2-4820-867c-fead8f7f5fc9-tls-certs\" (UniqueName: \"kubernetes.io/secret/0431ba98-4ab2-4820-867c-fead8f7f5fc9-tls-certs\") pod \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") "
Nov 04 03:37:16.913225 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.913190    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-home\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-home\") pod \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") "
Nov 04 03:37:16.913263 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.913228    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-tmp-dir\") pod \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") "
Nov 04 03:37:16.913317 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.913262    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-dshm\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-dshm\") pod \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\" (UID: \"0431ba98-4ab2-4820-867c-fead8f7f5fc9\") "
Nov 04 03:37:16.913317 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.913221    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-model-cache" pod "0431ba98-4ab2-4820-867c-fead8f7f5fc9" (UID: "0431ba98-4ab2-4820-867c-fead8f7f5fc9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:37:16.913446 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.913424    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-home" pod "0431ba98-4ab2-4820-867c-fead8f7f5fc9" (UID: "0431ba98-4ab2-4820-867c-fead8f7f5fc9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:37:16.913509 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.913473    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-tmp-dir" pod "0431ba98-4ab2-4820-867c-fead8f7f5fc9" (UID: "0431ba98-4ab2-4820-867c-fead8f7f5fc9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:37:16.913636 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.913620    4510 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-home\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:37:16.913719 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.913642    4510 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9de2297-f797-4439-9e0e-2f5555ef676d-dshm\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:37:16.913719 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.913656    4510 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-tmp-dir\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:37:16.913719 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.913670    4510 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-model-cache\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:37:16.913719 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.913703    4510 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9de2297-f797-4439-9e0e-2f5555ef676d-tls-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:37:16.913876 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.913718    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddh8c\" (UniqueName: \"kubernetes.io/projected/b9de2297-f797-4439-9e0e-2f5555ef676d-kube-api-access-ddh8c\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:37:16.915311 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.915290    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-dshm" pod "0431ba98-4ab2-4820-867c-fead8f7f5fc9" (UID: "0431ba98-4ab2-4820-867c-fead8f7f5fc9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:37:16.915311 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.915298    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0431ba98-4ab2-4820-867c-fead8f7f5fc9-kube-api-access-d55jb" pod "0431ba98-4ab2-4820-867c-fead8f7f5fc9" (UID: "0431ba98-4ab2-4820-867c-fead8f7f5fc9"). InnerVolumeSpecName "kube-api-access-d55jb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:37:16.915412 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:16.915346    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0431ba98-4ab2-4820-867c-fead8f7f5fc9-tls-certs" pod "0431ba98-4ab2-4820-867c-fead8f7f5fc9" (UID: "0431ba98-4ab2-4820-867c-fead8f7f5fc9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:37:17.014639 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.014605    4510 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0431ba98-4ab2-4820-867c-fead8f7f5fc9-dshm\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:37:17.014639 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.014632    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d55jb\" (UniqueName: \"kubernetes.io/projected/0431ba98-4ab2-4820-867c-fead8f7f5fc9-kube-api-access-d55jb\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:37:17.014639 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.014642    4510 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0431ba98-4ab2-4820-867c-fead8f7f5fc9-tls-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:37:17.048474 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.048446    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t"]
Nov 04 03:37:17.159331 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.159295    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4"]
Nov 04 03:37:17.564286 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.564254    4510 generic.go:356] "Generic (PLEG): container finished" podID="0431ba98-4ab2-4820-867c-fead8f7f5fc9" containerID="e387c29825f8abbab63446ae1bc5767d434748f23d8edead0dfa3b9a76a76b76" exitCode=0
Nov 04 03:37:17.564791 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.564322    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"
Nov 04 03:37:17.564791 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.564339    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk" event={"ID":"0431ba98-4ab2-4820-867c-fead8f7f5fc9","Type":"ContainerDied","Data":"e387c29825f8abbab63446ae1bc5767d434748f23d8edead0dfa3b9a76a76b76"}
Nov 04 03:37:17.564791 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.564379    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk" event={"ID":"0431ba98-4ab2-4820-867c-fead8f7f5fc9","Type":"ContainerDied","Data":"ed52a2747b8e3a23e1724cc72b95694b1ce2227f5894556fe3f83065b66d6b8e"}
Nov 04 03:37:17.564791 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.564396    4510 scope.go:122] "RemoveContainer" containerID="e387c29825f8abbab63446ae1bc5767d434748f23d8edead0dfa3b9a76a76b76"
Nov 04 03:37:17.565986 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.565888    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc" event={"ID":"b9de2297-f797-4439-9e0e-2f5555ef676d","Type":"ContainerDied","Data":"746179791ed39f958bc2fcbebaffda4840ee868a90b0369912d2944420f57813"}
Nov 04 03:37:17.565986 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.565920    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"
Nov 04 03:37:17.575658 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.575639    4510 scope.go:122] "RemoveContainer" containerID="e387c29825f8abbab63446ae1bc5767d434748f23d8edead0dfa3b9a76a76b76"
Nov 04 03:37:17.576007 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:17.575974    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e387c29825f8abbab63446ae1bc5767d434748f23d8edead0dfa3b9a76a76b76\": container with ID starting with e387c29825f8abbab63446ae1bc5767d434748f23d8edead0dfa3b9a76a76b76 not found: ID does not exist" containerID="e387c29825f8abbab63446ae1bc5767d434748f23d8edead0dfa3b9a76a76b76"
Nov 04 03:37:17.576069 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.576012    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e387c29825f8abbab63446ae1bc5767d434748f23d8edead0dfa3b9a76a76b76"} err="failed to get container status \"e387c29825f8abbab63446ae1bc5767d434748f23d8edead0dfa3b9a76a76b76\": rpc error: code = NotFound desc = could not find container \"e387c29825f8abbab63446ae1bc5767d434748f23d8edead0dfa3b9a76a76b76\": container with ID starting with e387c29825f8abbab63446ae1bc5767d434748f23d8edead0dfa3b9a76a76b76 not found: ID does not exist"
Nov 04 03:37:17.576069 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.576035    4510 scope.go:122] "RemoveContainer" containerID="f32b9d6f815a374fde42fc4ef853872925855cc54a85d1c4d791c7d419ee2353"
Nov 04 03:37:17.730222 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.730192    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"]
Nov 04 03:37:17.736181 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.736156    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-36ccd3/distinct-w0-36ccd3-kserve-85795c66ff-xdbsc"]
Nov 04 03:37:17.844765 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.844733    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"]
Nov 04 03:37:17.851055 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:17.851032    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-36ccd3/simulator-w0-36ccd3-kserve-5554887bb9-mv4mk"]
Nov 04 03:37:18.862673 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:18.862634    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0431ba98-4ab2-4820-867c-fead8f7f5fc9" path="/var/lib/kubelet/pods/0431ba98-4ab2-4820-867c-fead8f7f5fc9/volumes"
Nov 04 03:37:18.863186 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:18.863078    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b9de2297-f797-4439-9e0e-2f5555ef676d" path="/var/lib/kubelet/pods/b9de2297-f797-4439-9e0e-2f5555ef676d/volumes"
Nov 04 03:37:22.048922 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.048867    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t" podUID="a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443" containerName="payload-processing" containerID="cri-o://9aef7c5b814b4d1859036b82e547336e306e190c0615c473e7b2fbb2ff65fcb4" gracePeriod=25
Nov 04 03:37:22.159761 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.159727    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4" podUID="d1e9672f-aa23-4c1b-ad67-e01f2ae0b993" containerName="payload-pre-processing" containerID="cri-o://b5c96147174ee7f4ff82e5f24d6441f0dc29bb9a0c837b0cd00a744b2e746489" gracePeriod=25
Nov 04 03:37:22.331040 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.331012    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t"
Nov 04 03:37:22.369588 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.369554    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443-plugins-config-volume\") pod \"a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443\" (UID: \"a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443\") "
Nov 04 03:37:22.369785 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.369772    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443-kube-api-access-v2dqt\" (UniqueName: \"kubernetes.io/projected/a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443-kube-api-access-v2dqt\") pod \"a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443\" (UID: \"a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443\") "
Nov 04 03:37:22.370773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.370673    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443-plugins-config-volume" pod "a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443" (UID: "a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:37:22.372995 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.372966    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443-kube-api-access-v2dqt" pod "a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443" (UID: "a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443"). InnerVolumeSpecName "kube-api-access-v2dqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:37:22.430630 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.430602    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4"
Nov 04 03:37:22.470452 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.470425    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d1e9672f-aa23-4c1b-ad67-e01f2ae0b993-kube-api-access-dt2ch\" (UniqueName: \"kubernetes.io/projected/d1e9672f-aa23-4c1b-ad67-e01f2ae0b993-kube-api-access-dt2ch\") pod \"d1e9672f-aa23-4c1b-ad67-e01f2ae0b993\" (UID: \"d1e9672f-aa23-4c1b-ad67-e01f2ae0b993\") "
Nov 04 03:37:22.470613 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.470499    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d1e9672f-aa23-4c1b-ad67-e01f2ae0b993-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1e9672f-aa23-4c1b-ad67-e01f2ae0b993-plugins-config-volume\") pod \"d1e9672f-aa23-4c1b-ad67-e01f2ae0b993\" (UID: \"d1e9672f-aa23-4c1b-ad67-e01f2ae0b993\") "
Nov 04 03:37:22.470871 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.470854    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v2dqt\" (UniqueName: \"kubernetes.io/projected/a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443-kube-api-access-v2dqt\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:37:22.470949 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.470877    4510 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443-plugins-config-volume\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:37:22.470949 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.470914    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1e9672f-aa23-4c1b-ad67-e01f2ae0b993-plugins-config-volume" pod "d1e9672f-aa23-4c1b-ad67-e01f2ae0b993" (UID: "d1e9672f-aa23-4c1b-ad67-e01f2ae0b993"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:37:22.472582 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.472554    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1e9672f-aa23-4c1b-ad67-e01f2ae0b993-kube-api-access-dt2ch" pod "d1e9672f-aa23-4c1b-ad67-e01f2ae0b993" (UID: "d1e9672f-aa23-4c1b-ad67-e01f2ae0b993"). InnerVolumeSpecName "kube-api-access-dt2ch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:37:22.573768 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.572459    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt2ch\" (UniqueName: \"kubernetes.io/projected/d1e9672f-aa23-4c1b-ad67-e01f2ae0b993-kube-api-access-dt2ch\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:37:22.573768 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.572501    4510 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d1e9672f-aa23-4c1b-ad67-e01f2ae0b993-plugins-config-volume\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:37:22.598744 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.598713    4510 generic.go:356] "Generic (PLEG): container finished" podID="a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443" containerID="9aef7c5b814b4d1859036b82e547336e306e190c0615c473e7b2fbb2ff65fcb4" exitCode=0
Nov 04 03:37:22.598921 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.598766    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t"
Nov 04 03:37:22.598921 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.598799    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t" event={"ID":"a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443","Type":"ContainerDied","Data":"9aef7c5b814b4d1859036b82e547336e306e190c0615c473e7b2fbb2ff65fcb4"}
Nov 04 03:37:22.598921 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.598894    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t" event={"ID":"a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443","Type":"ContainerDied","Data":"8df3f9637e2484bc7704c3b00f3108f10b14e0f31e1577a9f41e2237ac236766"}
Nov 04 03:37:22.599080 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.598930    4510 scope.go:122] "RemoveContainer" containerID="9aef7c5b814b4d1859036b82e547336e306e190c0615c473e7b2fbb2ff65fcb4"
Nov 04 03:37:22.600955 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.600928    4510 generic.go:356] "Generic (PLEG): container finished" podID="d1e9672f-aa23-4c1b-ad67-e01f2ae0b993" containerID="b5c96147174ee7f4ff82e5f24d6441f0dc29bb9a0c837b0cd00a744b2e746489" exitCode=0
Nov 04 03:37:22.601082 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.600974    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4"
Nov 04 03:37:22.601082 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.601010    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4" event={"ID":"d1e9672f-aa23-4c1b-ad67-e01f2ae0b993","Type":"ContainerDied","Data":"b5c96147174ee7f4ff82e5f24d6441f0dc29bb9a0c837b0cd00a744b2e746489"}
Nov 04 03:37:22.601082 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.601070    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4" event={"ID":"d1e9672f-aa23-4c1b-ad67-e01f2ae0b993","Type":"ContainerDied","Data":"c58d2ac30e09bd1cb5d3cca975a71155f4a56978eec5b7363e16d93069dcbbeb"}
Nov 04 03:37:22.612365 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.612346    4510 scope.go:122] "RemoveContainer" containerID="9aef7c5b814b4d1859036b82e547336e306e190c0615c473e7b2fbb2ff65fcb4"
Nov 04 03:37:22.612745 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:22.612722    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9aef7c5b814b4d1859036b82e547336e306e190c0615c473e7b2fbb2ff65fcb4\": container with ID starting with 9aef7c5b814b4d1859036b82e547336e306e190c0615c473e7b2fbb2ff65fcb4 not found: ID does not exist" containerID="9aef7c5b814b4d1859036b82e547336e306e190c0615c473e7b2fbb2ff65fcb4"
Nov 04 03:37:22.612841 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.612750    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9aef7c5b814b4d1859036b82e547336e306e190c0615c473e7b2fbb2ff65fcb4"} err="failed to get container status \"9aef7c5b814b4d1859036b82e547336e306e190c0615c473e7b2fbb2ff65fcb4\": rpc error: code = NotFound desc = could not find container \"9aef7c5b814b4d1859036b82e547336e306e190c0615c473e7b2fbb2ff65fcb4\": container with ID starting with 9aef7c5b814b4d1859036b82e547336e306e190c0615c473e7b2fbb2ff65fcb4 not found: ID does not exist"
Nov 04 03:37:22.612841 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.612767    4510 scope.go:122] "RemoveContainer" containerID="b5c96147174ee7f4ff82e5f24d6441f0dc29bb9a0c837b0cd00a744b2e746489"
Nov 04 03:37:22.621389 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.621368    4510 scope.go:122] "RemoveContainer" containerID="b5c96147174ee7f4ff82e5f24d6441f0dc29bb9a0c837b0cd00a744b2e746489"
Nov 04 03:37:22.621669 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:22.621652    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5c96147174ee7f4ff82e5f24d6441f0dc29bb9a0c837b0cd00a744b2e746489\": container with ID starting with b5c96147174ee7f4ff82e5f24d6441f0dc29bb9a0c837b0cd00a744b2e746489 not found: ID does not exist" containerID="b5c96147174ee7f4ff82e5f24d6441f0dc29bb9a0c837b0cd00a744b2e746489"
Nov 04 03:37:22.621762 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.621676    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5c96147174ee7f4ff82e5f24d6441f0dc29bb9a0c837b0cd00a744b2e746489"} err="failed to get container status \"b5c96147174ee7f4ff82e5f24d6441f0dc29bb9a0c837b0cd00a744b2e746489\": rpc error: code = NotFound desc = could not find container \"b5c96147174ee7f4ff82e5f24d6441f0dc29bb9a0c837b0cd00a744b2e746489\": container with ID starting with b5c96147174ee7f4ff82e5f24d6441f0dc29bb9a0c837b0cd00a744b2e746489 not found: ID does not exist"
Nov 04 03:37:22.765007 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.764975    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4"]
Nov 04 03:37:22.773674 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.773644    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-36ccd3-85c988f879-znrw4"]
Nov 04 03:37:22.864015 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.863945    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d1e9672f-aa23-4c1b-ad67-e01f2ae0b993" path="/var/lib/kubelet/pods/d1e9672f-aa23-4c1b-ad67-e01f2ae0b993/volumes"
Nov 04 03:37:22.876405 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:22.876338    4510 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-bd5d7d46b00c: secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:22.876405 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:22.876370    4510 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6: secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:22.876612 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:22.876452    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials podName:a8307d11-d8a0-49c1-b3eb-d6b238871f5c nodeName:}" failed. No retries permitted until 2026-11-04 03:37:23.376432019 +0000 UTC m=+1218.640306321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials") pod "payload-processing-external-model-86b659c8d5-hjmv6" (UID: "a8307d11-d8a0-49c1-b3eb-d6b238871f5c") : secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:22.884044 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.884019    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t"]
Nov 04 03:37:22.890235 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:22.890212    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-36ccd3-8554878c58-n9m9t"]
Nov 04 03:37:23.287767 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.287732    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"]
Nov 04 03:37:23.288195 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.288172    4510 cpu_manager.go:414] "containerMap: removing container" podUID="d1e9672f-aa23-4c1b-ad67-e01f2ae0b993" containerName="payload-pre-processing"
Nov 04 03:37:23.288195 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.288184    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d1e9672f-aa23-4c1b-ad67-e01f2ae0b993" containerName="payload-pre-processing"
Nov 04 03:37:23.288266 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.288212    4510 cpu_manager.go:414] "containerMap: removing container" podUID="0431ba98-4ab2-4820-867c-fead8f7f5fc9" containerName="main"
Nov 04 03:37:23.288266 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.288217    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0431ba98-4ab2-4820-867c-fead8f7f5fc9" containerName="main"
Nov 04 03:37:23.288266 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.288223    4510 cpu_manager.go:414] "containerMap: removing container" podUID="b9de2297-f797-4439-9e0e-2f5555ef676d" containerName="main"
Nov 04 03:37:23.288266 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.288227    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b9de2297-f797-4439-9e0e-2f5555ef676d" containerName="main"
Nov 04 03:37:23.288266 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.288239    4510 cpu_manager.go:414] "containerMap: removing container" podUID="a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443" containerName="payload-processing"
Nov 04 03:37:23.288266 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.288244    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443" containerName="payload-processing"
Nov 04 03:37:23.288455 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.288314    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="0431ba98-4ab2-4820-867c-fead8f7f5fc9" containerName="main"
Nov 04 03:37:23.288455 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.288322    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="b9de2297-f797-4439-9e0e-2f5555ef676d" containerName="main"
Nov 04 03:37:23.288455 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.288330    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443" containerName="payload-processing"
Nov 04 03:37:23.288455 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.288336    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="d1e9672f-aa23-4c1b-ad67-e01f2ae0b993" containerName="payload-pre-processing"
Nov 04 03:37:23.292807 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.292784    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.318162 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.318136    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"]
Nov 04 03:37:23.319775 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:23.319738    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:37:23.321998 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.321978    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.380025 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.379991    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce520f3c-5385-4894-801d-d63a326ec3f5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.380213 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.380037    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.380213 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.380058    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.380213 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.380143    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w88br\" (UniqueName: \"kubernetes.io/projected/ce520f3c-5385-4894-801d-d63a326ec3f5-kube-api-access-w88br\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.380360 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.380246    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.380360 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.380266    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.380360 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.380287    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.380360 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.380308    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.380360 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:23.380323    4510 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-bd5d7d46b00c: secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:23.380360 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:23.380344    4510 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6: secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:23.380562 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:23.380412    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials podName:a8307d11-d8a0-49c1-b3eb-d6b238871f5c nodeName:}" failed. No retries permitted until 2026-11-04 03:37:24.380395947 +0000 UTC m=+1219.644270233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials") pod "payload-processing-external-model-86b659c8d5-hjmv6" (UID: "a8307d11-d8a0-49c1-b3eb-d6b238871f5c") : secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:23.380562 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.380471    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nmlnb\" (UniqueName: \"kubernetes.io/projected/c999ed6d-66f4-4695-bf7a-bc63f68c466b-kube-api-access-nmlnb\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.380562 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.380494    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.380562 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.380515    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.380562 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.380536    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.380824 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.380617    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.380824 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.380743    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.380824 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.380797    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.380951 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.380830    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.380951 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.380873    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.380951 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.380938    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.395314 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.395282    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"]
Nov 04 03:37:23.446731 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.446694    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"]
Nov 04 03:37:23.481753 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.481713    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.481939 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.481786    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nmlnb\" (UniqueName: \"kubernetes.io/projected/c999ed6d-66f4-4695-bf7a-bc63f68c466b-kube-api-access-nmlnb\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.481939 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.481819    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.481939 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.481838    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.482119 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.481981    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.482119 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482027    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.482119 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482069    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.482119 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482106    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.482319 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482131    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.482319 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482144    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.482319 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482172    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.482319 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482212    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.482319 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482272    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce520f3c-5385-4894-801d-d63a326ec3f5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.482579 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482333    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.482579 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482367    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.482579 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482369    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.482579 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482392    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w88br\" (UniqueName: \"kubernetes.io/projected/ce520f3c-5385-4894-801d-d63a326ec3f5-kube-api-access-w88br\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.482579 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482455    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.482579 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482475    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.482579 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482502    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.482579 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482541    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.483191 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482711    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.483191 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482888    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.483191 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.482985    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce520f3c-5385-4894-801d-d63a326ec3f5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.483719 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.483461    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.483719 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.483667    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.483931 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.483696    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.484079 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.484056    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.484997 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.484976    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.485114 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.484980    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.485296 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.485277    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.485720 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.485669    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.543318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.543247    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.543458 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.543438    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nmlnb\" (UniqueName: \"kubernetes.io/projected/c999ed6d-66f4-4695-bf7a-bc63f68c466b-kube-api-access-nmlnb\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.551944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.551870    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-xgbfh\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.552128 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.552101    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w88br\" (UniqueName: \"kubernetes.io/projected/ce520f3c-5385-4894-801d-d63a326ec3f5-kube-api-access-w88br\") pod \"maas-default-gateway-openshift-default-6dcf757899-42zq8\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:23.606611 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.606585    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:23.635283 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:23.635243    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:24.044669 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:24.044622    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"]
Nov 04 03:37:24.046312 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:37:24.046276    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc999ed6d_66f4_4695_bf7a_bc63f68c466b.slice/crio-8cef1e8499e7d008791db36a2b16090cd0eca79453dbdfcafdb64c2540d345ff WatchSource:0}: Error finding container 8cef1e8499e7d008791db36a2b16090cd0eca79453dbdfcafdb64c2540d345ff: Status 404 returned error can't find the container with id 8cef1e8499e7d008791db36a2b16090cd0eca79453dbdfcafdb64c2540d345ff
Nov 04 03:37:24.047422 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:37:24.047397    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce520f3c_5385_4894_801d_d63a326ec3f5.slice/crio-fbee21eda1609695554ca84a2133ce3058c02eeb5e9a937ee1d1d50b7b177ae9 WatchSource:0}: Error finding container fbee21eda1609695554ca84a2133ce3058c02eeb5e9a937ee1d1d50b7b177ae9: Status 404 returned error can't find the container with id fbee21eda1609695554ca84a2133ce3058c02eeb5e9a937ee1d1d50b7b177ae9
Nov 04 03:37:24.048813 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:24.048794    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"]
Nov 04 03:37:24.048979 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:24.048948    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:37:24.049058 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:24.049026    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:37:24.049113 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:24.049075    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:37:24.050249 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:24.050222    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:37:24.050328 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:24.050313    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:37:24.050367 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:24.050356    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:37:24.403028 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:24.402925    4510 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-bd5d7d46b00c: secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:24.403028 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:24.402969    4510 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6: secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:24.403567 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:24.403036    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials podName:a8307d11-d8a0-49c1-b3eb-d6b238871f5c nodeName:}" failed. No retries permitted until 2026-11-04 03:37:26.403016144 +0000 UTC m=+1221.666890438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials") pod "payload-processing-external-model-86b659c8d5-hjmv6" (UID: "a8307d11-d8a0-49c1-b3eb-d6b238871f5c") : secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:24.620710 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:24.620230    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh" event={"ID":"c999ed6d-66f4-4695-bf7a-bc63f68c466b","Type":"ContainerStarted","Data":"239e0b1cdbf620e232afa316873dda0bc5b87d38d00ce16abff7695c27894ef5"}
Nov 04 03:37:24.620710 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:24.620331    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh" event={"ID":"c999ed6d-66f4-4695-bf7a-bc63f68c466b","Type":"ContainerStarted","Data":"8cef1e8499e7d008791db36a2b16090cd0eca79453dbdfcafdb64c2540d345ff"}
Nov 04 03:37:24.625371 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:24.625337    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8" event={"ID":"ce520f3c-5385-4894-801d-d63a326ec3f5","Type":"ContainerStarted","Data":"f8d22bb3aa4058e0d4afbb9561c5a79d63a2029d0724d8ce1adc92a9e1a5a32a"}
Nov 04 03:37:24.625616 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:24.625602    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8" event={"ID":"ce520f3c-5385-4894-801d-d63a326ec3f5","Type":"ContainerStarted","Data":"fbee21eda1609695554ca84a2133ce3058c02eeb5e9a937ee1d1d50b7b177ae9"}
Nov 04 03:37:24.646830 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:24.646791    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:24.863310 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:24.863278    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443" path="/var/lib/kubelet/pods/a7a3ce8c-36c4-4e7e-8bd0-8f9fb1c2f443/volumes"
Nov 04 03:37:24.886730 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:24.886172    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8" podStartSLOduration=1.886157512 podStartE2EDuration="1.886157512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:37:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:37:24.883818248 +0000 UTC m=+1220.147692555" watchObservedRunningTime="2026-11-04 03:37:24.886157512 +0000 UTC m=+1220.150031819"
Nov 04 03:37:24.886897 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:24.886824    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh" podStartSLOduration=1.886813563 podStartE2EDuration="1.886813563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:37:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:37:24.744993536 +0000 UTC m=+1220.008867844" watchObservedRunningTime="2026-11-04 03:37:24.886813563 +0000 UTC m=+1220.150687870"
Nov 04 03:37:25.607112 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:25.607077    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:25.613021 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:25.612990    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-xgbfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 03:37:25.613267 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:25.613243    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh" podUID="c999ed6d-66f4-4695-bf7a-bc63f68c466b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 03:37:25.639603 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:25.639563    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-42zq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 03:37:25.639951 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:25.639906    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8" podUID="ce520f3c-5385-4894-801d-d63a326ec3f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 03:37:26.462302 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:26.462274    4510 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-bd5d7d46b00c: secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:26.462302 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:26.462304    4510 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6: secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:26.462540 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:26.462347    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials podName:a8307d11-d8a0-49c1-b3eb-d6b238871f5c nodeName:}" failed. No retries permitted until 2026-11-04 03:37:30.462334713 +0000 UTC m=+1225.726209011 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials") pod "payload-processing-external-model-86b659c8d5-hjmv6" (UID: "a8307d11-d8a0-49c1-b3eb-d6b238871f5c") : secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:26.560241 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:26.560204    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"
Nov 04 03:37:26.608708 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:26.608153    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-xgbfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 03:37:26.608708 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:26.608227    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh" podUID="c999ed6d-66f4-4695-bf7a-bc63f68c466b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 03:37:26.643703 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:26.639086    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-42zq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 03:37:26.643703 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:26.639150    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8" podUID="ce520f3c-5385-4894-801d-d63a326ec3f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 03:37:27.611714 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:27.611079    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-xgbfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 03:37:27.611714 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:27.611154    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh" podUID="c999ed6d-66f4-4695-bf7a-bc63f68c466b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 03:37:27.641707 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:27.639756    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-42zq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 03:37:27.641707 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:27.639812    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8" podUID="ce520f3c-5385-4894-801d-d63a326ec3f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 03:37:28.614707 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:28.607133    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-xgbfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 03:37:28.614707 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:28.607216    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh" podUID="c999ed6d-66f4-4695-bf7a-bc63f68c466b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 03:37:28.645707 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:28.639222    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-42zq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 03:37:28.645707 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:28.639296    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8" podUID="ce520f3c-5385-4894-801d-d63a326ec3f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 03:37:29.611708 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:29.610069    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-xgbfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 03:37:29.611708 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:29.610133    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh" podUID="c999ed6d-66f4-4695-bf7a-bc63f68c466b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 03:37:29.639716 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:29.639126    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-42zq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 03:37:29.639716 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:29.639188    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8" podUID="ce520f3c-5385-4894-801d-d63a326ec3f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 03:37:30.531443 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:30.530923    4510 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-bd5d7d46b00c: secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:30.531443 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:30.530963    4510 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6: secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:30.531443 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:30.531047    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials podName:a8307d11-d8a0-49c1-b3eb-d6b238871f5c nodeName:}" failed. No retries permitted until 2026-11-04 03:37:38.531025438 +0000 UTC m=+1233.794899737 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials") pod "payload-processing-external-model-86b659c8d5-hjmv6" (UID: "a8307d11-d8a0-49c1-b3eb-d6b238871f5c") : secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:30.607620 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:30.607577    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-xgbfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 03:37:30.607826 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:30.607640    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh" podUID="c999ed6d-66f4-4695-bf7a-bc63f68c466b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 03:37:30.636258 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:30.636220    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-42zq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 03:37:30.636470 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:30.636280    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8" podUID="ce520f3c-5385-4894-801d-d63a326ec3f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 03:37:31.607192 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:31.607158    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-xgbfh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 03:37:31.607753 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:31.607221    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh" podUID="c999ed6d-66f4-4695-bf7a-bc63f68c466b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 03:37:31.636489 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:31.636455    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-42zq8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 03:37:31.636671 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:31.636509    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8" podUID="ce520f3c-5385-4894-801d-d63a326ec3f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 03:37:33.382385 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:33.382351    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:33.383068 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:33.382788    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:33.390184 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:33.390152    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:37:33.527343 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:33.527306    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:33.527837 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:33.527799    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:33.528996 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:33.528977    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:37:38.540632 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:38.540599    4510 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-bd5d7d46b00c: secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:38.540632 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:38.540629    4510 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6: secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:38.541089 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:38.540712    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials podName:a8307d11-d8a0-49c1-b3eb-d6b238871f5c nodeName:}" failed. No retries permitted until 2026-11-04 03:37:54.540669179 +0000 UTC m=+1249.804543463 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials") pod "payload-processing-external-model-86b659c8d5-hjmv6" (UID: "a8307d11-d8a0-49c1-b3eb-d6b238871f5c") : secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:43.183368 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:43.183334    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"]
Nov 04 03:37:43.188664 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:43.188639    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:37:43.290033 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:43.289989    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78da5e30-34cb-416c-93dd-00ce41a38bcf-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst\" (UID: \"78da5e30-34cb-416c-93dd-00ce41a38bcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:37:43.290245 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:43.290045    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnp82\" (UniqueName: \"kubernetes.io/projected/78da5e30-34cb-416c-93dd-00ce41a38bcf-kube-api-access-jnp82\") pod \"maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst\" (UID: \"78da5e30-34cb-416c-93dd-00ce41a38bcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:37:43.290245 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:43.290166    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78da5e30-34cb-416c-93dd-00ce41a38bcf-maas-api-tls\") pod \"maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst\" (UID: \"78da5e30-34cb-416c-93dd-00ce41a38bcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:37:43.290366 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:43.290297    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78da5e30-34cb-416c-93dd-00ce41a38bcf-metrics-certs\") pod \"maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst\" (UID: \"78da5e30-34cb-416c-93dd-00ce41a38bcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:37:43.292968 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:43.292930    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-extmod-b-5d459a-serving-cert\""
Nov 04 03:37:43.295851 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:43.295830    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"]
Nov 04 03:37:43.391483 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:43.391444    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78da5e30-34cb-416c-93dd-00ce41a38bcf-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst\" (UID: \"78da5e30-34cb-416c-93dd-00ce41a38bcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:37:43.391483 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:43.391489    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnp82\" (UniqueName: \"kubernetes.io/projected/78da5e30-34cb-416c-93dd-00ce41a38bcf-kube-api-access-jnp82\") pod \"maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst\" (UID: \"78da5e30-34cb-416c-93dd-00ce41a38bcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:37:43.391782 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:43.391526    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78da5e30-34cb-416c-93dd-00ce41a38bcf-maas-api-tls\") pod \"maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst\" (UID: \"78da5e30-34cb-416c-93dd-00ce41a38bcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:37:43.391782 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:43.391606    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78da5e30-34cb-416c-93dd-00ce41a38bcf-metrics-certs\") pod \"maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst\" (UID: \"78da5e30-34cb-416c-93dd-00ce41a38bcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:37:43.391782 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:43.391756    4510 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-serving-cert: secret "maas-api-e2e-extmod-b-5d459a-serving-cert" not found
Nov 04 03:37:43.391959 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:43.391852    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/78da5e30-34cb-416c-93dd-00ce41a38bcf-maas-api-tls podName:78da5e30-34cb-416c-93dd-00ce41a38bcf nodeName:}" failed. No retries permitted until 2026-11-04 03:37:43.891832097 +0000 UTC m=+1239.155706382 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/78da5e30-34cb-416c-93dd-00ce41a38bcf-maas-api-tls") pod "maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst" (UID: "78da5e30-34cb-416c-93dd-00ce41a38bcf") : secret "maas-api-e2e-extmod-b-5d459a-serving-cert" not found
Nov 04 03:37:43.392238 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:43.392216    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78da5e30-34cb-416c-93dd-00ce41a38bcf-openshift-service-ca\") pod \"maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst\" (UID: \"78da5e30-34cb-416c-93dd-00ce41a38bcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:37:43.394299 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:43.394279    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78da5e30-34cb-416c-93dd-00ce41a38bcf-metrics-certs\") pod \"maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst\" (UID: \"78da5e30-34cb-416c-93dd-00ce41a38bcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:37:43.453857 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:43.453770    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnp82\" (UniqueName: \"kubernetes.io/projected/78da5e30-34cb-416c-93dd-00ce41a38bcf-kube-api-access-jnp82\") pod \"maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst\" (UID: \"78da5e30-34cb-416c-93dd-00ce41a38bcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:37:43.896363 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:43.896315    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78da5e30-34cb-416c-93dd-00ce41a38bcf-maas-api-tls\") pod \"maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst\" (UID: \"78da5e30-34cb-416c-93dd-00ce41a38bcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:37:43.899075 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:43.899046    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78da5e30-34cb-416c-93dd-00ce41a38bcf-maas-api-tls\") pod \"maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst\" (UID: \"78da5e30-34cb-416c-93dd-00ce41a38bcf\") " pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:37:44.103014 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:44.102976    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:37:44.487906 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:44.487879    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"]
Nov 04 03:37:44.489615 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:37:44.489590    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78da5e30_34cb_416c_93dd_00ce41a38bcf.slice/crio-3c82dd10d88709891f8b859a005a618eb4e623a3b311e00a133b191c7905dfbe WatchSource:0}: Error finding container 3c82dd10d88709891f8b859a005a618eb4e623a3b311e00a133b191c7905dfbe: Status 404 returned error can't find the container with id 3c82dd10d88709891f8b859a005a618eb4e623a3b311e00a133b191c7905dfbe
Nov 04 03:37:44.491775 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:44.491757    4510 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 03:37:44.784191 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:44.784096    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst" event={"ID":"78da5e30-34cb-416c-93dd-00ce41a38bcf","Type":"ContainerStarted","Data":"3c82dd10d88709891f8b859a005a618eb4e623a3b311e00a133b191c7905dfbe"}
Nov 04 03:37:45.791378 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:45.791289    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst" event={"ID":"78da5e30-34cb-416c-93dd-00ce41a38bcf","Type":"ContainerStarted","Data":"2dd8ef95e53a328324f90a1404477fa8ae435a31972b0438ae0bfd182c8625c6"}
Nov 04 03:37:45.791378 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:45.791352    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:37:45.909938 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:45.909885    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst" podStartSLOduration=1.903847693 podStartE2EDuration="2.909869089s" totalImagesPullingTime="1.006021396s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:37:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:37:45.909276627 +0000 UTC m=+1241.173150935" watchObservedRunningTime="2026-11-04 03:37:45.909869089 +0000 UTC m=+1241.173743425"
Nov 04 03:37:51.803789 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:51.803757    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:37:53.321884 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:53.321834    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:37:54.628626 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:54.628594    4510 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-bd5d7d46b00c: secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:54.628626 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:54.628624    4510 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6: secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:54.629080 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:37:54.628707    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials podName:a8307d11-d8a0-49c1-b3eb-d6b238871f5c nodeName:}" failed. No retries permitted until 2026-11-04 03:38:26.628672982 +0000 UTC m=+1281.892547280 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials") pod "payload-processing-external-model-86b659c8d5-hjmv6" (UID: "a8307d11-d8a0-49c1-b3eb-d6b238871f5c") : secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:37:54.823259 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:54.823228    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"]
Nov 04 03:37:54.827106 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:54.827080    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:54.879910 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:54.879842    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-36ccd3-openshift-default-dockercfg-n5hpn\""
Nov 04 03:37:54.932404 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:54.932353    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-token\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:54.932585 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:54.932409    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-podinfo\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:54.932585 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:54.932491    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-credential-socket\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:54.932585 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:54.932552    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b73b78e7-78dc-44b0-8567-ebdb30939c29-istiod-ca-cert\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:54.932784 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:54.932609    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwkcz\" (UniqueName: \"kubernetes.io/projected/b73b78e7-78dc-44b0-8567-ebdb30939c29-kube-api-access-kwkcz\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:54.932784 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:54.932665    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-envoy\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:54.932784 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:54.932716    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-workload-socket\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:54.932944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:54.932827    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-data\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:54.932944 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:54.932872    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-workload-certs\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:54.933675 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:54.933650    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"]
Nov 04 03:37:55.034192 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.034155    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b73b78e7-78dc-44b0-8567-ebdb30939c29-istiod-ca-cert\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.034395 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.034201    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwkcz\" (UniqueName: \"kubernetes.io/projected/b73b78e7-78dc-44b0-8567-ebdb30939c29-kube-api-access-kwkcz\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.034395 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.034245    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-envoy\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.034395 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.034288    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-workload-socket\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.034395 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.034366    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-data\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.034628 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.034404    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-workload-certs\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.034628 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.034545    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-token\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.034628 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.034582    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-podinfo\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.034628 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.034621    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-credential-socket\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.034894 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.034787    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-workload-socket\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.034894 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.034839    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-workload-certs\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.035005 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.034912    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-data\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.035070 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.035003    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b73b78e7-78dc-44b0-8567-ebdb30939c29-istiod-ca-cert\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.035126 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.035089    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-credential-socket\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.036717 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.036674    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-envoy\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.037150 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.037133    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-podinfo\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.099283 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.099253    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-token\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.099500 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.099481    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwkcz\" (UniqueName: \"kubernetes.io/projected/b73b78e7-78dc-44b0-8567-ebdb30939c29-kube-api-access-kwkcz\") pod \"e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") " pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.140532 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.140448    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:55.581036 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.581003    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"]
Nov 04 03:37:55.582389 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:37:55.582360    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb73b78e7_78dc_44b0_8567_ebdb30939c29.slice/crio-4f45b838de5242009656bc3c89164b4abe5e45fe3140f804bbf257b17c883ce9 WatchSource:0}: Error finding container 4f45b838de5242009656bc3c89164b4abe5e45fe3140f804bbf257b17c883ce9: Status 404 returned error can't find the container with id 4f45b838de5242009656bc3c89164b4abe5e45fe3140f804bbf257b17c883ce9
Nov 04 03:37:55.585100 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.585067    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:37:55.585185 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.585149    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:37:55.585233 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.585194    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:37:55.865764 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.865487    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6" event={"ID":"b73b78e7-78dc-44b0-8567-ebdb30939c29","Type":"ContainerStarted","Data":"dc221f42c78d19fa25a86846884eba219bbdb888e5afc550638c923fe0a8720e"}
Nov 04 03:37:55.865764 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.865550    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6" event={"ID":"b73b78e7-78dc-44b0-8567-ebdb30939c29","Type":"ContainerStarted","Data":"4f45b838de5242009656bc3c89164b4abe5e45fe3140f804bbf257b17c883ce9"}
Nov 04 03:37:55.990708 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:55.990183    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6" podStartSLOduration=1.990168267 podStartE2EDuration="1.990168267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:37:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:37:55.986259032 +0000 UTC m=+1251.250133339" watchObservedRunningTime="2026-11-04 03:37:55.990168267 +0000 UTC m=+1251.254042574"
Nov 04 03:37:56.141756 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:56.141544    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:37:56.142530 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:56.142497    4510 patch_prober.go:29] interesting pod/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 04 03:37:56.142665 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:56.142554    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6" podUID="b73b78e7-78dc-44b0-8567-ebdb30939c29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 04 03:37:57.164706 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:57.161186    4510 patch_prober.go:29] interesting pod/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 04 03:37:57.164706 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:57.161253    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6" podUID="b73b78e7-78dc-44b0-8567-ebdb30939c29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 04 03:37:57.876726 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:57.847791    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z" podUID="2b117874-604c-468c-817d-d479546de869" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": context deadline exceeded"
Nov 04 03:37:57.876726 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:57.848297    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk" podUID="5881ff60-a61f-416c-8034-a9991921631b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": context deadline exceeded"
Nov 04 03:37:57.988732 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:57.981185    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8" podUID="bbc02f97-cd51-49be-9dda-5c14d6beb6c6" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 03:37:58.159897 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:58.159788    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r" podUID="207320d1-fa2f-4204-805a-ec84fec16b89" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 03:37:58.161543 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:58.161514    4510 patch_prober.go:29] interesting pod/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 04 03:37:58.161772 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:58.161748    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6" podUID="b73b78e7-78dc-44b0-8567-ebdb30939c29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 04 03:37:58.380510 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:58.379489    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq" podUID="b7e091e0-5112-49c2-8801-d0c6a46e8e01" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 03:37:58.406201 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:58.406081    4510 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f" podUID="dd9ea1b1-0b00-4c30-a4d5-e2de30e12496" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 03:37:58.443272 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:58.442361    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f" podUID="dd9ea1b1-0b00-4c30-a4d5-e2de30e12496" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 03:37:58.494653 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:58.493836    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs" podUID="ba15e83e-3b7c-4f87-9513-dad698c4147b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 03:37:58.866709 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:58.851764    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk" podUID="5881ff60-a61f-416c-8034-a9991921631b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 03:37:58.866709 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:58.852158    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z" podUID="2b117874-604c-468c-817d-d479546de869" containerName="main" probeResult="failure" output="Get \"https://10.133.0.64:8000/ready\": context deadline exceeded"
Nov 04 03:37:58.866709 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:58.852660    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:37:58.866709 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:58.852744    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:37:58.944708 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:58.925006    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mpwlf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 03:37:58.944708 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:58.925066    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf" podUID="85cb4aab-7613-481a-af4c-228be87df8c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 03:37:58.985713 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:58.981575    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8" podUID="bbc02f97-cd51-49be-9dda-5c14d6beb6c6" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 03:37:58.989708 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:58.988849    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:37:59.211775 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:59.162089    4510 patch_prober.go:29] interesting pod/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 04 03:37:59.211775 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:59.162164    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6" podUID="b73b78e7-78dc-44b0-8567-ebdb30939c29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 04 03:37:59.211775 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:59.169473    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r" podUID="207320d1-fa2f-4204-805a-ec84fec16b89" containerName="main" probeResult="failure" output="Get \"https://10.133.0.55:8000/ready\": context deadline exceeded"
Nov 04 03:37:59.211775 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:59.169862    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:37:59.379862 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:59.379823    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq" podUID="b7e091e0-5112-49c2-8801-d0c6a46e8e01" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 03:37:59.388722 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:59.385390    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:37:59.390320 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:59.390301    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:37:59.449208 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:59.447988    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f" podUID="dd9ea1b1-0b00-4c30-a4d5-e2de30e12496" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 03:37:59.449208 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:59.448399    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:37:59.477883 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:59.477841    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:37:59.503728 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:59.498162    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs" podUID="ba15e83e-3b7c-4f87-9513-dad698c4147b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": context deadline exceeded"
Nov 04 03:37:59.503728 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:59.498542    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:37:59.567709 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:59.563492    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:37:59.582373 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:59.582241    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:37:59.589198 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:59.589169    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:37:59.764753 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:59.762348    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:37:59.781696 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:37:59.780569    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:38:00.142918 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:00.142781    4510 patch_prober.go:29] interesting pod/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 04 03:38:00.142918 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:00.142890    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6" podUID="b73b78e7-78dc-44b0-8567-ebdb30939c29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 04 03:38:01.141252 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:01.141216    4510 patch_prober.go:29] interesting pod/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 04 03:38:01.141773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:01.141279    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6" podUID="b73b78e7-78dc-44b0-8567-ebdb30939c29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 04 03:38:02.141175 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:02.141141    4510 patch_prober.go:29] interesting pod/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 04 03:38:02.141379 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:02.141209    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6" podUID="b73b78e7-78dc-44b0-8567-ebdb30939c29" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 04 03:38:03.145597 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:03.145566    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:38:03.146102 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:03.145952    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:38:03.146525 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:03.146505    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:38:08.957010 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:08.956969    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"]
Nov 04 03:38:08.957922 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:08.957871    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6" podUID="b73b78e7-78dc-44b0-8567-ebdb30939c29" containerName="istio-proxy" containerID="cri-o://dc221f42c78d19fa25a86846884eba219bbdb888e5afc550638c923fe0a8720e" gracePeriod=30
Nov 04 03:38:14.220473 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.220415    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:38:14.266607 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.266581    4510 generic.go:356] "Generic (PLEG): container finished" podID="b73b78e7-78dc-44b0-8567-ebdb30939c29" containerID="dc221f42c78d19fa25a86846884eba219bbdb888e5afc550638c923fe0a8720e" exitCode=0
Nov 04 03:38:14.266803 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.266665    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6" event={"ID":"b73b78e7-78dc-44b0-8567-ebdb30939c29","Type":"ContainerDied","Data":"dc221f42c78d19fa25a86846884eba219bbdb888e5afc550638c923fe0a8720e"}
Nov 04 03:38:14.266803 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.266719    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"
Nov 04 03:38:14.266803 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.266730    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6" event={"ID":"b73b78e7-78dc-44b0-8567-ebdb30939c29","Type":"ContainerDied","Data":"4f45b838de5242009656bc3c89164b4abe5e45fe3140f804bbf257b17c883ce9"}
Nov 04 03:38:14.266803 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.266755    4510 scope.go:122] "RemoveContainer" containerID="dc221f42c78d19fa25a86846884eba219bbdb888e5afc550638c923fe0a8720e"
Nov 04 03:38:14.276288 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.276259    4510 scope.go:122] "RemoveContainer" containerID="dc221f42c78d19fa25a86846884eba219bbdb888e5afc550638c923fe0a8720e"
Nov 04 03:38:14.276558 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:38:14.276540    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc221f42c78d19fa25a86846884eba219bbdb888e5afc550638c923fe0a8720e\": container with ID starting with dc221f42c78d19fa25a86846884eba219bbdb888e5afc550638c923fe0a8720e not found: ID does not exist" containerID="dc221f42c78d19fa25a86846884eba219bbdb888e5afc550638c923fe0a8720e"
Nov 04 03:38:14.276610 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.276565    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc221f42c78d19fa25a86846884eba219bbdb888e5afc550638c923fe0a8720e"} err="failed to get container status \"dc221f42c78d19fa25a86846884eba219bbdb888e5afc550638c923fe0a8720e\": rpc error: code = NotFound desc = could not find container \"dc221f42c78d19fa25a86846884eba219bbdb888e5afc550638c923fe0a8720e\": container with ID starting with dc221f42c78d19fa25a86846884eba219bbdb888e5afc550638c923fe0a8720e not found: ID does not exist"
Nov 04 03:38:14.332248 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.332228    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-token\" (UniqueName: \"kubernetes.io/projected/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-token\") pod \"b73b78e7-78dc-44b0-8567-ebdb30939c29\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") "
Nov 04 03:38:14.332361 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.332264    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b73b78e7-78dc-44b0-8567-ebdb30939c29-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b73b78e7-78dc-44b0-8567-ebdb30939c29-istiod-ca-cert\") pod \"b73b78e7-78dc-44b0-8567-ebdb30939c29\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") "
Nov 04 03:38:14.332361 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.332315    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-envoy\") pod \"b73b78e7-78dc-44b0-8567-ebdb30939c29\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") "
Nov 04 03:38:14.332478 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.332421    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-podinfo\") pod \"b73b78e7-78dc-44b0-8567-ebdb30939c29\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") "
Nov 04 03:38:14.332478 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.332462    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b73b78e7-78dc-44b0-8567-ebdb30939c29-kube-api-access-kwkcz\" (UniqueName: \"kubernetes.io/projected/b73b78e7-78dc-44b0-8567-ebdb30939c29-kube-api-access-kwkcz\") pod \"b73b78e7-78dc-44b0-8567-ebdb30939c29\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") "
Nov 04 03:38:14.332583 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.332505    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-data\") pod \"b73b78e7-78dc-44b0-8567-ebdb30939c29\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") "
Nov 04 03:38:14.332661 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.332641    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-workload-certs\") pod \"b73b78e7-78dc-44b0-8567-ebdb30939c29\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") "
Nov 04 03:38:14.332757 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.332718    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-credential-socket\") pod \"b73b78e7-78dc-44b0-8567-ebdb30939c29\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") "
Nov 04 03:38:14.332757 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.332719    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b73b78e7-78dc-44b0-8567-ebdb30939c29-istiod-ca-cert" pod "b73b78e7-78dc-44b0-8567-ebdb30939c29" (UID: "b73b78e7-78dc-44b0-8567-ebdb30939c29"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:38:14.332757 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.332749    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-workload-socket\") pod \"b73b78e7-78dc-44b0-8567-ebdb30939c29\" (UID: \"b73b78e7-78dc-44b0-8567-ebdb30939c29\") "
Nov 04 03:38:14.332984 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.332945    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-data" pod "b73b78e7-78dc-44b0-8567-ebdb30939c29" (UID: "b73b78e7-78dc-44b0-8567-ebdb30939c29"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:38:14.332984 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.332973    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-workload-certs" pod "b73b78e7-78dc-44b0-8567-ebdb30939c29" (UID: "b73b78e7-78dc-44b0-8567-ebdb30939c29"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:38:14.333217 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.333190    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-workload-socket" pod "b73b78e7-78dc-44b0-8567-ebdb30939c29" (UID: "b73b78e7-78dc-44b0-8567-ebdb30939c29"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:38:14.333217 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.333205    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-credential-socket" pod "b73b78e7-78dc-44b0-8567-ebdb30939c29" (UID: "b73b78e7-78dc-44b0-8567-ebdb30939c29"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:38:14.333491 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.333468    4510 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-data\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:38:14.333546 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.333498    4510 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-workload-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:38:14.333546 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.333516    4510 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-credential-socket\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:38:14.333546 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.333531    4510 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-workload-socket\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:38:14.333642 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.333545    4510 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b73b78e7-78dc-44b0-8567-ebdb30939c29-istiod-ca-cert\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:38:14.334836 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.334811    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b73b78e7-78dc-44b0-8567-ebdb30939c29-kube-api-access-kwkcz" pod "b73b78e7-78dc-44b0-8567-ebdb30939c29" (UID: "b73b78e7-78dc-44b0-8567-ebdb30939c29"). InnerVolumeSpecName "kube-api-access-kwkcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:38:14.335193 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.334942    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-token" pod "b73b78e7-78dc-44b0-8567-ebdb30939c29" (UID: "b73b78e7-78dc-44b0-8567-ebdb30939c29"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:38:14.335366 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.335341    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-envoy" pod "b73b78e7-78dc-44b0-8567-ebdb30939c29" (UID: "b73b78e7-78dc-44b0-8567-ebdb30939c29"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:38:14.336056 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.336037    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-podinfo" pod "b73b78e7-78dc-44b0-8567-ebdb30939c29" (UID: "b73b78e7-78dc-44b0-8567-ebdb30939c29"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 03:38:14.434885 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.434856    4510 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-podinfo\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:38:14.434885 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.434881    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwkcz\" (UniqueName: \"kubernetes.io/projected/b73b78e7-78dc-44b0-8567-ebdb30939c29-kube-api-access-kwkcz\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:38:14.434885 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.434891    4510 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-token\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:38:14.435105 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.434901    4510 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b73b78e7-78dc-44b0-8567-ebdb30939c29-istio-envoy\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:38:14.689963 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.689932    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"]
Nov 04 03:38:14.694414 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.694389    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-36ccd3-openshift-default-f57d8465-t8xx6"]
Nov 04 03:38:14.862973 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:14.862887    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b73b78e7-78dc-44b0-8567-ebdb30939c29" path="/var/lib/kubelet/pods/b73b78e7-78dc-44b0-8567-ebdb30939c29/volumes"
Nov 04 03:38:23.318244 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:38:23.318205    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:38:26.658037 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:38:26.658007    4510 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-bd5d7d46b00c: secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:38:26.658037 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:38:26.658034    4510 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6: secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:38:26.658473 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:38:26.658093    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials podName:a8307d11-d8a0-49c1-b3eb-d6b238871f5c nodeName:}" failed. No retries permitted until 2026-11-04 03:39:30.658076706 +0000 UTC m=+1345.921951005 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials") pod "payload-processing-external-model-86b659c8d5-hjmv6" (UID: "a8307d11-d8a0-49c1-b3eb-d6b238871f5c") : secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:38:53.317478 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:38:53.317438    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:38:56.813618 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:38:56.813587    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"]
Nov 04 03:39:01.814794 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:01.814751    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56" podUID="c49160c5-aeac-464e-9a7f-8e436aa1e90e" containerName="payload-processing" containerID="cri-o://a91b183abb928da49cd24cfe4f0d517069e66ec35c1a21a2c17f44030ff2dee2" gracePeriod=25
Nov 04 03:39:02.082610 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.082548    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"
Nov 04 03:39:02.161757 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.161727    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c49160c5-aeac-464e-9a7f-8e436aa1e90e-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/c49160c5-aeac-464e-9a7f-8e436aa1e90e-routing-overlay-volume\") pod \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\" (UID: \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\") "
Nov 04 03:39:02.161907 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.161841    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c49160c5-aeac-464e-9a7f-8e436aa1e90e-provider-credentials\" (UniqueName: \"kubernetes.io/projected/c49160c5-aeac-464e-9a7f-8e436aa1e90e-provider-credentials\") pod \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\" (UID: \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\") "
Nov 04 03:39:02.161948 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.161907    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c49160c5-aeac-464e-9a7f-8e436aa1e90e-kube-api-access-7swcc\" (UniqueName: \"kubernetes.io/projected/c49160c5-aeac-464e-9a7f-8e436aa1e90e-kube-api-access-7swcc\") pod \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\" (UID: \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\") "
Nov 04 03:39:02.161988 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.161946    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c49160c5-aeac-464e-9a7f-8e436aa1e90e-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c49160c5-aeac-464e-9a7f-8e436aa1e90e-plugins-config-volume\") pod \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\" (UID: \"c49160c5-aeac-464e-9a7f-8e436aa1e90e\") "
Nov 04 03:39:02.162109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.162079    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c49160c5-aeac-464e-9a7f-8e436aa1e90e-routing-overlay-volume" pod "c49160c5-aeac-464e-9a7f-8e436aa1e90e" (UID: "c49160c5-aeac-464e-9a7f-8e436aa1e90e"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:39:02.162393 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.162370    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c49160c5-aeac-464e-9a7f-8e436aa1e90e-plugins-config-volume" pod "c49160c5-aeac-464e-9a7f-8e436aa1e90e" (UID: "c49160c5-aeac-464e-9a7f-8e436aa1e90e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:39:02.162462 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.162381    4510 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/c49160c5-aeac-464e-9a7f-8e436aa1e90e-routing-overlay-volume\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:39:02.164278 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.164245    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c49160c5-aeac-464e-9a7f-8e436aa1e90e-kube-api-access-7swcc" pod "c49160c5-aeac-464e-9a7f-8e436aa1e90e" (UID: "c49160c5-aeac-464e-9a7f-8e436aa1e90e"). InnerVolumeSpecName "kube-api-access-7swcc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:39:02.164450 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.164429    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c49160c5-aeac-464e-9a7f-8e436aa1e90e-provider-credentials" pod "c49160c5-aeac-464e-9a7f-8e436aa1e90e" (UID: "c49160c5-aeac-464e-9a7f-8e436aa1e90e"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:39:02.263386 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.263358    4510 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/c49160c5-aeac-464e-9a7f-8e436aa1e90e-provider-credentials\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:39:02.263386 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.263385    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7swcc\" (UniqueName: \"kubernetes.io/projected/c49160c5-aeac-464e-9a7f-8e436aa1e90e-kube-api-access-7swcc\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:39:02.263386 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.263394    4510 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c49160c5-aeac-464e-9a7f-8e436aa1e90e-plugins-config-volume\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:39:02.564551 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.564518    4510 generic.go:356] "Generic (PLEG): container finished" podID="c49160c5-aeac-464e-9a7f-8e436aa1e90e" containerID="a91b183abb928da49cd24cfe4f0d517069e66ec35c1a21a2c17f44030ff2dee2" exitCode=0
Nov 04 03:39:02.564741 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.564577    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"
Nov 04 03:39:02.564741 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.564598    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56" event={"ID":"c49160c5-aeac-464e-9a7f-8e436aa1e90e","Type":"ContainerDied","Data":"a91b183abb928da49cd24cfe4f0d517069e66ec35c1a21a2c17f44030ff2dee2"}
Nov 04 03:39:02.564741 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.564709    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56" event={"ID":"c49160c5-aeac-464e-9a7f-8e436aa1e90e","Type":"ContainerDied","Data":"95a1eaeccda5afebf8794ceb33df5db11f61ff032121a11223c55200dfd8d6e5"}
Nov 04 03:39:02.564741 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.564740    4510 scope.go:122] "RemoveContainer" containerID="a91b183abb928da49cd24cfe4f0d517069e66ec35c1a21a2c17f44030ff2dee2"
Nov 04 03:39:02.574991 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.574976    4510 scope.go:122] "RemoveContainer" containerID="a91b183abb928da49cd24cfe4f0d517069e66ec35c1a21a2c17f44030ff2dee2"
Nov 04 03:39:02.575244 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:39:02.575228    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a91b183abb928da49cd24cfe4f0d517069e66ec35c1a21a2c17f44030ff2dee2\": container with ID starting with a91b183abb928da49cd24cfe4f0d517069e66ec35c1a21a2c17f44030ff2dee2 not found: ID does not exist" containerID="a91b183abb928da49cd24cfe4f0d517069e66ec35c1a21a2c17f44030ff2dee2"
Nov 04 03:39:02.575291 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.575252    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91b183abb928da49cd24cfe4f0d517069e66ec35c1a21a2c17f44030ff2dee2"} err="failed to get container status \"a91b183abb928da49cd24cfe4f0d517069e66ec35c1a21a2c17f44030ff2dee2\": rpc error: code = NotFound desc = could not find container \"a91b183abb928da49cd24cfe4f0d517069e66ec35c1a21a2c17f44030ff2dee2\": container with ID starting with a91b183abb928da49cd24cfe4f0d517069e66ec35c1a21a2c17f44030ff2dee2 not found: ID does not exist"
Nov 04 03:39:02.734446 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.734408    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"]
Nov 04 03:39:02.782115 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.782074    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-extmod-b-491fe7/payload-processing-external-model-e2e-extmod-b-491fe7-59886pd56"]
Nov 04 03:39:02.863387 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:39:02.863291    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c49160c5-aeac-464e-9a7f-8e436aa1e90e" path="/var/lib/kubelet/pods/c49160c5-aeac-464e-9a7f-8e436aa1e90e/volumes"
Nov 04 03:39:23.318063 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:39:23.318023    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:39:30.678126 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:39:30.678091    4510 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-bd5d7d46b00c: secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:39:30.678126 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:39:30.678123    4510 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6: secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:39:30.678566 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:39:30.678174    4510 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials podName:a8307d11-d8a0-49c1-b3eb-d6b238871f5c nodeName:}" failed. No retries permitted until 2026-11-04 03:41:32.678160733 +0000 UTC m=+1467.942035018 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials") pod "payload-processing-external-model-86b659c8d5-hjmv6" (UID: "a8307d11-d8a0-49c1-b3eb-d6b238871f5c") : secret "agc-cred-bd5d7d46b00c" not found
Nov 04 03:39:53.322072 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:39:53.322031    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:40:23.316928 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:40:23.316845    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:40:35.874441 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:35.874402    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"]
Nov 04 03:40:40.876420 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:40.876365    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6" podUID="a8307d11-d8a0-49c1-b3eb-d6b238871f5c" containerName="payload-processing" containerID="cri-o://3e45021450aa4103372b32aed05c7dfb23b6b619e2dba74a427faf37c6ebe852" gracePeriod=25
Nov 04 03:40:41.136638 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.136577    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"
Nov 04 03:40:41.254363 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.254322    4510 generic.go:356] "Generic (PLEG): container finished" podID="a8307d11-d8a0-49c1-b3eb-d6b238871f5c" containerID="3e45021450aa4103372b32aed05c7dfb23b6b619e2dba74a427faf37c6ebe852" exitCode=0
Nov 04 03:40:41.254363 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.254367    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6" event={"ID":"a8307d11-d8a0-49c1-b3eb-d6b238871f5c","Type":"ContainerDied","Data":"3e45021450aa4103372b32aed05c7dfb23b6b619e2dba74a427faf37c6ebe852"}
Nov 04 03:40:41.254626 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.254385    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"
Nov 04 03:40:41.254626 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.254412    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6" event={"ID":"a8307d11-d8a0-49c1-b3eb-d6b238871f5c","Type":"ContainerDied","Data":"83e31b263b3a826044427de55da005309fe47cdab9106ba056fd7c670d6196cb"}
Nov 04 03:40:41.254626 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.254437    4510 scope.go:122] "RemoveContainer" containerID="3e45021450aa4103372b32aed05c7dfb23b6b619e2dba74a427faf37c6ebe852"
Nov 04 03:40:41.265859 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.265837    4510 scope.go:122] "RemoveContainer" containerID="3e45021450aa4103372b32aed05c7dfb23b6b619e2dba74a427faf37c6ebe852"
Nov 04 03:40:41.266158 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:40:41.266134    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e45021450aa4103372b32aed05c7dfb23b6b619e2dba74a427faf37c6ebe852\": container with ID starting with 3e45021450aa4103372b32aed05c7dfb23b6b619e2dba74a427faf37c6ebe852 not found: ID does not exist" containerID="3e45021450aa4103372b32aed05c7dfb23b6b619e2dba74a427faf37c6ebe852"
Nov 04 03:40:41.266281 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.266159    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials\" (UniqueName: \"kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials\") pod \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\" (UID: \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\") "
Nov 04 03:40:41.266281 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.266171    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e45021450aa4103372b32aed05c7dfb23b6b619e2dba74a427faf37c6ebe852"} err="failed to get container status \"3e45021450aa4103372b32aed05c7dfb23b6b619e2dba74a427faf37c6ebe852\": rpc error: code = NotFound desc = could not find container \"3e45021450aa4103372b32aed05c7dfb23b6b619e2dba74a427faf37c6ebe852\": container with ID starting with 3e45021450aa4103372b32aed05c7dfb23b6b619e2dba74a427faf37c6ebe852 not found: ID does not exist"
Nov 04 03:40:41.266281 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.266217    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-routing-overlay-volume\") pod \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\" (UID: \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\") "
Nov 04 03:40:41.266281 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.266257    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-kube-api-access-8q7mz\" (UniqueName: \"kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-kube-api-access-8q7mz\") pod \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\" (UID: \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\") "
Nov 04 03:40:41.266518 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.266293    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-plugins-config-volume\") pod \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\" (UID: \"a8307d11-d8a0-49c1-b3eb-d6b238871f5c\") "
Nov 04 03:40:41.266669 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.266646    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-routing-overlay-volume" pod "a8307d11-d8a0-49c1-b3eb-d6b238871f5c" (UID: "a8307d11-d8a0-49c1-b3eb-d6b238871f5c"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:40:41.266802 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.266784    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-plugins-config-volume" pod "a8307d11-d8a0-49c1-b3eb-d6b238871f5c" (UID: "a8307d11-d8a0-49c1-b3eb-d6b238871f5c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:40:41.266923 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.266904    4510 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-routing-overlay-volume\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:41.267024 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.266925    4510 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-plugins-config-volume\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:41.269293 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.269272    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-kube-api-access-8q7mz" pod "a8307d11-d8a0-49c1-b3eb-d6b238871f5c" (UID: "a8307d11-d8a0-49c1-b3eb-d6b238871f5c"). InnerVolumeSpecName "kube-api-access-8q7mz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:40:41.269494 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.269454    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials" pod "a8307d11-d8a0-49c1-b3eb-d6b238871f5c" (UID: "a8307d11-d8a0-49c1-b3eb-d6b238871f5c"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:40:41.368176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.368146    4510 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-provider-credentials\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:41.368176 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.368174    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8q7mz\" (UniqueName: \"kubernetes.io/projected/a8307d11-d8a0-49c1-b3eb-d6b238871f5c-kube-api-access-8q7mz\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:41.679007 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.678967    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"]
Nov 04 03:40:41.776499 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:41.776464    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["models-as-a-service/payload-processing-external-model-86b659c8d5-hjmv6"]
Nov 04 03:40:42.043844 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:42.043812    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"]
Nov 04 03:40:42.044333 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:42.044079    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9" podUID="8b9608b1-179d-4740-bffe-ba998cdea67b" containerName="istio-proxy" containerID="cri-o://165a81998f44c166f09e2654ef5b57c4f949db1a22ec5b232d7102936cd78f57" gracePeriod=30
Nov 04 03:40:42.093563 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:42.093528    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"]
Nov 04 03:40:42.093762 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:42.093741    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn" podUID="e7512762-8459-4fe2-a5e6-bcf32b17a181" containerName="istio-proxy" containerID="cri-o://73f1572423c56508c6374c28b4666b04a30304ad76881f2b8095d043677fb8dc" gracePeriod=30
Nov 04 03:40:42.863008 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:42.862975    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a8307d11-d8a0-49c1-b3eb-d6b238871f5c" path="/var/lib/kubelet/pods/a8307d11-d8a0-49c1-b3eb-d6b238871f5c/volumes"
Nov 04 03:40:47.294919 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.294756    4510 generic.go:356] "Generic (PLEG): container finished" podID="8b9608b1-179d-4740-bffe-ba998cdea67b" containerID="165a81998f44c166f09e2654ef5b57c4f949db1a22ec5b232d7102936cd78f57" exitCode=0
Nov 04 03:40:47.294919 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.294824    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9" event={"ID":"8b9608b1-179d-4740-bffe-ba998cdea67b","Type":"ContainerDied","Data":"165a81998f44c166f09e2654ef5b57c4f949db1a22ec5b232d7102936cd78f57"}
Nov 04 03:40:47.297417 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.297165    4510 generic.go:356] "Generic (PLEG): container finished" podID="e7512762-8459-4fe2-a5e6-bcf32b17a181" containerID="73f1572423c56508c6374c28b4666b04a30304ad76881f2b8095d043677fb8dc" exitCode=0
Nov 04 03:40:47.297417 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.297285    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn" event={"ID":"e7512762-8459-4fe2-a5e6-bcf32b17a181","Type":"ContainerDied","Data":"73f1572423c56508c6374c28b4666b04a30304ad76881f2b8095d043677fb8dc"}
Nov 04 03:40:47.297417 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.297329    4510 scope.go:122] "RemoveContainer" containerID="da2ff17cb1540a1de7adac9afd8eb569004003ab221ab0f7918185f5494ec487"
Nov 04 03:40:47.369455 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.369428    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:40:47.411537 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.411511    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:40:47.423959 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.423938    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-envoy\") pod \"e7512762-8459-4fe2-a5e6-bcf32b17a181\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") "
Nov 04 03:40:47.424116 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.423973    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8b9608b1-179d-4740-bffe-ba998cdea67b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b9608b1-179d-4740-bffe-ba998cdea67b-istiod-ca-cert\") pod \"8b9608b1-179d-4740-bffe-ba998cdea67b\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") "
Nov 04 03:40:47.424116 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424000    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-workload-certs\") pod \"8b9608b1-179d-4740-bffe-ba998cdea67b\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") "
Nov 04 03:40:47.424116 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424052    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-credential-socket\") pod \"e7512762-8459-4fe2-a5e6-bcf32b17a181\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") "
Nov 04 03:40:47.424116 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424090    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-envoy\") pod \"8b9608b1-179d-4740-bffe-ba998cdea67b\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") "
Nov 04 03:40:47.424334 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424125    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-workload-certs\") pod \"e7512762-8459-4fe2-a5e6-bcf32b17a181\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") "
Nov 04 03:40:47.424334 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424171    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-workload-socket\") pod \"8b9608b1-179d-4740-bffe-ba998cdea67b\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") "
Nov 04 03:40:47.424334 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424205    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-data\") pod \"8b9608b1-179d-4740-bffe-ba998cdea67b\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") "
Nov 04 03:40:47.424334 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424236    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e7512762-8459-4fe2-a5e6-bcf32b17a181-kube-api-access-5fvp8\" (UniqueName: \"kubernetes.io/projected/e7512762-8459-4fe2-a5e6-bcf32b17a181-kube-api-access-5fvp8\") pod \"e7512762-8459-4fe2-a5e6-bcf32b17a181\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") "
Nov 04 03:40:47.424334 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424278    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8b9608b1-179d-4740-bffe-ba998cdea67b-kube-api-access-hnhrg\" (UniqueName: \"kubernetes.io/projected/8b9608b1-179d-4740-bffe-ba998cdea67b-kube-api-access-hnhrg\") pod \"8b9608b1-179d-4740-bffe-ba998cdea67b\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") "
Nov 04 03:40:47.424334 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424307    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-data\") pod \"e7512762-8459-4fe2-a5e6-bcf32b17a181\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") "
Nov 04 03:40:47.424796 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424360    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b9608b1-179d-4740-bffe-ba998cdea67b-istiod-ca-cert" pod "8b9608b1-179d-4740-bffe-ba998cdea67b" (UID: "8b9608b1-179d-4740-bffe-ba998cdea67b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:40:47.424796 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424366    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-workload-socket\") pod \"e7512762-8459-4fe2-a5e6-bcf32b17a181\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") "
Nov 04 03:40:47.424796 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424422    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-podinfo\") pod \"8b9608b1-179d-4740-bffe-ba998cdea67b\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") "
Nov 04 03:40:47.424796 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424490    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-token\" (UniqueName: \"kubernetes.io/projected/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-token\") pod \"8b9608b1-179d-4740-bffe-ba998cdea67b\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") "
Nov 04 03:40:47.424796 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424524    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-podinfo\") pod \"e7512762-8459-4fe2-a5e6-bcf32b17a181\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") "
Nov 04 03:40:47.424796 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424598    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e7512762-8459-4fe2-a5e6-bcf32b17a181-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7512762-8459-4fe2-a5e6-bcf32b17a181-istiod-ca-cert\") pod \"e7512762-8459-4fe2-a5e6-bcf32b17a181\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") "
Nov 04 03:40:47.424796 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424650    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-token\" (UniqueName: \"kubernetes.io/projected/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-token\") pod \"e7512762-8459-4fe2-a5e6-bcf32b17a181\" (UID: \"e7512762-8459-4fe2-a5e6-bcf32b17a181\") "
Nov 04 03:40:47.424796 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424702    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-credential-socket\") pod \"8b9608b1-179d-4740-bffe-ba998cdea67b\" (UID: \"8b9608b1-179d-4740-bffe-ba998cdea67b\") "
Nov 04 03:40:47.425311 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.425055    4510 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8b9608b1-179d-4740-bffe-ba998cdea67b-istiod-ca-cert\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:47.425514 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424358    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-credential-socket" pod "e7512762-8459-4fe2-a5e6-bcf32b17a181" (UID: "e7512762-8459-4fe2-a5e6-bcf32b17a181"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:40:47.425583 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424524    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-data" pod "e7512762-8459-4fe2-a5e6-bcf32b17a181" (UID: "e7512762-8459-4fe2-a5e6-bcf32b17a181"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:40:47.425583 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424660    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-data" pod "8b9608b1-179d-4740-bffe-ba998cdea67b" (UID: "8b9608b1-179d-4740-bffe-ba998cdea67b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:40:47.425583 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424798    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-workload-socket" pod "8b9608b1-179d-4740-bffe-ba998cdea67b" (UID: "8b9608b1-179d-4740-bffe-ba998cdea67b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:40:47.425583 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.424810    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-workload-certs" pod "e7512762-8459-4fe2-a5e6-bcf32b17a181" (UID: "e7512762-8459-4fe2-a5e6-bcf32b17a181"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:40:47.425583 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.425156    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-workload-certs" pod "8b9608b1-179d-4740-bffe-ba998cdea67b" (UID: "8b9608b1-179d-4740-bffe-ba998cdea67b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:40:47.425583 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.425254    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-credential-socket" pod "8b9608b1-179d-4740-bffe-ba998cdea67b" (UID: "8b9608b1-179d-4740-bffe-ba998cdea67b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:40:47.425583 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.425473    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7512762-8459-4fe2-a5e6-bcf32b17a181-istiod-ca-cert" pod "e7512762-8459-4fe2-a5e6-bcf32b17a181" (UID: "e7512762-8459-4fe2-a5e6-bcf32b17a181"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:40:47.425964 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.425826    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-workload-socket" pod "e7512762-8459-4fe2-a5e6-bcf32b17a181" (UID: "e7512762-8459-4fe2-a5e6-bcf32b17a181"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:40:47.426926 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.426899    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-envoy" pod "e7512762-8459-4fe2-a5e6-bcf32b17a181" (UID: "e7512762-8459-4fe2-a5e6-bcf32b17a181"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:40:47.427382 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.427351    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-token" pod "8b9608b1-179d-4740-bffe-ba998cdea67b" (UID: "8b9608b1-179d-4740-bffe-ba998cdea67b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:40:47.427512 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.427487    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7512762-8459-4fe2-a5e6-bcf32b17a181-kube-api-access-5fvp8" pod "e7512762-8459-4fe2-a5e6-bcf32b17a181" (UID: "e7512762-8459-4fe2-a5e6-bcf32b17a181"). InnerVolumeSpecName "kube-api-access-5fvp8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:40:47.428160 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.428136    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-podinfo" pod "8b9608b1-179d-4740-bffe-ba998cdea67b" (UID: "8b9608b1-179d-4740-bffe-ba998cdea67b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 03:40:47.428160 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.428152    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-podinfo" pod "e7512762-8459-4fe2-a5e6-bcf32b17a181" (UID: "e7512762-8459-4fe2-a5e6-bcf32b17a181"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 03:40:47.428367 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.428350    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-token" pod "e7512762-8459-4fe2-a5e6-bcf32b17a181" (UID: "e7512762-8459-4fe2-a5e6-bcf32b17a181"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:40:47.428714 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.428669    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b9608b1-179d-4740-bffe-ba998cdea67b-kube-api-access-hnhrg" pod "8b9608b1-179d-4740-bffe-ba998cdea67b" (UID: "8b9608b1-179d-4740-bffe-ba998cdea67b"). InnerVolumeSpecName "kube-api-access-hnhrg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:40:47.429384 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.429359    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-envoy" pod "8b9608b1-179d-4740-bffe-ba998cdea67b" (UID: "8b9608b1-179d-4740-bffe-ba998cdea67b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:40:47.526569 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.526528    4510 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-podinfo\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:47.526569 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.526562    4510 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-token\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:47.526856 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.526578    4510 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-podinfo\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:47.526856 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.526596    4510 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e7512762-8459-4fe2-a5e6-bcf32b17a181-istiod-ca-cert\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:47.526856 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.526613    4510 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-token\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:47.526856 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.526627    4510 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-credential-socket\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:47.526856 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.526641    4510 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-envoy\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:47.526856 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.526657    4510 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-workload-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:47.526856 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.526671    4510 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-credential-socket\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:47.526856 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.526704    4510 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-envoy\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:47.526856 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.526718    4510 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-workload-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:47.526856 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.526731    4510 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-workload-socket\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:47.526856 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.526746    4510 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8b9608b1-179d-4740-bffe-ba998cdea67b-istio-data\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:47.526856 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.526760    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fvp8\" (UniqueName: \"kubernetes.io/projected/e7512762-8459-4fe2-a5e6-bcf32b17a181-kube-api-access-5fvp8\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:47.526856 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.526775    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnhrg\" (UniqueName: \"kubernetes.io/projected/8b9608b1-179d-4740-bffe-ba998cdea67b-kube-api-access-hnhrg\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:47.526856 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.526789    4510 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-istio-data\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:47.526856 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:47.526803    4510 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e7512762-8459-4fe2-a5e6-bcf32b17a181-workload-socket\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:40:48.304773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:48.304746    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"
Nov 04 03:40:48.304773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:48.304760    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9" event={"ID":"8b9608b1-179d-4740-bffe-ba998cdea67b","Type":"ContainerDied","Data":"07fc0753263ffbe03b0a98600d5a16c3f75b7ac0d251eec091de1669051166aa"}
Nov 04 03:40:48.305347 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:48.304830    4510 scope.go:122] "RemoveContainer" containerID="165a81998f44c166f09e2654ef5b57c4f949db1a22ec5b232d7102936cd78f57"
Nov 04 03:40:48.306364 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:48.306343    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn" event={"ID":"e7512762-8459-4fe2-a5e6-bcf32b17a181","Type":"ContainerDied","Data":"c689043f996abbd7c2b7752f1fe834bdd7fc3ea2910bbe21a6fc820dd5aa2c57"}
Nov 04 03:40:48.306431 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:48.306381    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"
Nov 04 03:40:48.316215 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:48.316154    4510 scope.go:122] "RemoveContainer" containerID="73f1572423c56508c6374c28b4666b04a30304ad76881f2b8095d043677fb8dc"
Nov 04 03:40:48.520584 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:48.520547    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"]
Nov 04 03:40:48.574112 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:48.574031    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-ndxmn"]
Nov 04 03:40:48.680582 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:48.680544    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"]
Nov 04 03:40:48.735896 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:48.735859    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-b-491fe7-openshift-default-7774566777-tjlv9"]
Nov 04 03:40:48.863281 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:48.863200    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8b9608b1-179d-4740-bffe-ba998cdea67b" path="/var/lib/kubelet/pods/8b9608b1-179d-4740-bffe-ba998cdea67b/volumes"
Nov 04 03:40:48.863747 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:48.863732    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e7512762-8459-4fe2-a5e6-bcf32b17a181" path="/var/lib/kubelet/pods/e7512762-8459-4fe2-a5e6-bcf32b17a181/volumes"
Nov 04 03:40:53.317344 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:40:53.317305    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:40:57.483549 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:57.483515    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"]
Nov 04 03:40:57.533149 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:40:57.533121    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"]
Nov 04 03:41:09.063707 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:09.061253    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"]
Nov 04 03:41:09.110117 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:09.110078    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"]
Nov 04 03:41:10.490708 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:10.490542    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk" podUID="5881ff60-a61f-416c-8034-a9991921631b" containerName="main" probeResult="failure" output="Get \"https://10.133.0.51:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 03:41:10.610667 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:10.610560    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f" podUID="dd9ea1b1-0b00-4c30-a4d5-e2de30e12496" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 04 03:41:12.504182 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.504119    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8" podUID="bbc02f97-cd51-49be-9dda-5c14d6beb6c6" containerName="main" containerID="cri-o://802dca74dc8d6b92d7fa155a173de3a1602759988b87be6032cac71ef8bf100b" gracePeriod=45
Nov 04 03:41:12.552599 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.552544    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk" podUID="5881ff60-a61f-416c-8034-a9991921631b" containerName="main" containerID="cri-o://d77a76a4db5964c25e446e5fa74f9f4713d1e946242f940c1d70321c4c4b3564" gracePeriod=45
Nov 04 03:41:12.589834 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.589796    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8" podUID="bbc02f97-cd51-49be-9dda-5c14d6beb6c6" containerName="main" probeResult="failure" output="Get \"https://10.133.0.53:8000/ready\": dial tcp 10.133.0.53:8000: connect: connection refused"
Nov 04 03:41:12.847655 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.847314    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:41:12.874327 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.874304    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:41:12.955894 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.955871    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-tmp-dir\") pod \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") "
Nov 04 03:41:12.956072 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.955948    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-dshm\") pod \"5881ff60-a61f-416c-8034-a9991921631b\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") "
Nov 04 03:41:12.956072 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.955988    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-kube-api-access-jfvzw\" (UniqueName: \"kubernetes.io/projected/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-kube-api-access-jfvzw\") pod \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") "
Nov 04 03:41:12.956072 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.956012    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-dshm\") pod \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") "
Nov 04 03:41:12.956263 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.956082    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5881ff60-a61f-416c-8034-a9991921631b-kube-api-access-gs8t8\" (UniqueName: \"kubernetes.io/projected/5881ff60-a61f-416c-8034-a9991921631b-kube-api-access-gs8t8\") pod \"5881ff60-a61f-416c-8034-a9991921631b\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") "
Nov 04 03:41:12.956263 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.956109    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5881ff60-a61f-416c-8034-a9991921631b-tls-certs\" (UniqueName: \"kubernetes.io/secret/5881ff60-a61f-416c-8034-a9991921631b-tls-certs\") pod \"5881ff60-a61f-416c-8034-a9991921631b\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") "
Nov 04 03:41:12.956263 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.956158    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-tmp-dir" pod "bbc02f97-cd51-49be-9dda-5c14d6beb6c6" (UID: "bbc02f97-cd51-49be-9dda-5c14d6beb6c6"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:41:12.956263 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.956174    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-model-cache\") pod \"5881ff60-a61f-416c-8034-a9991921631b\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") "
Nov 04 03:41:12.956263 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.956224    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-home\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-home\") pod \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") "
Nov 04 03:41:12.956263 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.956254    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-tmp-dir\") pod \"5881ff60-a61f-416c-8034-a9991921631b\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") "
Nov 04 03:41:12.956573 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.956291    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-model-cache\") pod \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") "
Nov 04 03:41:12.956573 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.956337    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-tls-certs\") pod \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\" (UID: \"bbc02f97-cd51-49be-9dda-5c14d6beb6c6\") "
Nov 04 03:41:12.956573 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.956365    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-home\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-home\") pod \"5881ff60-a61f-416c-8034-a9991921631b\" (UID: \"5881ff60-a61f-416c-8034-a9991921631b\") "
Nov 04 03:41:12.956779 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.956640    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-model-cache" pod "bbc02f97-cd51-49be-9dda-5c14d6beb6c6" (UID: "bbc02f97-cd51-49be-9dda-5c14d6beb6c6"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:41:12.957000 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.956785    4510 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-model-cache\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:12.957000 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.956806    4510 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-tmp-dir\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:12.957000 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.956851    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-tmp-dir" pod "5881ff60-a61f-416c-8034-a9991921631b" (UID: "5881ff60-a61f-416c-8034-a9991921631b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:41:12.957169 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.956998    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-model-cache" pod "5881ff60-a61f-416c-8034-a9991921631b" (UID: "5881ff60-a61f-416c-8034-a9991921631b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:41:12.957169 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.957085    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-home" pod "bbc02f97-cd51-49be-9dda-5c14d6beb6c6" (UID: "bbc02f97-cd51-49be-9dda-5c14d6beb6c6"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:41:12.957284 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.957265    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-home" pod "5881ff60-a61f-416c-8034-a9991921631b" (UID: "5881ff60-a61f-416c-8034-a9991921631b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:41:12.958733 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.958701    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5881ff60-a61f-416c-8034-a9991921631b-tls-certs" pod "5881ff60-a61f-416c-8034-a9991921631b" (UID: "5881ff60-a61f-416c-8034-a9991921631b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:41:12.958865 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.958749    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-dshm" pod "bbc02f97-cd51-49be-9dda-5c14d6beb6c6" (UID: "bbc02f97-cd51-49be-9dda-5c14d6beb6c6"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:41:12.958865 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.958837    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-kube-api-access-jfvzw" pod "bbc02f97-cd51-49be-9dda-5c14d6beb6c6" (UID: "bbc02f97-cd51-49be-9dda-5c14d6beb6c6"). InnerVolumeSpecName "kube-api-access-jfvzw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:41:12.959416 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.959388    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-tls-certs" pod "bbc02f97-cd51-49be-9dda-5c14d6beb6c6" (UID: "bbc02f97-cd51-49be-9dda-5c14d6beb6c6"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:41:12.959525 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.959423    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5881ff60-a61f-416c-8034-a9991921631b-kube-api-access-gs8t8" pod "5881ff60-a61f-416c-8034-a9991921631b" (UID: "5881ff60-a61f-416c-8034-a9991921631b"). InnerVolumeSpecName "kube-api-access-gs8t8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:41:12.959702 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:12.959666    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-dshm" pod "5881ff60-a61f-416c-8034-a9991921631b" (UID: "5881ff60-a61f-416c-8034-a9991921631b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:41:13.057787 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.057714    4510 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-dshm\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:13.057787 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.057752    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfvzw\" (UniqueName: \"kubernetes.io/projected/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-kube-api-access-jfvzw\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:13.057787 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.057766    4510 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-dshm\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:13.057787 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.057775    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gs8t8\" (UniqueName: \"kubernetes.io/projected/5881ff60-a61f-416c-8034-a9991921631b-kube-api-access-gs8t8\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:13.057787 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.057784    4510 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5881ff60-a61f-416c-8034-a9991921631b-tls-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:13.058040 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.057793    4510 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-model-cache\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:13.058040 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.057802    4510 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-home\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:13.058040 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.057811    4510 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-tmp-dir\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:13.058040 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.057819    4510 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bbc02f97-cd51-49be-9dda-5c14d6beb6c6-tls-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:13.058040 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.057827    4510 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5881ff60-a61f-416c-8034-a9991921631b-home\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:13.519973 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.519935    4510 generic.go:356] "Generic (PLEG): container finished" podID="5881ff60-a61f-416c-8034-a9991921631b" containerID="d77a76a4db5964c25e446e5fa74f9f4713d1e946242f940c1d70321c4c4b3564" exitCode=0
Nov 04 03:41:13.520442 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.519980    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"
Nov 04 03:41:13.520442 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.520031    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk" event={"ID":"5881ff60-a61f-416c-8034-a9991921631b","Type":"ContainerDied","Data":"d77a76a4db5964c25e446e5fa74f9f4713d1e946242f940c1d70321c4c4b3564"}
Nov 04 03:41:13.520442 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.520078    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk" event={"ID":"5881ff60-a61f-416c-8034-a9991921631b","Type":"ContainerDied","Data":"4356e906a75b54a2d12b5183a3d75a4a3b2d7f7f1b19531cd4ab77e4c410ef78"}
Nov 04 03:41:13.520442 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.520103    4510 scope.go:122] "RemoveContainer" containerID="d77a76a4db5964c25e446e5fa74f9f4713d1e946242f940c1d70321c4c4b3564"
Nov 04 03:41:13.522235 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.521915    4510 generic.go:356] "Generic (PLEG): container finished" podID="bbc02f97-cd51-49be-9dda-5c14d6beb6c6" containerID="802dca74dc8d6b92d7fa155a173de3a1602759988b87be6032cac71ef8bf100b" exitCode=0
Nov 04 03:41:13.522235 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.521953    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8" event={"ID":"bbc02f97-cd51-49be-9dda-5c14d6beb6c6","Type":"ContainerDied","Data":"802dca74dc8d6b92d7fa155a173de3a1602759988b87be6032cac71ef8bf100b"}
Nov 04 03:41:13.522235 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.521966    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"
Nov 04 03:41:13.522235 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.521982    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8" event={"ID":"bbc02f97-cd51-49be-9dda-5c14d6beb6c6","Type":"ContainerDied","Data":"5954538f616b8995c42e60d46f6078ea9e8d3f9102bcd62b7d433d5b7484dbab"}
Nov 04 03:41:13.531743 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.531729    4510 scope.go:122] "RemoveContainer" containerID="d77a76a4db5964c25e446e5fa74f9f4713d1e946242f940c1d70321c4c4b3564"
Nov 04 03:41:13.532031 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:41:13.532010    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d77a76a4db5964c25e446e5fa74f9f4713d1e946242f940c1d70321c4c4b3564\": container with ID starting with d77a76a4db5964c25e446e5fa74f9f4713d1e946242f940c1d70321c4c4b3564 not found: ID does not exist" containerID="d77a76a4db5964c25e446e5fa74f9f4713d1e946242f940c1d70321c4c4b3564"
Nov 04 03:41:13.532118 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.532044    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d77a76a4db5964c25e446e5fa74f9f4713d1e946242f940c1d70321c4c4b3564"} err="failed to get container status \"d77a76a4db5964c25e446e5fa74f9f4713d1e946242f940c1d70321c4c4b3564\": rpc error: code = NotFound desc = could not find container \"d77a76a4db5964c25e446e5fa74f9f4713d1e946242f940c1d70321c4c4b3564\": container with ID starting with d77a76a4db5964c25e446e5fa74f9f4713d1e946242f940c1d70321c4c4b3564 not found: ID does not exist"
Nov 04 03:41:13.532118 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.532069    4510 scope.go:122] "RemoveContainer" containerID="802dca74dc8d6b92d7fa155a173de3a1602759988b87be6032cac71ef8bf100b"
Nov 04 03:41:13.540310 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.540295    4510 scope.go:122] "RemoveContainer" containerID="802dca74dc8d6b92d7fa155a173de3a1602759988b87be6032cac71ef8bf100b"
Nov 04 03:41:13.540538 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:41:13.540521    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"802dca74dc8d6b92d7fa155a173de3a1602759988b87be6032cac71ef8bf100b\": container with ID starting with 802dca74dc8d6b92d7fa155a173de3a1602759988b87be6032cac71ef8bf100b not found: ID does not exist" containerID="802dca74dc8d6b92d7fa155a173de3a1602759988b87be6032cac71ef8bf100b"
Nov 04 03:41:13.540598 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.540548    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"802dca74dc8d6b92d7fa155a173de3a1602759988b87be6032cac71ef8bf100b"} err="failed to get container status \"802dca74dc8d6b92d7fa155a173de3a1602759988b87be6032cac71ef8bf100b\": rpc error: code = NotFound desc = could not find container \"802dca74dc8d6b92d7fa155a173de3a1602759988b87be6032cac71ef8bf100b\": container with ID starting with 802dca74dc8d6b92d7fa155a173de3a1602759988b87be6032cac71ef8bf100b not found: ID does not exist"
Nov 04 03:41:13.687153 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.687125    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"]
Nov 04 03:41:13.738185 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.738158    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-10f834/simulator-w4-10f834-kserve-6bcb95d479-g8vlk"]
Nov 04 03:41:13.848207 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.848134    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"]
Nov 04 03:41:13.850733 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:13.850710    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-10f834/premium-w4-10f834-kserve-c974589f4-l2sn8"]
Nov 04 03:41:14.862548 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:14.862519    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5881ff60-a61f-416c-8034-a9991921631b" path="/var/lib/kubelet/pods/5881ff60-a61f-416c-8034-a9991921631b/volumes"
Nov 04 03:41:14.862976 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:14.862939    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bbc02f97-cd51-49be-9dda-5c14d6beb6c6" path="/var/lib/kubelet/pods/bbc02f97-cd51-49be-9dda-5c14d6beb6c6/volumes"
Nov 04 03:41:20.193016 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:20.192982    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq"]
Nov 04 03:41:23.316498 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:41:23.316453    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:41:24.407714 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.406320    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z" podUID="2b117874-604c-468c-817d-d479546de869" containerName="main" containerID="cri-o://4289f0ca19b7615a80f79f3784fd889b00d8a60b61aec15be0d7bd3ef6f9ebc7" gracePeriod=45
Nov 04 03:41:24.441214 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.441178    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq" podUID="b7e091e0-5112-49c2-8801-d0c6a46e8e01" containerName="main" containerID="cri-o://106675e774a7b40b2354b3ac1122b099394f7ffa29525cacdd290a3331cc1ac6" gracePeriod=45
Nov 04 03:41:24.588230 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.588191    4510 generic.go:356] "Generic (PLEG): container finished" podID="2b117874-604c-468c-817d-d479546de869" containerID="4289f0ca19b7615a80f79f3784fd889b00d8a60b61aec15be0d7bd3ef6f9ebc7" exitCode=0
Nov 04 03:41:24.588387 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.588366    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z" event={"ID":"2b117874-604c-468c-817d-d479546de869","Type":"ContainerDied","Data":"4289f0ca19b7615a80f79f3784fd889b00d8a60b61aec15be0d7bd3ef6f9ebc7"}
Nov 04 03:41:24.590196 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.590169    4510 generic.go:356] "Generic (PLEG): container finished" podID="b7e091e0-5112-49c2-8801-d0c6a46e8e01" containerID="106675e774a7b40b2354b3ac1122b099394f7ffa29525cacdd290a3331cc1ac6" exitCode=0
Nov 04 03:41:24.590328 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.590257    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq" event={"ID":"b7e091e0-5112-49c2-8801-d0c6a46e8e01","Type":"ContainerDied","Data":"106675e774a7b40b2354b3ac1122b099394f7ffa29525cacdd290a3331cc1ac6"}
Nov 04 03:41:24.725328 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.725299    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:41:24.742891 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.742868    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:41:24.778375 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.778350    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-model-cache\") pod \"2b117874-604c-468c-817d-d479546de869\" (UID: \"2b117874-604c-468c-817d-d479546de869\") "
Nov 04 03:41:24.778497 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.778414    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2b117874-604c-468c-817d-d479546de869-tls-certs\" (UniqueName: \"kubernetes.io/secret/2b117874-604c-468c-817d-d479546de869-tls-certs\") pod \"2b117874-604c-468c-817d-d479546de869\" (UID: \"2b117874-604c-468c-817d-d479546de869\") "
Nov 04 03:41:24.778497 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.778484    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-tmp-dir\") pod \"2b117874-604c-468c-817d-d479546de869\" (UID: \"2b117874-604c-468c-817d-d479546de869\") "
Nov 04 03:41:24.778611 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.778546    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2b117874-604c-468c-817d-d479546de869-kube-api-access-xbm4d\" (UniqueName: \"kubernetes.io/projected/2b117874-604c-468c-817d-d479546de869-kube-api-access-xbm4d\") pod \"2b117874-604c-468c-817d-d479546de869\" (UID: \"2b117874-604c-468c-817d-d479546de869\") "
Nov 04 03:41:24.778611 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.778574    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-home\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-home\") pod \"2b117874-604c-468c-817d-d479546de869\" (UID: \"2b117874-604c-468c-817d-d479546de869\") "
Nov 04 03:41:24.778750 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.778638    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-model-cache" pod "2b117874-604c-468c-817d-d479546de869" (UID: "2b117874-604c-468c-817d-d479546de869"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:41:24.778750 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.778702    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-dshm\") pod \"2b117874-604c-468c-817d-d479546de869\" (UID: \"2b117874-604c-468c-817d-d479546de869\") "
Nov 04 03:41:24.778865 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.778808    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-tmp-dir" pod "2b117874-604c-468c-817d-d479546de869" (UID: "2b117874-604c-468c-817d-d479546de869"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:41:24.778927 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.778878    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-home" pod "2b117874-604c-468c-817d-d479546de869" (UID: "2b117874-604c-468c-817d-d479546de869"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:41:24.779115 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.779093    4510 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-model-cache\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:24.779115 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.779116    4510 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-tmp-dir\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:24.779267 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.779129    4510 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-home\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:24.780767 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.780740    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b117874-604c-468c-817d-d479546de869-tls-certs" pod "2b117874-604c-468c-817d-d479546de869" (UID: "2b117874-604c-468c-817d-d479546de869"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:41:24.780871 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.780856    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-dshm" pod "2b117874-604c-468c-817d-d479546de869" (UID: "2b117874-604c-468c-817d-d479546de869"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:41:24.780923 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.780869    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b117874-604c-468c-817d-d479546de869-kube-api-access-xbm4d" pod "2b117874-604c-468c-817d-d479546de869" (UID: "2b117874-604c-468c-817d-d479546de869"). InnerVolumeSpecName "kube-api-access-xbm4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:41:24.880366 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.880336    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b7e091e0-5112-49c2-8801-d0c6a46e8e01-kube-api-access-w4mqd\" (UniqueName: \"kubernetes.io/projected/b7e091e0-5112-49c2-8801-d0c6a46e8e01-kube-api-access-w4mqd\") pod \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") "
Nov 04 03:41:24.880501 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.880385    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b7e091e0-5112-49c2-8801-d0c6a46e8e01-tls-certs\" (UniqueName: \"kubernetes.io/secret/b7e091e0-5112-49c2-8801-d0c6a46e8e01-tls-certs\") pod \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") "
Nov 04 03:41:24.880501 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.880457    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-dshm\") pod \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") "
Nov 04 03:41:24.880623 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.880540    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-tmp-dir\") pod \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") "
Nov 04 03:41:24.880623 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.880594    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-home\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-home\") pod \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") "
Nov 04 03:41:24.880777 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.880662    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-model-cache\") pod \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\" (UID: \"b7e091e0-5112-49c2-8801-d0c6a46e8e01\") "
Nov 04 03:41:24.880933 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.880904    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-tmp-dir" pod "b7e091e0-5112-49c2-8801-d0c6a46e8e01" (UID: "b7e091e0-5112-49c2-8801-d0c6a46e8e01"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:41:24.881125 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.881095    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-model-cache" pod "b7e091e0-5112-49c2-8801-d0c6a46e8e01" (UID: "b7e091e0-5112-49c2-8801-d0c6a46e8e01"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:41:24.881228 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.881174    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-home" pod "b7e091e0-5112-49c2-8801-d0c6a46e8e01" (UID: "b7e091e0-5112-49c2-8801-d0c6a46e8e01"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:41:24.881302 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.881267    4510 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-tmp-dir\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:24.881302 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.881287    4510 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2b117874-604c-468c-817d-d479546de869-dshm\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:24.881413 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.881300    4510 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2b117874-604c-468c-817d-d479546de869-tls-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:24.881413 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.881316    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xbm4d\" (UniqueName: \"kubernetes.io/projected/2b117874-604c-468c-817d-d479546de869-kube-api-access-xbm4d\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:24.882659 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.882637    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7e091e0-5112-49c2-8801-d0c6a46e8e01-tls-certs" pod "b7e091e0-5112-49c2-8801-d0c6a46e8e01" (UID: "b7e091e0-5112-49c2-8801-d0c6a46e8e01"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:41:24.883208 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.883176    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7e091e0-5112-49c2-8801-d0c6a46e8e01-kube-api-access-w4mqd" pod "b7e091e0-5112-49c2-8801-d0c6a46e8e01" (UID: "b7e091e0-5112-49c2-8801-d0c6a46e8e01"). InnerVolumeSpecName "kube-api-access-w4mqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:41:24.883389 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.883372    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-dshm" pod "b7e091e0-5112-49c2-8801-d0c6a46e8e01" (UID: "b7e091e0-5112-49c2-8801-d0c6a46e8e01"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:41:24.982043 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.982008    4510 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-home\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:24.982043 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.982044    4510 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-model-cache\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:24.982235 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.982060    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4mqd\" (UniqueName: \"kubernetes.io/projected/b7e091e0-5112-49c2-8801-d0c6a46e8e01-kube-api-access-w4mqd\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:24.982235 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.982074    4510 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b7e091e0-5112-49c2-8801-d0c6a46e8e01-tls-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:24.982235 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:24.982086    4510 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b7e091e0-5112-49c2-8801-d0c6a46e8e01-dshm\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:25.194022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:25.193988    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq" podUID="711e1966-9061-4246-951f-f99bd1963969" containerName="payload-processing" containerID="cri-o://bf6236bac59c2492b1ea9a3cbfd6279a423e0959dc56559b378b2f0d77c1903f" gracePeriod=25
Nov 04 03:41:25.598010 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:25.597982    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"
Nov 04 03:41:25.598486 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:25.598004    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z" event={"ID":"2b117874-604c-468c-817d-d479546de869","Type":"ContainerDied","Data":"712e7fbc3419bf2e71190a4f3bb212b51a37159bfca477a09f6a5cc3096aa1b5"}
Nov 04 03:41:25.598486 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:25.598065    4510 scope.go:122] "RemoveContainer" containerID="4289f0ca19b7615a80f79f3784fd889b00d8a60b61aec15be0d7bd3ef6f9ebc7"
Nov 04 03:41:25.599612 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:25.599482    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq" event={"ID":"b7e091e0-5112-49c2-8801-d0c6a46e8e01","Type":"ContainerDied","Data":"53374e23df8c277c168fc8a66f68201c97e8ced61f779474df1f1a2b3333582c"}
Nov 04 03:41:25.599612 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:25.599540    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"
Nov 04 03:41:25.611878 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:25.611857    4510 scope.go:122] "RemoveContainer" containerID="106675e774a7b40b2354b3ac1122b099394f7ffa29525cacdd290a3331cc1ac6"
Nov 04 03:41:25.770140 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:25.765025    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"]
Nov 04 03:41:25.813250 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:25.813212    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-af788a/distinct-w2-af788a-kserve-5cddc85cbd-6bcrq"]
Nov 04 03:41:25.882169 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:25.882138    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"]
Nov 04 03:41:25.886947 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:25.886920    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-af788a/distinct-2-w2-af788a-kserve-849c84b975-cmt5z"]
Nov 04 03:41:26.863416 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:26.863382    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2b117874-604c-468c-817d-d479546de869" path="/var/lib/kubelet/pods/2b117874-604c-468c-817d-d479546de869/volumes"
Nov 04 03:41:26.863801 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:26.863787    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b7e091e0-5112-49c2-8801-d0c6a46e8e01" path="/var/lib/kubelet/pods/b7e091e0-5112-49c2-8801-d0c6a46e8e01/volumes"
Nov 04 03:41:27.730199 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:27.730158    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq" podUID="711e1966-9061-4246-951f-f99bd1963969" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 03:41:37.729428 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:37.729395    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq" podUID="711e1966-9061-4246-951f-f99bd1963969" containerName="payload-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 03:41:39.081333 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.081301    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"]
Nov 04 03:41:39.081850 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.081493    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68" podUID="76c943ec-886f-4198-bb58-f67c63173668" containerName="maas-api" containerID="cri-o://3793af3dfd168ec366c470e4f73e2f489f9fa8bd10d34b5e9879754e76d45e09" gracePeriod=30
Nov 04 03:41:39.349631 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.349604    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:41:39.423219 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.423185    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/76c943ec-886f-4198-bb58-f67c63173668-metrics-certs\" (UniqueName: \"kubernetes.io/secret/76c943ec-886f-4198-bb58-f67c63173668-metrics-certs\") pod \"76c943ec-886f-4198-bb58-f67c63173668\" (UID: \"76c943ec-886f-4198-bb58-f67c63173668\") "
Nov 04 03:41:39.423375 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.423278    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/76c943ec-886f-4198-bb58-f67c63173668-kube-api-access-s6d6v\" (UniqueName: \"kubernetes.io/projected/76c943ec-886f-4198-bb58-f67c63173668-kube-api-access-s6d6v\") pod \"76c943ec-886f-4198-bb58-f67c63173668\" (UID: \"76c943ec-886f-4198-bb58-f67c63173668\") "
Nov 04 03:41:39.423375 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.423366    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/76c943ec-886f-4198-bb58-f67c63173668-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c943ec-886f-4198-bb58-f67c63173668-openshift-service-ca\") pod \"76c943ec-886f-4198-bb58-f67c63173668\" (UID: \"76c943ec-886f-4198-bb58-f67c63173668\") "
Nov 04 03:41:39.423482 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.423395    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/76c943ec-886f-4198-bb58-f67c63173668-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c943ec-886f-4198-bb58-f67c63173668-maas-api-tls\") pod \"76c943ec-886f-4198-bb58-f67c63173668\" (UID: \"76c943ec-886f-4198-bb58-f67c63173668\") "
Nov 04 03:41:39.423761 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.423737    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76c943ec-886f-4198-bb58-f67c63173668-openshift-service-ca" pod "76c943ec-886f-4198-bb58-f67c63173668" (UID: "76c943ec-886f-4198-bb58-f67c63173668"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:41:39.425369 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.425340    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76c943ec-886f-4198-bb58-f67c63173668-metrics-certs" pod "76c943ec-886f-4198-bb58-f67c63173668" (UID: "76c943ec-886f-4198-bb58-f67c63173668"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:41:39.425472 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.425438    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76c943ec-886f-4198-bb58-f67c63173668-kube-api-access-s6d6v" pod "76c943ec-886f-4198-bb58-f67c63173668" (UID: "76c943ec-886f-4198-bb58-f67c63173668"). InnerVolumeSpecName "kube-api-access-s6d6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:41:39.425522 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.425497    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76c943ec-886f-4198-bb58-f67c63173668-maas-api-tls" pod "76c943ec-886f-4198-bb58-f67c63173668" (UID: "76c943ec-886f-4198-bb58-f67c63173668"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:41:39.524878 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.524843    4510 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/76c943ec-886f-4198-bb58-f67c63173668-openshift-service-ca\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:39.524878 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.524871    4510 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/76c943ec-886f-4198-bb58-f67c63173668-maas-api-tls\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:39.524878 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.524880    4510 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/76c943ec-886f-4198-bb58-f67c63173668-metrics-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:39.525133 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.524891    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6d6v\" (UniqueName: \"kubernetes.io/projected/76c943ec-886f-4198-bb58-f67c63173668-kube-api-access-s6d6v\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:39.688822 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.688729    4510 generic.go:356] "Generic (PLEG): container finished" podID="76c943ec-886f-4198-bb58-f67c63173668" containerID="3793af3dfd168ec366c470e4f73e2f489f9fa8bd10d34b5e9879754e76d45e09" exitCode=0
Nov 04 03:41:39.688822 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.688777    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"
Nov 04 03:41:39.688822 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.688812    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68" event={"ID":"76c943ec-886f-4198-bb58-f67c63173668","Type":"ContainerDied","Data":"3793af3dfd168ec366c470e4f73e2f489f9fa8bd10d34b5e9879754e76d45e09"}
Nov 04 03:41:39.689076 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.688860    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68" event={"ID":"76c943ec-886f-4198-bb58-f67c63173668","Type":"ContainerDied","Data":"d7cf52737089f4bad49a1db1cdc5efc301e86a8c5a20df99b545d59b53d83d27"}
Nov 04 03:41:39.689076 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.688886    4510 scope.go:122] "RemoveContainer" containerID="3793af3dfd168ec366c470e4f73e2f489f9fa8bd10d34b5e9879754e76d45e09"
Nov 04 03:41:39.699260 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.699246    4510 scope.go:122] "RemoveContainer" containerID="3793af3dfd168ec366c470e4f73e2f489f9fa8bd10d34b5e9879754e76d45e09"
Nov 04 03:41:39.699544 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:41:39.699527    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3793af3dfd168ec366c470e4f73e2f489f9fa8bd10d34b5e9879754e76d45e09\": container with ID starting with 3793af3dfd168ec366c470e4f73e2f489f9fa8bd10d34b5e9879754e76d45e09 not found: ID does not exist" containerID="3793af3dfd168ec366c470e4f73e2f489f9fa8bd10d34b5e9879754e76d45e09"
Nov 04 03:41:39.699611 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.699553    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3793af3dfd168ec366c470e4f73e2f489f9fa8bd10d34b5e9879754e76d45e09"} err="failed to get container status \"3793af3dfd168ec366c470e4f73e2f489f9fa8bd10d34b5e9879754e76d45e09\": rpc error: code = NotFound desc = could not find container \"3793af3dfd168ec366c470e4f73e2f489f9fa8bd10d34b5e9879754e76d45e09\": container with ID starting with 3793af3dfd168ec366c470e4f73e2f489f9fa8bd10d34b5e9879754e76d45e09 not found: ID does not exist"
Nov 04 03:41:39.948701 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.948615    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"]
Nov 04 03:41:39.953424 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:39.953395    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w2-af788a-6c477456db-4gd68"]
Nov 04 03:41:40.862357 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:40.862320    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="76c943ec-886f-4198-bb58-f67c63173668" path="/var/lib/kubelet/pods/76c943ec-886f-4198-bb58-f67c63173668/volumes"
Nov 04 03:41:45.456618 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.456562    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq"
Nov 04 03:41:45.569327 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.569293    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"]
Nov 04 03:41:45.569545 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.569522    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n" podUID="37beb582-a33b-4214-a262-1f2ba08ce759" containerName="maas-api" containerID="cri-o://2958fe0d3748258c8bf211328a447e5e1af231d6ed7a794038331dfdbe14c624" gracePeriod=30
Nov 04 03:41:45.588189 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.588163    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/711e1966-9061-4246-951f-f99bd1963969-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/711e1966-9061-4246-951f-f99bd1963969-plugins-config-volume\") pod \"711e1966-9061-4246-951f-f99bd1963969\" (UID: \"711e1966-9061-4246-951f-f99bd1963969\") "
Nov 04 03:41:45.588349 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.588235    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/711e1966-9061-4246-951f-f99bd1963969-kube-api-access-hfg7c\" (UniqueName: \"kubernetes.io/projected/711e1966-9061-4246-951f-f99bd1963969-kube-api-access-hfg7c\") pod \"711e1966-9061-4246-951f-f99bd1963969\" (UID: \"711e1966-9061-4246-951f-f99bd1963969\") "
Nov 04 03:41:45.588764 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.588734    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/711e1966-9061-4246-951f-f99bd1963969-plugins-config-volume" pod "711e1966-9061-4246-951f-f99bd1963969" (UID: "711e1966-9061-4246-951f-f99bd1963969"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:41:45.592850 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.592810    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/711e1966-9061-4246-951f-f99bd1963969-kube-api-access-hfg7c" pod "711e1966-9061-4246-951f-f99bd1963969" (UID: "711e1966-9061-4246-951f-f99bd1963969"). InnerVolumeSpecName "kube-api-access-hfg7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:41:45.689408 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.689371    4510 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/711e1966-9061-4246-951f-f99bd1963969-plugins-config-volume\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:45.689545 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.689412    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hfg7c\" (UniqueName: \"kubernetes.io/projected/711e1966-9061-4246-951f-f99bd1963969-kube-api-access-hfg7c\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:45.729720 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.729600    4510 generic.go:356] "Generic (PLEG): container finished" podID="711e1966-9061-4246-951f-f99bd1963969" containerID="bf6236bac59c2492b1ea9a3cbfd6279a423e0959dc56559b378b2f0d77c1903f" exitCode=0
Nov 04 03:41:45.729932 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.729784    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq" event={"ID":"711e1966-9061-4246-951f-f99bd1963969","Type":"ContainerDied","Data":"bf6236bac59c2492b1ea9a3cbfd6279a423e0959dc56559b378b2f0d77c1903f"}
Nov 04 03:41:45.729932 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.729837    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq" event={"ID":"711e1966-9061-4246-951f-f99bd1963969","Type":"ContainerDied","Data":"6c421a2b05d93e93126c9583f59fae775bb84c9a4d97bd9a1e0bcc4c01427812"}
Nov 04 03:41:45.729932 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.729868    4510 scope.go:122] "RemoveContainer" containerID="bf6236bac59c2492b1ea9a3cbfd6279a423e0959dc56559b378b2f0d77c1903f"
Nov 04 03:41:45.730112 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.730011    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq"
Nov 04 03:41:45.734978 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.734945    4510 generic.go:356] "Generic (PLEG): container finished" podID="37beb582-a33b-4214-a262-1f2ba08ce759" containerID="2958fe0d3748258c8bf211328a447e5e1af231d6ed7a794038331dfdbe14c624" exitCode=0
Nov 04 03:41:45.735112 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.735077    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n" event={"ID":"37beb582-a33b-4214-a262-1f2ba08ce759","Type":"ContainerDied","Data":"2958fe0d3748258c8bf211328a447e5e1af231d6ed7a794038331dfdbe14c624"}
Nov 04 03:41:45.748184 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.748163    4510 scope.go:122] "RemoveContainer" containerID="bf6236bac59c2492b1ea9a3cbfd6279a423e0959dc56559b378b2f0d77c1903f"
Nov 04 03:41:45.748579 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:41:45.748557    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bf6236bac59c2492b1ea9a3cbfd6279a423e0959dc56559b378b2f0d77c1903f\": container with ID starting with bf6236bac59c2492b1ea9a3cbfd6279a423e0959dc56559b378b2f0d77c1903f not found: ID does not exist" containerID="bf6236bac59c2492b1ea9a3cbfd6279a423e0959dc56559b378b2f0d77c1903f"
Nov 04 03:41:45.748710 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.748586    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bf6236bac59c2492b1ea9a3cbfd6279a423e0959dc56559b378b2f0d77c1903f"} err="failed to get container status \"bf6236bac59c2492b1ea9a3cbfd6279a423e0959dc56559b378b2f0d77c1903f\": rpc error: code = NotFound desc = could not find container \"bf6236bac59c2492b1ea9a3cbfd6279a423e0959dc56559b378b2f0d77c1903f\": container with ID starting with bf6236bac59c2492b1ea9a3cbfd6279a423e0959dc56559b378b2f0d77c1903f not found: ID does not exist"
Nov 04 03:41:45.877924 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.877895    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:41:45.911178 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.911143    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq"]
Nov 04 03:41:45.913593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:45.913566    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w1-90051a-8588c4cd7b-thnzq"]
Nov 04 03:41:46.004506 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:46.004420    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/37beb582-a33b-4214-a262-1f2ba08ce759-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37beb582-a33b-4214-a262-1f2ba08ce759-openshift-service-ca\") pod \"37beb582-a33b-4214-a262-1f2ba08ce759\" (UID: \"37beb582-a33b-4214-a262-1f2ba08ce759\") "
Nov 04 03:41:46.004506 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:46.004457    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/37beb582-a33b-4214-a262-1f2ba08ce759-kube-api-access-lkgff\" (UniqueName: \"kubernetes.io/projected/37beb582-a33b-4214-a262-1f2ba08ce759-kube-api-access-lkgff\") pod \"37beb582-a33b-4214-a262-1f2ba08ce759\" (UID: \"37beb582-a33b-4214-a262-1f2ba08ce759\") "
Nov 04 03:41:46.004760 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:46.004520    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/37beb582-a33b-4214-a262-1f2ba08ce759-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37beb582-a33b-4214-a262-1f2ba08ce759-maas-api-tls\") pod \"37beb582-a33b-4214-a262-1f2ba08ce759\" (UID: \"37beb582-a33b-4214-a262-1f2ba08ce759\") "
Nov 04 03:41:46.004760 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:46.004564    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/37beb582-a33b-4214-a262-1f2ba08ce759-metrics-certs\" (UniqueName: \"kubernetes.io/secret/37beb582-a33b-4214-a262-1f2ba08ce759-metrics-certs\") pod \"37beb582-a33b-4214-a262-1f2ba08ce759\" (UID: \"37beb582-a33b-4214-a262-1f2ba08ce759\") "
Nov 04 03:41:46.004907 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:46.004880    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/37beb582-a33b-4214-a262-1f2ba08ce759-openshift-service-ca" pod "37beb582-a33b-4214-a262-1f2ba08ce759" (UID: "37beb582-a33b-4214-a262-1f2ba08ce759"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:41:46.006873 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:46.006843    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/37beb582-a33b-4214-a262-1f2ba08ce759-kube-api-access-lkgff" pod "37beb582-a33b-4214-a262-1f2ba08ce759" (UID: "37beb582-a33b-4214-a262-1f2ba08ce759"). InnerVolumeSpecName "kube-api-access-lkgff". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:41:46.006973 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:46.006907    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37beb582-a33b-4214-a262-1f2ba08ce759-maas-api-tls" pod "37beb582-a33b-4214-a262-1f2ba08ce759" (UID: "37beb582-a33b-4214-a262-1f2ba08ce759"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:41:46.006973 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:46.006922    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/37beb582-a33b-4214-a262-1f2ba08ce759-metrics-certs" pod "37beb582-a33b-4214-a262-1f2ba08ce759" (UID: "37beb582-a33b-4214-a262-1f2ba08ce759"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:41:46.105770 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:46.105735    4510 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/37beb582-a33b-4214-a262-1f2ba08ce759-maas-api-tls\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:46.105770 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:46.105762    4510 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/37beb582-a33b-4214-a262-1f2ba08ce759-metrics-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:46.105770 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:46.105772    4510 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/37beb582-a33b-4214-a262-1f2ba08ce759-openshift-service-ca\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:46.106012 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:46.105781    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lkgff\" (UniqueName: \"kubernetes.io/projected/37beb582-a33b-4214-a262-1f2ba08ce759-kube-api-access-lkgff\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:41:46.743216 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:46.743190    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"
Nov 04 03:41:46.743708 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:46.743189    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n" event={"ID":"37beb582-a33b-4214-a262-1f2ba08ce759","Type":"ContainerDied","Data":"23dfe41cb7a7e58a3d477388114440feabaad0063259de7a1d64f45cd8469150"}
Nov 04 03:41:46.743708 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:46.743326    4510 scope.go:122] "RemoveContainer" containerID="2958fe0d3748258c8bf211328a447e5e1af231d6ed7a794038331dfdbe14c624"
Nov 04 03:41:46.862930 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:46.862896    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="711e1966-9061-4246-951f-f99bd1963969" path="/var/lib/kubelet/pods/711e1966-9061-4246-951f-f99bd1963969/volumes"
Nov 04 03:41:46.908120 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:46.908088    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"]
Nov 04 03:41:46.958004 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:46.957962    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-90051a-6c698487db-8gj6n"]
Nov 04 03:41:48.862797 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:41:48.862763    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="37beb582-a33b-4214-a262-1f2ba08ce759" path="/var/lib/kubelet/pods/37beb582-a33b-4214-a262-1f2ba08ce759/volumes"
Nov 04 03:41:53.317433 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:41:53.317397    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:42:23.317048 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:42:23.317007    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:42:53.316323 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:42:53.316281    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:43:23.317353 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:43:23.317260    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:43:53.315100 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:43:53.315063    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:44:23.317074 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:44:23.317031    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:44:53.317828 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:44:53.317744    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:45:23.317154 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:45:23.317116    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:45:53.316942 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:45:53.316901    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:46:23.317426 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:46:23.317383    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:46:28.911707 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:28.910814    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mpwlf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 03:46:28.911707 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:28.910909    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf" podUID="85cb4aab-7613-481a-af4c-228be87df8c9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 03:46:31.021378 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:31.021338    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr"]
Nov 04 03:46:31.129609 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:31.129579    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v"]
Nov 04 03:46:36.021822 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.021780    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr" podUID="26f637a4-444a-4725-b7cf-eab47dd1e7b9" containerName="payload-processing" containerID="cri-o://9f66612ebc5cfa02b28c6a56883693126af18e29fff85c71725569d50585ce9e" gracePeriod=25
Nov 04 03:46:36.130472 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.130439    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v" podUID="e8e768db-6b1c-43ae-9b85-0c0427ef4c66" containerName="payload-pre-processing" containerID="cri-o://f09295754be9948b106b8c2c5c8c9d7dff7eba8a0522a91cb107ebbdde30b0dc" gracePeriod=25
Nov 04 03:46:36.287249 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.287179    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr"
Nov 04 03:46:36.319866 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.319831    4510 generic.go:356] "Generic (PLEG): container finished" podID="26f637a4-444a-4725-b7cf-eab47dd1e7b9" containerID="9f66612ebc5cfa02b28c6a56883693126af18e29fff85c71725569d50585ce9e" exitCode=0
Nov 04 03:46:36.320060 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.319886    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr"
Nov 04 03:46:36.320060 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.319915    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr" event={"ID":"26f637a4-444a-4725-b7cf-eab47dd1e7b9","Type":"ContainerDied","Data":"9f66612ebc5cfa02b28c6a56883693126af18e29fff85c71725569d50585ce9e"}
Nov 04 03:46:36.320060 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.319970    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr" event={"ID":"26f637a4-444a-4725-b7cf-eab47dd1e7b9","Type":"ContainerDied","Data":"6ddcd839591b124f6eff6b02b419d1c3ee8ac72b4b6fe958c56ea570c5bf4595"}
Nov 04 03:46:36.320060 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.320002    4510 scope.go:122] "RemoveContainer" containerID="9f66612ebc5cfa02b28c6a56883693126af18e29fff85c71725569d50585ce9e"
Nov 04 03:46:36.322221 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.322198    4510 generic.go:356] "Generic (PLEG): container finished" podID="e8e768db-6b1c-43ae-9b85-0c0427ef4c66" containerID="f09295754be9948b106b8c2c5c8c9d7dff7eba8a0522a91cb107ebbdde30b0dc" exitCode=0
Nov 04 03:46:36.322338 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.322272    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v" event={"ID":"e8e768db-6b1c-43ae-9b85-0c0427ef4c66","Type":"ContainerDied","Data":"f09295754be9948b106b8c2c5c8c9d7dff7eba8a0522a91cb107ebbdde30b0dc"}
Nov 04 03:46:36.326823 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.326184    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/26f637a4-444a-4725-b7cf-eab47dd1e7b9-kube-api-access-f298c\" (UniqueName: \"kubernetes.io/projected/26f637a4-444a-4725-b7cf-eab47dd1e7b9-kube-api-access-f298c\") pod \"26f637a4-444a-4725-b7cf-eab47dd1e7b9\" (UID: \"26f637a4-444a-4725-b7cf-eab47dd1e7b9\") "
Nov 04 03:46:36.326823 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.326313    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/26f637a4-444a-4725-b7cf-eab47dd1e7b9-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26f637a4-444a-4725-b7cf-eab47dd1e7b9-plugins-config-volume\") pod \"26f637a4-444a-4725-b7cf-eab47dd1e7b9\" (UID: \"26f637a4-444a-4725-b7cf-eab47dd1e7b9\") "
Nov 04 03:46:36.326915 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.326890    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26f637a4-444a-4725-b7cf-eab47dd1e7b9-plugins-config-volume" pod "26f637a4-444a-4725-b7cf-eab47dd1e7b9" (UID: "26f637a4-444a-4725-b7cf-eab47dd1e7b9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:46:36.334184 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.334164    4510 scope.go:122] "RemoveContainer" containerID="9f66612ebc5cfa02b28c6a56883693126af18e29fff85c71725569d50585ce9e"
Nov 04 03:46:36.334494 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:46:36.334468    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f66612ebc5cfa02b28c6a56883693126af18e29fff85c71725569d50585ce9e\": container with ID starting with 9f66612ebc5cfa02b28c6a56883693126af18e29fff85c71725569d50585ce9e not found: ID does not exist" containerID="9f66612ebc5cfa02b28c6a56883693126af18e29fff85c71725569d50585ce9e"
Nov 04 03:46:36.334582 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.334503    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f66612ebc5cfa02b28c6a56883693126af18e29fff85c71725569d50585ce9e"} err="failed to get container status \"9f66612ebc5cfa02b28c6a56883693126af18e29fff85c71725569d50585ce9e\": rpc error: code = NotFound desc = could not find container \"9f66612ebc5cfa02b28c6a56883693126af18e29fff85c71725569d50585ce9e\": container with ID starting with 9f66612ebc5cfa02b28c6a56883693126af18e29fff85c71725569d50585ce9e not found: ID does not exist"
Nov 04 03:46:36.335070 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.334990    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26f637a4-444a-4725-b7cf-eab47dd1e7b9-kube-api-access-f298c" pod "26f637a4-444a-4725-b7cf-eab47dd1e7b9" (UID: "26f637a4-444a-4725-b7cf-eab47dd1e7b9"). InnerVolumeSpecName "kube-api-access-f298c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:46:36.400980 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.400949    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v"
Nov 04 03:46:36.427511 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.427481    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e8e768db-6b1c-43ae-9b85-0c0427ef4c66-kube-api-access-qn4bq\" (UniqueName: \"kubernetes.io/projected/e8e768db-6b1c-43ae-9b85-0c0427ef4c66-kube-api-access-qn4bq\") pod \"e8e768db-6b1c-43ae-9b85-0c0427ef4c66\" (UID: \"e8e768db-6b1c-43ae-9b85-0c0427ef4c66\") "
Nov 04 03:46:36.427714 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.427518    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e8e768db-6b1c-43ae-9b85-0c0427ef4c66-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8e768db-6b1c-43ae-9b85-0c0427ef4c66-plugins-config-volume\") pod \"e8e768db-6b1c-43ae-9b85-0c0427ef4c66\" (UID: \"e8e768db-6b1c-43ae-9b85-0c0427ef4c66\") "
Nov 04 03:46:36.427834 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.427814    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f298c\" (UniqueName: \"kubernetes.io/projected/26f637a4-444a-4725-b7cf-eab47dd1e7b9-kube-api-access-f298c\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:36.427914 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.427841    4510 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26f637a4-444a-4725-b7cf-eab47dd1e7b9-plugins-config-volume\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:36.428020 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.427995    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8e768db-6b1c-43ae-9b85-0c0427ef4c66-plugins-config-volume" pod "e8e768db-6b1c-43ae-9b85-0c0427ef4c66" (UID: "e8e768db-6b1c-43ae-9b85-0c0427ef4c66"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:46:36.430024 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.429990    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8e768db-6b1c-43ae-9b85-0c0427ef4c66-kube-api-access-qn4bq" pod "e8e768db-6b1c-43ae-9b85-0c0427ef4c66" (UID: "e8e768db-6b1c-43ae-9b85-0c0427ef4c66"). InnerVolumeSpecName "kube-api-access-qn4bq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:46:36.528832 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.528803    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qn4bq\" (UniqueName: \"kubernetes.io/projected/e8e768db-6b1c-43ae-9b85-0c0427ef4c66-kube-api-access-qn4bq\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:36.528832 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.528827    4510 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8e768db-6b1c-43ae-9b85-0c0427ef4c66-plugins-config-volume\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:36.740872 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.740840    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr"]
Nov 04 03:46:36.745160 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.745129    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-a-13190c-8589c7b8bb-pkxrr"]
Nov 04 03:46:36.868782 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:36.868750    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="26f637a4-444a-4725-b7cf-eab47dd1e7b9" path="/var/lib/kubelet/pods/26f637a4-444a-4725-b7cf-eab47dd1e7b9/volumes"
Nov 04 03:46:37.331660 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:37.331550    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v" event={"ID":"e8e768db-6b1c-43ae-9b85-0c0427ef4c66","Type":"ContainerDied","Data":"2fb2d151b8dfa4c16fb7400717e6e36d2841d459428ad8b0701f21af05bcf3fb"}
Nov 04 03:46:37.331660 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:37.331595    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v"
Nov 04 03:46:37.331660 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:37.331638    4510 scope.go:122] "RemoveContainer" containerID="f09295754be9948b106b8c2c5c8c9d7dff7eba8a0522a91cb107ebbdde30b0dc"
Nov 04 03:46:37.495945 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:37.495916    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v"]
Nov 04 03:46:37.545728 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:37.545697    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-a-13190c-97548c4ff-dm59v"]
Nov 04 03:46:38.862014 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:38.861982    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e8e768db-6b1c-43ae-9b85-0c0427ef4c66" path="/var/lib/kubelet/pods/e8e768db-6b1c-43ae-9b85-0c0427ef4c66/volumes"
Nov 04 03:46:41.781109 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:41.781072    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"]
Nov 04 03:46:41.781587 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:41.781330    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh" podUID="c999ed6d-66f4-4695-bf7a-bc63f68c466b" containerName="istio-proxy" containerID="cri-o://239e0b1cdbf620e232afa316873dda0bc5b87d38d00ce16abff7695c27894ef5" gracePeriod=30
Nov 04 03:46:41.831138 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:41.831102    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"]
Nov 04 03:46:41.831331 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:41.831295    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf" podUID="85cb4aab-7613-481a-af4c-228be87df8c9" containerName="istio-proxy" containerID="cri-o://f763177edfa06b4711fd496e7a77cac0c03b0b0721608124e0783e5d2253867d" gracePeriod=30
Nov 04 03:46:41.833252 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:41.833228    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"]
Nov 04 03:46:41.833405 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:41.833373    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8" podUID="ce520f3c-5385-4894-801d-d63a326ec3f5" containerName="istio-proxy" containerID="cri-o://f8d22bb3aa4058e0d4afbb9561c5a79d63a2029d0724d8ce1adc92a9e1a5a32a" gracePeriod=30
Nov 04 03:46:41.881569 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:41.881543    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"]
Nov 04 03:46:41.881774 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:41.881752    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6" podUID="0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" containerName="istio-proxy" containerID="cri-o://42b665ddb2d3a24c087183030680306ea13be3239ba65a284e36b30ab18fc2bb" gracePeriod=30
Nov 04 03:46:42.864598 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:42.864561    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mpwlf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Nov 04 03:46:42.864990 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:42.864609    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf" podUID="85cb4aab-7613-481a-af4c-228be87df8c9" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 03:46:47.110283 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.109966    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:46:47.145077 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.145052    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-envoy\") pod \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") "
Nov 04 03:46:47.145174 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.145103    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-data\") pod \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") "
Nov 04 03:46:47.145174 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.145142    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-credential-socket\") pod \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") "
Nov 04 03:46:47.145174 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.145161    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-podinfo\") pod \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") "
Nov 04 03:46:47.145334 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.145182    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istiod-ca-cert\") pod \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") "
Nov 04 03:46:47.145334 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.145233    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-workload-socket\") pod \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") "
Nov 04 03:46:47.145334 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.145286    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-workload-certs\") pod \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") "
Nov 04 03:46:47.145334 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.145321    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c999ed6d-66f4-4695-bf7a-bc63f68c466b-kube-api-access-nmlnb\" (UniqueName: \"kubernetes.io/projected/c999ed6d-66f4-4695-bf7a-bc63f68c466b-kube-api-access-nmlnb\") pod \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") "
Nov 04 03:46:47.145520 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.145359    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-token\" (UniqueName: \"kubernetes.io/projected/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-token\") pod \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\" (UID: \"c999ed6d-66f4-4695-bf7a-bc63f68c466b\") "
Nov 04 03:46:47.146444 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.146364    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-data" pod "c999ed6d-66f4-4695-bf7a-bc63f68c466b" (UID: "c999ed6d-66f4-4695-bf7a-bc63f68c466b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.146614 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.146563    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-workload-socket" pod "c999ed6d-66f4-4695-bf7a-bc63f68c466b" (UID: "c999ed6d-66f4-4695-bf7a-bc63f68c466b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.147206 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.147023    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-credential-socket" pod "c999ed6d-66f4-4695-bf7a-bc63f68c466b" (UID: "c999ed6d-66f4-4695-bf7a-bc63f68c466b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.147206 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.147031    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istiod-ca-cert" pod "c999ed6d-66f4-4695-bf7a-bc63f68c466b" (UID: "c999ed6d-66f4-4695-bf7a-bc63f68c466b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:46:47.147206 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.147094    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-workload-certs" pod "c999ed6d-66f4-4695-bf7a-bc63f68c466b" (UID: "c999ed6d-66f4-4695-bf7a-bc63f68c466b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.149173 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.149128    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-token" pod "c999ed6d-66f4-4695-bf7a-bc63f68c466b" (UID: "c999ed6d-66f4-4695-bf7a-bc63f68c466b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:46:47.149779 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.149741    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c999ed6d-66f4-4695-bf7a-bc63f68c466b-kube-api-access-nmlnb" pod "c999ed6d-66f4-4695-bf7a-bc63f68c466b" (UID: "c999ed6d-66f4-4695-bf7a-bc63f68c466b"). InnerVolumeSpecName "kube-api-access-nmlnb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:46:47.151153 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.151117    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-podinfo" pod "c999ed6d-66f4-4695-bf7a-bc63f68c466b" (UID: "c999ed6d-66f4-4695-bf7a-bc63f68c466b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 03:46:47.151756 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.151730    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-envoy" pod "c999ed6d-66f4-4695-bf7a-bc63f68c466b" (UID: "c999ed6d-66f4-4695-bf7a-bc63f68c466b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.175164 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.175133    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:46:47.214840 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.214810    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:46:47.219485 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.219461    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:46:47.246823 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.246799    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ce520f3c-5385-4894-801d-d63a326ec3f5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce520f3c-5385-4894-801d-d63a326ec3f5-istiod-ca-cert\") pod \"ce520f3c-5385-4894-801d-d63a326ec3f5\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") "
Nov 04 03:46:47.246959 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.246832    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-credential-socket\") pod \"ce520f3c-5385-4894-801d-d63a326ec3f5\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") "
Nov 04 03:46:47.246959 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.246880    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-envoy\") pod \"ce520f3c-5385-4894-801d-d63a326ec3f5\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") "
Nov 04 03:46:47.246959 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.246935    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-token\" (UniqueName: \"kubernetes.io/projected/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-token\") pod \"ce520f3c-5385-4894-801d-d63a326ec3f5\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") "
Nov 04 03:46:47.247093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247028    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-data\") pod \"ce520f3c-5385-4894-801d-d63a326ec3f5\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") "
Nov 04 03:46:47.247093 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247061    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-workload-certs\") pod \"ce520f3c-5385-4894-801d-d63a326ec3f5\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") "
Nov 04 03:46:47.247190 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247090    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-workload-socket\") pod \"ce520f3c-5385-4894-801d-d63a326ec3f5\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") "
Nov 04 03:46:47.247190 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247153    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-podinfo\") pod \"ce520f3c-5385-4894-801d-d63a326ec3f5\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") "
Nov 04 03:46:47.247307 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247203    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce520f3c-5385-4894-801d-d63a326ec3f5-kube-api-access-w88br\" (UniqueName: \"kubernetes.io/projected/ce520f3c-5385-4894-801d-d63a326ec3f5-kube-api-access-w88br\") pod \"ce520f3c-5385-4894-801d-d63a326ec3f5\" (UID: \"ce520f3c-5385-4894-801d-d63a326ec3f5\") "
Nov 04 03:46:47.247307 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247209    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-credential-socket" pod "ce520f3c-5385-4894-801d-d63a326ec3f5" (UID: "ce520f3c-5385-4894-801d-d63a326ec3f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.247414 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247323    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-data" pod "ce520f3c-5385-4894-801d-d63a326ec3f5" (UID: "ce520f3c-5385-4894-801d-d63a326ec3f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.247414 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247361    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce520f3c-5385-4894-801d-d63a326ec3f5-istiod-ca-cert" pod "ce520f3c-5385-4894-801d-d63a326ec3f5" (UID: "ce520f3c-5385-4894-801d-d63a326ec3f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:46:47.247414 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247365    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-workload-certs" pod "ce520f3c-5385-4894-801d-d63a326ec3f5" (UID: "ce520f3c-5385-4894-801d-d63a326ec3f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.247543 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247437    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-workload-socket" pod "ce520f3c-5385-4894-801d-d63a326ec3f5" (UID: "ce520f3c-5385-4894-801d-d63a326ec3f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.247721 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247667    4510 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-envoy\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.247810 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247728    4510 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-data\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.247810 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247743    4510 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ce520f3c-5385-4894-801d-d63a326ec3f5-istiod-ca-cert\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.247810 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247757    4510 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-credential-socket\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.247810 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247770    4510 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-credential-socket\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.247810 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247783    4510 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-podinfo\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.247810 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247796    4510 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istiod-ca-cert\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.247810 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247809    4510 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-workload-socket\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.248358 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247821    4510 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c999ed6d-66f4-4695-bf7a-bc63f68c466b-workload-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.248358 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247835    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nmlnb\" (UniqueName: \"kubernetes.io/projected/c999ed6d-66f4-4695-bf7a-bc63f68c466b-kube-api-access-nmlnb\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.248358 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247850    4510 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-data\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.248358 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247863    4510 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c999ed6d-66f4-4695-bf7a-bc63f68c466b-istio-token\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.248358 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247876    4510 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-workload-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.248358 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.247889    4510 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-workload-socket\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.249380 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.249357    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-token" pod "ce520f3c-5385-4894-801d-d63a326ec3f5" (UID: "ce520f3c-5385-4894-801d-d63a326ec3f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:46:47.249571 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.249549    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-podinfo" pod "ce520f3c-5385-4894-801d-d63a326ec3f5" (UID: "ce520f3c-5385-4894-801d-d63a326ec3f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 03:46:47.249784 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.249762    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-envoy" pod "ce520f3c-5385-4894-801d-d63a326ec3f5" (UID: "ce520f3c-5385-4894-801d-d63a326ec3f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.249855 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.249758    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce520f3c-5385-4894-801d-d63a326ec3f5-kube-api-access-w88br" pod "ce520f3c-5385-4894-801d-d63a326ec3f5" (UID: "ce520f3c-5385-4894-801d-d63a326ec3f5"). InnerVolumeSpecName "kube-api-access-w88br". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:46:47.348325 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348231    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-kube-api-access-tf9xq\" (UniqueName: \"kubernetes.io/projected/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-kube-api-access-tf9xq\") pod \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") "
Nov 04 03:46:47.348325 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348270    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-workload-socket\") pod \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") "
Nov 04 03:46:47.348325 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348307    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-data\") pod \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") "
Nov 04 03:46:47.348614 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348337    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-credential-socket\") pod \"85cb4aab-7613-481a-af4c-228be87df8c9\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") "
Nov 04 03:46:47.348614 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348368    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-workload-certs\") pod \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") "
Nov 04 03:46:47.348614 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348416    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-workload-socket\") pod \"85cb4aab-7613-481a-af4c-228be87df8c9\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") "
Nov 04 03:46:47.348614 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348468    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/85cb4aab-7613-481a-af4c-228be87df8c9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85cb4aab-7613-481a-af4c-228be87df8c9-istio-podinfo\") pod \"85cb4aab-7613-481a-af4c-228be87df8c9\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") "
Nov 04 03:46:47.348614 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348500    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-istio-envoy\") pod \"85cb4aab-7613-481a-af4c-228be87df8c9\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") "
Nov 04 03:46:47.348614 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348541    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istiod-ca-cert\") pod \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") "
Nov 04 03:46:47.348614 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348587    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-credential-socket" pod "85cb4aab-7613-481a-af4c-228be87df8c9" (UID: "85cb4aab-7613-481a-af4c-228be87df8c9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.349022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348605    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-workload-socket" pod "0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" (UID: "0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.349022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348603    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-envoy\") pod \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") "
Nov 04 03:46:47.349022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348709    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-data" pod "0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" (UID: "0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.349022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348736    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/85cb4aab-7613-481a-af4c-228be87df8c9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85cb4aab-7613-481a-af4c-228be87df8c9-istiod-ca-cert\") pod \"85cb4aab-7613-481a-af4c-228be87df8c9\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") "
Nov 04 03:46:47.349022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348781    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-workload-certs" pod "0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" (UID: "0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.349022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348798    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/85cb4aab-7613-481a-af4c-228be87df8c9-istio-token\" (UniqueName: \"kubernetes.io/projected/85cb4aab-7613-481a-af4c-228be87df8c9-istio-token\") pod \"85cb4aab-7613-481a-af4c-228be87df8c9\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") "
Nov 04 03:46:47.349022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348836    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-credential-socket\") pod \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") "
Nov 04 03:46:47.349022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348869    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/85cb4aab-7613-481a-af4c-228be87df8c9-kube-api-access-ptshj\" (UniqueName: \"kubernetes.io/projected/85cb4aab-7613-481a-af4c-228be87df8c9-kube-api-access-ptshj\") pod \"85cb4aab-7613-481a-af4c-228be87df8c9\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") "
Nov 04 03:46:47.349022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348907    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-istio-data\") pod \"85cb4aab-7613-481a-af4c-228be87df8c9\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") "
Nov 04 03:46:47.349022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348937    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-token\" (UniqueName: \"kubernetes.io/projected/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-token\") pod \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") "
Nov 04 03:46:47.349022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.348993    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-podinfo\") pod \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\" (UID: \"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7\") "
Nov 04 03:46:47.349022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.349021    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-workload-certs\") pod \"85cb4aab-7613-481a-af4c-228be87df8c9\" (UID: \"85cb4aab-7613-481a-af4c-228be87df8c9\") "
Nov 04 03:46:47.349849 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.349066    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-workload-socket" pod "85cb4aab-7613-481a-af4c-228be87df8c9" (UID: "85cb4aab-7613-481a-af4c-228be87df8c9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.349849 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.349090    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85cb4aab-7613-481a-af4c-228be87df8c9-istiod-ca-cert" pod "85cb4aab-7613-481a-af4c-228be87df8c9" (UID: "85cb4aab-7613-481a-af4c-228be87df8c9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:46:47.349849 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.349364    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-istio-data" pod "85cb4aab-7613-481a-af4c-228be87df8c9" (UID: "85cb4aab-7613-481a-af4c-228be87df8c9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.349849 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.349374    4510 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-envoy\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.349849 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.349402    4510 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-token\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.349849 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.349417    4510 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-workload-socket\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.349849 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.349430    4510 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-data\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.349849 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.349443    4510 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-credential-socket\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.349849 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.349456    4510 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-workload-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.349849 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.349469    4510 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-workload-socket\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.349849 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.349487    4510 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ce520f3c-5385-4894-801d-d63a326ec3f5-istio-podinfo\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.349849 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.349505    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w88br\" (UniqueName: \"kubernetes.io/projected/ce520f3c-5385-4894-801d-d63a326ec3f5-kube-api-access-w88br\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.349849 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.349521    4510 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85cb4aab-7613-481a-af4c-228be87df8c9-istiod-ca-cert\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.349849 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.349528    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istiod-ca-cert" pod "0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" (UID: "0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:46:47.349849 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.349776    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-credential-socket" pod "0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" (UID: "0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.350660 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.349881    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-workload-certs" pod "85cb4aab-7613-481a-af4c-228be87df8c9" (UID: "85cb4aab-7613-481a-af4c-228be87df8c9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.351347 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.351318    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-kube-api-access-tf9xq" pod "0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" (UID: "0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7"). InnerVolumeSpecName "kube-api-access-tf9xq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:46:47.351464 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.351374    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-istio-envoy" pod "85cb4aab-7613-481a-af4c-228be87df8c9" (UID: "85cb4aab-7613-481a-af4c-228be87df8c9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.351863 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.351834    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85cb4aab-7613-481a-af4c-228be87df8c9-kube-api-access-ptshj" pod "85cb4aab-7613-481a-af4c-228be87df8c9" (UID: "85cb4aab-7613-481a-af4c-228be87df8c9"). InnerVolumeSpecName "kube-api-access-ptshj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:46:47.351863 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.351841    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85cb4aab-7613-481a-af4c-228be87df8c9-istio-podinfo" pod "85cb4aab-7613-481a-af4c-228be87df8c9" (UID: "85cb4aab-7613-481a-af4c-228be87df8c9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 03:46:47.352029 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.351947    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-envoy" pod "0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" (UID: "0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:46:47.352213 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.352198    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-podinfo" pod "0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" (UID: "0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 03:46:47.352253 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.352217    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85cb4aab-7613-481a-af4c-228be87df8c9-istio-token" pod "85cb4aab-7613-481a-af4c-228be87df8c9" (UID: "85cb4aab-7613-481a-af4c-228be87df8c9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:46:47.352774 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.352751    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-token" pod "0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" (UID: "0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:46:47.387789 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.387759    4510 generic.go:356] "Generic (PLEG): container finished" podID="c999ed6d-66f4-4695-bf7a-bc63f68c466b" containerID="239e0b1cdbf620e232afa316873dda0bc5b87d38d00ce16abff7695c27894ef5" exitCode=0
Nov 04 03:46:47.387925 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.387823    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"
Nov 04 03:46:47.387925 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.387849    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh" event={"ID":"c999ed6d-66f4-4695-bf7a-bc63f68c466b","Type":"ContainerDied","Data":"239e0b1cdbf620e232afa316873dda0bc5b87d38d00ce16abff7695c27894ef5"}
Nov 04 03:46:47.388011 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.387952    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh" event={"ID":"c999ed6d-66f4-4695-bf7a-bc63f68c466b","Type":"ContainerDied","Data":"8cef1e8499e7d008791db36a2b16090cd0eca79453dbdfcafdb64c2540d345ff"}
Nov 04 03:46:47.388011 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.387985    4510 scope.go:122] "RemoveContainer" containerID="239e0b1cdbf620e232afa316873dda0bc5b87d38d00ce16abff7695c27894ef5"
Nov 04 03:46:47.389236 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.389212    4510 generic.go:356] "Generic (PLEG): container finished" podID="0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" containerID="42b665ddb2d3a24c087183030680306ea13be3239ba65a284e36b30ab18fc2bb" exitCode=0
Nov 04 03:46:47.389349 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.389285    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"
Nov 04 03:46:47.389349 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.389304    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6" event={"ID":"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7","Type":"ContainerDied","Data":"42b665ddb2d3a24c087183030680306ea13be3239ba65a284e36b30ab18fc2bb"}
Nov 04 03:46:47.389438 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.389360    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6" event={"ID":"0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7","Type":"ContainerDied","Data":"4cb4fb0400dc013ff3287d4fc1ea6f762f317210a351bffcbe6d4b04ced87a94"}
Nov 04 03:46:47.395649 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.395625    4510 generic.go:356] "Generic (PLEG): container finished" podID="85cb4aab-7613-481a-af4c-228be87df8c9" containerID="f763177edfa06b4711fd496e7a77cac0c03b0b0721608124e0783e5d2253867d" exitCode=0
Nov 04 03:46:47.395787 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.395700    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"
Nov 04 03:46:47.395787 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.395724    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf" event={"ID":"85cb4aab-7613-481a-af4c-228be87df8c9","Type":"ContainerDied","Data":"f763177edfa06b4711fd496e7a77cac0c03b0b0721608124e0783e5d2253867d"}
Nov 04 03:46:47.395787 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.395780    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf" event={"ID":"85cb4aab-7613-481a-af4c-228be87df8c9","Type":"ContainerDied","Data":"65af33d0b0425e2eac8aed85e6a8db812d0cc6edffc3b1afcb58e7e7c2b29f27"}
Nov 04 03:46:47.399703 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.399667    4510 generic.go:356] "Generic (PLEG): container finished" podID="ce520f3c-5385-4894-801d-d63a326ec3f5" containerID="f8d22bb3aa4058e0d4afbb9561c5a79d63a2029d0724d8ce1adc92a9e1a5a32a" exitCode=0
Nov 04 03:46:47.399877 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.399707    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8" event={"ID":"ce520f3c-5385-4894-801d-d63a326ec3f5","Type":"ContainerDied","Data":"f8d22bb3aa4058e0d4afbb9561c5a79d63a2029d0724d8ce1adc92a9e1a5a32a"}
Nov 04 03:46:47.400023 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.400008    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8" event={"ID":"ce520f3c-5385-4894-801d-d63a326ec3f5","Type":"ContainerDied","Data":"fbee21eda1609695554ca84a2133ce3058c02eeb5e9a937ee1d1d50b7b177ae9"}
Nov 04 03:46:47.400181 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.399776    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"
Nov 04 03:46:47.403605 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.403570    4510 scope.go:122] "RemoveContainer" containerID="239e0b1cdbf620e232afa316873dda0bc5b87d38d00ce16abff7695c27894ef5"
Nov 04 03:46:47.403915 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:46:47.403881    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"239e0b1cdbf620e232afa316873dda0bc5b87d38d00ce16abff7695c27894ef5\": container with ID starting with 239e0b1cdbf620e232afa316873dda0bc5b87d38d00ce16abff7695c27894ef5 not found: ID does not exist" containerID="239e0b1cdbf620e232afa316873dda0bc5b87d38d00ce16abff7695c27894ef5"
Nov 04 03:46:47.404008 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.403927    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"239e0b1cdbf620e232afa316873dda0bc5b87d38d00ce16abff7695c27894ef5"} err="failed to get container status \"239e0b1cdbf620e232afa316873dda0bc5b87d38d00ce16abff7695c27894ef5\": rpc error: code = NotFound desc = could not find container \"239e0b1cdbf620e232afa316873dda0bc5b87d38d00ce16abff7695c27894ef5\": container with ID starting with 239e0b1cdbf620e232afa316873dda0bc5b87d38d00ce16abff7695c27894ef5 not found: ID does not exist"
Nov 04 03:46:47.404008 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.403950    4510 scope.go:122] "RemoveContainer" containerID="42b665ddb2d3a24c087183030680306ea13be3239ba65a284e36b30ab18fc2bb"
Nov 04 03:46:47.420217 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.420138    4510 scope.go:122] "RemoveContainer" containerID="42b665ddb2d3a24c087183030680306ea13be3239ba65a284e36b30ab18fc2bb"
Nov 04 03:46:47.420487 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:46:47.420456    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42b665ddb2d3a24c087183030680306ea13be3239ba65a284e36b30ab18fc2bb\": container with ID starting with 42b665ddb2d3a24c087183030680306ea13be3239ba65a284e36b30ab18fc2bb not found: ID does not exist" containerID="42b665ddb2d3a24c087183030680306ea13be3239ba65a284e36b30ab18fc2bb"
Nov 04 03:46:47.420576 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.420495    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42b665ddb2d3a24c087183030680306ea13be3239ba65a284e36b30ab18fc2bb"} err="failed to get container status \"42b665ddb2d3a24c087183030680306ea13be3239ba65a284e36b30ab18fc2bb\": rpc error: code = NotFound desc = could not find container \"42b665ddb2d3a24c087183030680306ea13be3239ba65a284e36b30ab18fc2bb\": container with ID starting with 42b665ddb2d3a24c087183030680306ea13be3239ba65a284e36b30ab18fc2bb not found: ID does not exist"
Nov 04 03:46:47.420576 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.420516    4510 scope.go:122] "RemoveContainer" containerID="f763177edfa06b4711fd496e7a77cac0c03b0b0721608124e0783e5d2253867d"
Nov 04 03:46:47.430293 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.430270    4510 scope.go:122] "RemoveContainer" containerID="7e46aa0f8ee424bbb32cfa7b40d63e269e06aadbaf6882763c634dc519a68632"
Nov 04 03:46:47.441149 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.441129    4510 scope.go:122] "RemoveContainer" containerID="f763177edfa06b4711fd496e7a77cac0c03b0b0721608124e0783e5d2253867d"
Nov 04 03:46:47.441512 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:46:47.441476    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f763177edfa06b4711fd496e7a77cac0c03b0b0721608124e0783e5d2253867d\": container with ID starting with f763177edfa06b4711fd496e7a77cac0c03b0b0721608124e0783e5d2253867d not found: ID does not exist" containerID="f763177edfa06b4711fd496e7a77cac0c03b0b0721608124e0783e5d2253867d"
Nov 04 03:46:47.441569 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.441526    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f763177edfa06b4711fd496e7a77cac0c03b0b0721608124e0783e5d2253867d"} err="failed to get container status \"f763177edfa06b4711fd496e7a77cac0c03b0b0721608124e0783e5d2253867d\": rpc error: code = NotFound desc = could not find container \"f763177edfa06b4711fd496e7a77cac0c03b0b0721608124e0783e5d2253867d\": container with ID starting with f763177edfa06b4711fd496e7a77cac0c03b0b0721608124e0783e5d2253867d not found: ID does not exist"
Nov 04 03:46:47.441569 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.441551    4510 scope.go:122] "RemoveContainer" containerID="7e46aa0f8ee424bbb32cfa7b40d63e269e06aadbaf6882763c634dc519a68632"
Nov 04 03:46:47.441871 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:46:47.441848    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e46aa0f8ee424bbb32cfa7b40d63e269e06aadbaf6882763c634dc519a68632\": container with ID starting with 7e46aa0f8ee424bbb32cfa7b40d63e269e06aadbaf6882763c634dc519a68632 not found: ID does not exist" containerID="7e46aa0f8ee424bbb32cfa7b40d63e269e06aadbaf6882763c634dc519a68632"
Nov 04 03:46:47.441983 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.441882    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e46aa0f8ee424bbb32cfa7b40d63e269e06aadbaf6882763c634dc519a68632"} err="failed to get container status \"7e46aa0f8ee424bbb32cfa7b40d63e269e06aadbaf6882763c634dc519a68632\": rpc error: code = NotFound desc = could not find container \"7e46aa0f8ee424bbb32cfa7b40d63e269e06aadbaf6882763c634dc519a68632\": container with ID starting with 7e46aa0f8ee424bbb32cfa7b40d63e269e06aadbaf6882763c634dc519a68632 not found: ID does not exist"
Nov 04 03:46:47.441983 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.441899    4510 scope.go:122] "RemoveContainer" containerID="f8d22bb3aa4058e0d4afbb9561c5a79d63a2029d0724d8ce1adc92a9e1a5a32a"
Nov 04 03:46:47.451315 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.450976    4510 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85cb4aab-7613-481a-af4c-228be87df8c9-istio-podinfo\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.451315 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.451004    4510 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-istio-envoy\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.451315 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.451019    4510 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istiod-ca-cert\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.451315 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.451032    4510 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-envoy\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.451315 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.451045    4510 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85cb4aab-7613-481a-af4c-228be87df8c9-istio-token\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.451315 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.451057    4510 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-credential-socket\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.451315 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.451070    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptshj\" (UniqueName: \"kubernetes.io/projected/85cb4aab-7613-481a-af4c-228be87df8c9-kube-api-access-ptshj\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.451315 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.451085    4510 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-istio-data\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.451315 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.451099    4510 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-token\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.451315 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.451111    4510 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-istio-podinfo\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.451315 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.451123    4510 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85cb4aab-7613-481a-af4c-228be87df8c9-workload-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.451315 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.451136    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf9xq\" (UniqueName: \"kubernetes.io/projected/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7-kube-api-access-tf9xq\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:46:47.453895 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.453874    4510 scope.go:122] "RemoveContainer" containerID="f8d22bb3aa4058e0d4afbb9561c5a79d63a2029d0724d8ce1adc92a9e1a5a32a"
Nov 04 03:46:47.454176 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:46:47.454144    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8d22bb3aa4058e0d4afbb9561c5a79d63a2029d0724d8ce1adc92a9e1a5a32a\": container with ID starting with f8d22bb3aa4058e0d4afbb9561c5a79d63a2029d0724d8ce1adc92a9e1a5a32a not found: ID does not exist" containerID="f8d22bb3aa4058e0d4afbb9561c5a79d63a2029d0724d8ce1adc92a9e1a5a32a"
Nov 04 03:46:47.454217 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.454185    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8d22bb3aa4058e0d4afbb9561c5a79d63a2029d0724d8ce1adc92a9e1a5a32a"} err="failed to get container status \"f8d22bb3aa4058e0d4afbb9561c5a79d63a2029d0724d8ce1adc92a9e1a5a32a\": rpc error: code = NotFound desc = could not find container \"f8d22bb3aa4058e0d4afbb9561c5a79d63a2029d0724d8ce1adc92a9e1a5a32a\": container with ID starting with f8d22bb3aa4058e0d4afbb9561c5a79d63a2029d0724d8ce1adc92a9e1a5a32a not found: ID does not exist"
Nov 04 03:46:47.760553 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.760519    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"]
Nov 04 03:46:47.811776 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.811607    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-zsxt6"]
Nov 04 03:46:47.875403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.875373    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"]
Nov 04 03:46:47.881365 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:47.881336    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mpwlf"]
Nov 04 03:46:48.000528 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:48.000492    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"]
Nov 04 03:46:48.022392 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:48.022319    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-xgbfh"]
Nov 04 03:46:48.142072 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:48.142038    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"]
Nov 04 03:46:48.156643 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:48.156609    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-42zq8"]
Nov 04 03:46:48.862060 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:48.862027    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" path="/var/lib/kubelet/pods/0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7/volumes"
Nov 04 03:46:48.862460 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:48.862448    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="85cb4aab-7613-481a-af4c-228be87df8c9" path="/var/lib/kubelet/pods/85cb4aab-7613-481a-af4c-228be87df8c9/volumes"
Nov 04 03:46:48.862862 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:48.862849    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c999ed6d-66f4-4695-bf7a-bc63f68c466b" path="/var/lib/kubelet/pods/c999ed6d-66f4-4695-bf7a-bc63f68c466b/volumes"
Nov 04 03:46:48.863550 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:48.863521    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ce520f3c-5385-4894-801d-d63a326ec3f5" path="/var/lib/kubelet/pods/ce520f3c-5385-4894-801d-d63a326ec3f5/volumes"
Nov 04 03:46:53.315817 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:46:53.315763    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:46:56.916492 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.916454    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"]
Nov 04 03:46:56.917026 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.916984    4510 cpu_manager.go:414] "containerMap: removing container" podUID="b73b78e7-78dc-44b0-8567-ebdb30939c29" containerName="istio-proxy"
Nov 04 03:46:56.917026 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917004    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b73b78e7-78dc-44b0-8567-ebdb30939c29" containerName="istio-proxy"
Nov 04 03:46:56.917026 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917022    4510 cpu_manager.go:414] "containerMap: removing container" podUID="c999ed6d-66f4-4695-bf7a-bc63f68c466b" containerName="istio-proxy"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917031    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c999ed6d-66f4-4695-bf7a-bc63f68c466b" containerName="istio-proxy"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917047    4510 cpu_manager.go:414] "containerMap: removing container" podUID="e8e768db-6b1c-43ae-9b85-0c0427ef4c66" containerName="payload-pre-processing"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917056    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e8e768db-6b1c-43ae-9b85-0c0427ef4c66" containerName="payload-pre-processing"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917068    4510 cpu_manager.go:414] "containerMap: removing container" podUID="e7512762-8459-4fe2-a5e6-bcf32b17a181" containerName="istio-proxy"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917074    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e7512762-8459-4fe2-a5e6-bcf32b17a181" containerName="istio-proxy"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917092    4510 cpu_manager.go:414] "containerMap: removing container" podUID="85cb4aab-7613-481a-af4c-228be87df8c9" containerName="istio-proxy"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917099    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="85cb4aab-7613-481a-af4c-228be87df8c9" containerName="istio-proxy"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917110    4510 cpu_manager.go:414] "containerMap: removing container" podUID="b7e091e0-5112-49c2-8801-d0c6a46e8e01" containerName="main"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917117    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b7e091e0-5112-49c2-8801-d0c6a46e8e01" containerName="main"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917128    4510 cpu_manager.go:414] "containerMap: removing container" podUID="e7512762-8459-4fe2-a5e6-bcf32b17a181" containerName="istio-proxy"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917136    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e7512762-8459-4fe2-a5e6-bcf32b17a181" containerName="istio-proxy"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917146    4510 cpu_manager.go:414] "containerMap: removing container" podUID="c49160c5-aeac-464e-9a7f-8e436aa1e90e" containerName="payload-processing"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917154    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c49160c5-aeac-464e-9a7f-8e436aa1e90e" containerName="payload-processing"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917165    4510 cpu_manager.go:414] "containerMap: removing container" podUID="85cb4aab-7613-481a-af4c-228be87df8c9" containerName="istio-proxy"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917174    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="85cb4aab-7613-481a-af4c-228be87df8c9" containerName="istio-proxy"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917187    4510 cpu_manager.go:414] "containerMap: removing container" podUID="711e1966-9061-4246-951f-f99bd1963969" containerName="payload-processing"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917195    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="711e1966-9061-4246-951f-f99bd1963969" containerName="payload-processing"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917206    4510 cpu_manager.go:414] "containerMap: removing container" podUID="5881ff60-a61f-416c-8034-a9991921631b" containerName="main"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917213    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5881ff60-a61f-416c-8034-a9991921631b" containerName="main"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917223    4510 cpu_manager.go:414] "containerMap: removing container" podUID="37beb582-a33b-4214-a262-1f2ba08ce759" containerName="maas-api"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917230    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="37beb582-a33b-4214-a262-1f2ba08ce759" containerName="maas-api"
Nov 04 03:46:56.917234 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917243    4510 cpu_manager.go:414] "containerMap: removing container" podUID="bbc02f97-cd51-49be-9dda-5c14d6beb6c6" containerName="main"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917249    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bbc02f97-cd51-49be-9dda-5c14d6beb6c6" containerName="main"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917259    4510 cpu_manager.go:414] "containerMap: removing container" podUID="a8307d11-d8a0-49c1-b3eb-d6b238871f5c" containerName="payload-processing"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917266    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a8307d11-d8a0-49c1-b3eb-d6b238871f5c" containerName="payload-processing"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917278    4510 cpu_manager.go:414] "containerMap: removing container" podUID="26f637a4-444a-4725-b7cf-eab47dd1e7b9" containerName="payload-processing"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917286    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="26f637a4-444a-4725-b7cf-eab47dd1e7b9" containerName="payload-processing"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917298    4510 cpu_manager.go:414] "containerMap: removing container" podUID="0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" containerName="istio-proxy"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917304    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" containerName="istio-proxy"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917314    4510 cpu_manager.go:414] "containerMap: removing container" podUID="8b9608b1-179d-4740-bffe-ba998cdea67b" containerName="istio-proxy"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917321    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8b9608b1-179d-4740-bffe-ba998cdea67b" containerName="istio-proxy"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917331    4510 cpu_manager.go:414] "containerMap: removing container" podUID="ce520f3c-5385-4894-801d-d63a326ec3f5" containerName="istio-proxy"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917338    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce520f3c-5385-4894-801d-d63a326ec3f5" containerName="istio-proxy"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917359    4510 cpu_manager.go:414] "containerMap: removing container" podUID="76c943ec-886f-4198-bb58-f67c63173668" containerName="maas-api"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917366    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="76c943ec-886f-4198-bb58-f67c63173668" containerName="maas-api"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917379    4510 cpu_manager.go:414] "containerMap: removing container" podUID="2b117874-604c-468c-817d-d479546de869" containerName="main"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917386    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2b117874-604c-468c-817d-d479546de869" containerName="main"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917472    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="26f637a4-444a-4725-b7cf-eab47dd1e7b9" containerName="payload-processing"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917484    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="0cd1f59e-5739-4c18-9073-fc6a3c3bc2d7" containerName="istio-proxy"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917494    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="8b9608b1-179d-4740-bffe-ba998cdea67b" containerName="istio-proxy"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917503    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce520f3c-5385-4894-801d-d63a326ec3f5" containerName="istio-proxy"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917512    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="76c943ec-886f-4198-bb58-f67c63173668" containerName="maas-api"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917522    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="2b117874-604c-468c-817d-d479546de869" containerName="main"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917530    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="b73b78e7-78dc-44b0-8567-ebdb30939c29" containerName="istio-proxy"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917537    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="c999ed6d-66f4-4695-bf7a-bc63f68c466b" containerName="istio-proxy"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917545    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="e8e768db-6b1c-43ae-9b85-0c0427ef4c66" containerName="payload-pre-processing"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917555    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="e7512762-8459-4fe2-a5e6-bcf32b17a181" containerName="istio-proxy"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917564    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="85cb4aab-7613-481a-af4c-228be87df8c9" containerName="istio-proxy"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917573    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="b7e091e0-5112-49c2-8801-d0c6a46e8e01" containerName="main"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917580    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="e7512762-8459-4fe2-a5e6-bcf32b17a181" containerName="istio-proxy"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917589    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="c49160c5-aeac-464e-9a7f-8e436aa1e90e" containerName="payload-processing"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917597    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="85cb4aab-7613-481a-af4c-228be87df8c9" containerName="istio-proxy"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917605    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="711e1966-9061-4246-951f-f99bd1963969" containerName="payload-processing"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917614    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="5881ff60-a61f-416c-8034-a9991921631b" containerName="main"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917623    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="37beb582-a33b-4214-a262-1f2ba08ce759" containerName="maas-api"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917631    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="bbc02f97-cd51-49be-9dda-5c14d6beb6c6" containerName="main"
Nov 04 03:46:56.918401 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.917639    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="a8307d11-d8a0-49c1-b3eb-d6b238871f5c" containerName="payload-processing"
Nov 04 03:46:56.921066 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.921034    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:56.966439 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.966408    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"]
Nov 04 03:46:56.969648 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.969633    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"]
Nov 04 03:46:56.969777 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.969761    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:56.972792 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:56.972772    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.030347 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.030326    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-cr7gn\""
Nov 04 03:46:57.034688 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.034664    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/718877b6-c5ed-451f-9b62-e64eb4e1ee88-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.034813 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.034730    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.034857 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.034833    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/718877b6-c5ed-451f-9b62-e64eb4e1ee88-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.034903 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.034866    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/718877b6-c5ed-451f-9b62-e64eb4e1ee88-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.034958 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.034939    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6t8d\" (UniqueName: \"kubernetes.io/projected/718877b6-c5ed-451f-9b62-e64eb4e1ee88-kube-api-access-j6t8d\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.034997 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.034977    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.035045 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.034997    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.035045 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035018    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.035119 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035107    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.035157 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035132    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.035272 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035253    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.035303 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035283    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/718877b6-c5ed-451f-9b62-e64eb4e1ee88-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.035333 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035300    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.035368 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035333    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzwd5\" (UniqueName: \"kubernetes.io/projected/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-kube-api-access-mzwd5\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.035405 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035369    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.035450 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035426    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/718877b6-c5ed-451f-9b62-e64eb4e1ee88-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.035484 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035461    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4pj4w\" (UniqueName: \"kubernetes.io/projected/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-kube-api-access-4pj4w\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.035519 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035484    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.035519 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035500    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.035580 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035532    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/718877b6-c5ed-451f-9b62-e64eb4e1ee88-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.035580 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035550    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.035639 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035614    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/718877b6-c5ed-451f-9b62-e64eb4e1ee88-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.035673 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035643    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.035730 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035699    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/718877b6-c5ed-451f-9b62-e64eb4e1ee88-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.035730 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035721    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.035788 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035744    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.035788 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.035779    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.066160 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.066138    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"]
Nov 04 03:46:57.075121 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.075102    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"]
Nov 04 03:46:57.085129 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.085099    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"]
Nov 04 03:46:57.136309 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136286    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/718877b6-c5ed-451f-9b62-e64eb4e1ee88-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.136426 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136315    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.136426 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136338    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/718877b6-c5ed-451f-9b62-e64eb4e1ee88-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.136426 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136361    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.136426 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136377    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/718877b6-c5ed-451f-9b62-e64eb4e1ee88-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.136426 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136395    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.136426 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136416    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.136773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136445    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.136773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136474    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/718877b6-c5ed-451f-9b62-e64eb4e1ee88-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.136773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136503    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.136773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136533    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/718877b6-c5ed-451f-9b62-e64eb4e1ee88-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.136773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136564    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/718877b6-c5ed-451f-9b62-e64eb4e1ee88-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.136773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136591    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6t8d\" (UniqueName: \"kubernetes.io/projected/718877b6-c5ed-451f-9b62-e64eb4e1ee88-kube-api-access-j6t8d\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.136773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136631    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.136773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136655    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.136773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136702    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.136773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136741    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.136773 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136766    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.137318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136817    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.137318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136828    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/718877b6-c5ed-451f-9b62-e64eb4e1ee88-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.137318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136846    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/718877b6-c5ed-451f-9b62-e64eb4e1ee88-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.137318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136869    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.137318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136897    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzwd5\" (UniqueName: \"kubernetes.io/projected/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-kube-api-access-mzwd5\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.137318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136937    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.137318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.136975    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/718877b6-c5ed-451f-9b62-e64eb4e1ee88-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.137318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.137001    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4pj4w\" (UniqueName: \"kubernetes.io/projected/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-kube-api-access-4pj4w\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.137318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.137003    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/718877b6-c5ed-451f-9b62-e64eb4e1ee88-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.137318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.137041    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.137318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.137073    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.137318 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.137226    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.137957 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.137456    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.137957 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.137631    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.137957 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.137709    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.137957 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.137734    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.138161 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.138070    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-workload-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.138221 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.138166    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.138363 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.138306    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-credential-socket\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.138747 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.138447    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.138747 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.138501    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/718877b6-c5ed-451f-9b62-e64eb4e1ee88-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.138747 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.138594    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-workload-certs\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.138747 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.138705    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/718877b6-c5ed-451f-9b62-e64eb4e1ee88-istio-data\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.139004 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.138972    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/718877b6-c5ed-451f-9b62-e64eb4e1ee88-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.139460 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.139422    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.139844 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.139825    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.140008 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.139987    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/718877b6-c5ed-451f-9b62-e64eb4e1ee88-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.140066 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.139987    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.140949 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.140929    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/718877b6-c5ed-451f-9b62-e64eb4e1ee88-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.140949 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.140941    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-istio-envoy\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.198039 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.197927    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.199431 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.199404    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzwd5\" (UniqueName: \"kubernetes.io/projected/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-kube-api-access-mzwd5\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.199542 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.199416    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5a005fb9-5ac0-40f1-85eb-c26cd3347f55-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-blsp9\" (UID: \"5a005fb9-5ac0-40f1-85eb-c26cd3347f55\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.199629 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.199614    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4pj4w\" (UniqueName: \"kubernetes.io/projected/fb734ce3-f820-46a0-a8e3-0f492e4f80c0-kube-api-access-4pj4w\") pod \"maas-default-gateway-openshift-default-6dcf757899-w6hx4\" (UID: \"fb734ce3-f820-46a0-a8e3-0f492e4f80c0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.199669 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.199625    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6t8d\" (UniqueName: \"kubernetes.io/projected/718877b6-c5ed-451f-9b62-e64eb4e1ee88-kube-api-access-j6t8d\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.199915 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.199884    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/718877b6-c5ed-451f-9b62-e64eb4e1ee88-istio-token\") pod \"maas-default-gateway-openshift-default-6dcf757899-mmdl5\" (UID: \"718877b6-c5ed-451f-9b62-e64eb4e1ee88\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.233252 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.233229    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:57.283498 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.283460    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:57.289924 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.289882    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:57.672207 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.672181    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"]
Nov 04 03:46:57.673707 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:46:57.673663    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb734ce3_f820_46a0_a8e3_0f492e4f80c0.slice/crio-1fab01d9d33cbafa1de68a9c9abfecfcd6d47eae5493f39192bfea001e2f6297 WatchSource:0}: Error finding container 1fab01d9d33cbafa1de68a9c9abfecfcd6d47eae5493f39192bfea001e2f6297: Status 404 returned error can't find the container with id 1fab01d9d33cbafa1de68a9c9abfecfcd6d47eae5493f39192bfea001e2f6297
Nov 04 03:46:57.675854 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.675826    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:46:57.675930 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.675890    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:46:57.675974 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.675930    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:46:57.726143 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.726119    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"]
Nov 04 03:46:57.727807 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:46:57.727781    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a005fb9_5ac0_40f1_85eb_c26cd3347f55.slice/crio-5eb1be32dd89ad33fc88f7b4c71765b0351e802c1e3c9c370c9a677287d0c180 WatchSource:0}: Error finding container 5eb1be32dd89ad33fc88f7b4c71765b0351e802c1e3c9c370c9a677287d0c180: Status 404 returned error can't find the container with id 5eb1be32dd89ad33fc88f7b4c71765b0351e802c1e3c9c370c9a677287d0c180
Nov 04 03:46:57.729891 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.729861    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:46:57.729974 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.729921    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:46:57.729974 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.729949    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:46:57.776670 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.776646    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"]
Nov 04 03:46:57.778312 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:46:57.778282    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod718877b6_c5ed_451f_9b62_e64eb4e1ee88.slice/crio-dba5f8be778ff794e07ccd8aeb3020482591b8531c0b4ef81d9d74577359dba9 WatchSource:0}: Error finding container dba5f8be778ff794e07ccd8aeb3020482591b8531c0b4ef81d9d74577359dba9: Status 404 returned error can't find the container with id dba5f8be778ff794e07ccd8aeb3020482591b8531c0b4ef81d9d74577359dba9
Nov 04 03:46:57.780918 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.780879    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:46:57.781032 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.780958    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:46:57.781032 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:57.781006    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:46:58.477958 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:58.477919    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5" event={"ID":"718877b6-c5ed-451f-9b62-e64eb4e1ee88","Type":"ContainerStarted","Data":"79fa12539aba508f776c7ce72f8c59353b2df55cbfa6c54a30cd90a2e8ae6f65"}
Nov 04 03:46:58.478507 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:58.477979    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5" event={"ID":"718877b6-c5ed-451f-9b62-e64eb4e1ee88","Type":"ContainerStarted","Data":"dba5f8be778ff794e07ccd8aeb3020482591b8531c0b4ef81d9d74577359dba9"}
Nov 04 03:46:58.480195 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:58.480167    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4" event={"ID":"fb734ce3-f820-46a0-a8e3-0f492e4f80c0","Type":"ContainerStarted","Data":"3724d6814245d40cdf3a35a2374302279bf927e2a949010aa5b3ca26de9acba1"}
Nov 04 03:46:58.480312 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:58.480215    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4" event={"ID":"fb734ce3-f820-46a0-a8e3-0f492e4f80c0","Type":"ContainerStarted","Data":"1fab01d9d33cbafa1de68a9c9abfecfcd6d47eae5493f39192bfea001e2f6297"}
Nov 04 03:46:58.482167 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:58.482141    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9" event={"ID":"5a005fb9-5ac0-40f1-85eb-c26cd3347f55","Type":"ContainerStarted","Data":"76baa00c10fc3817e7e870834282cef6d4c49395117684cf5fcbd1c5cb39b867"}
Nov 04 03:46:58.482336 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:58.482310    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9" event={"ID":"5a005fb9-5ac0-40f1-85eb-c26cd3347f55","Type":"ContainerStarted","Data":"5eb1be32dd89ad33fc88f7b4c71765b0351e802c1e3c9c370c9a677287d0c180"}
Nov 04 03:46:58.734074 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:58.733936    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5" podStartSLOduration=2.733913436 podStartE2EDuration="2.733913436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:46:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:46:58.608067465 +0000 UTC m=+1793.871941774" watchObservedRunningTime="2026-11-04 03:46:58.733913436 +0000 UTC m=+1793.997787743"
Nov 04 03:46:58.861794 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:58.861732    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9" podStartSLOduration=2.861710688 podStartE2EDuration="2.861710688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:46:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:46:58.734853735 +0000 UTC m=+1793.998728047" watchObservedRunningTime="2026-11-04 03:46:58.861710688 +0000 UTC m=+1794.125584992"
Nov 04 03:46:59.235796 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:59.235759    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:46:59.236182 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:59.236159    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-w6hx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 04 03:46:59.236370 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:59.236346    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4" podUID="fb734ce3-f820-46a0-a8e3-0f492e4f80c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 04 03:46:59.284761 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:59.284726    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:46:59.285694 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:59.285653    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-blsp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 04 03:46:59.285790 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:59.285716    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9" podUID="5a005fb9-5ac0-40f1-85eb-c26cd3347f55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 04 03:46:59.291180 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:59.291165    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:46:59.291994 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:59.291974    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mmdl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 04 03:46:59.292039 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:46:59.292009    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5" podUID="718877b6-c5ed-451f-9b62-e64eb4e1ee88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 04 03:47:00.234142 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:00.234100    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-w6hx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 04 03:47:00.234781 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:00.234743    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4" podUID="fb734ce3-f820-46a0-a8e3-0f492e4f80c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 04 03:47:00.284242 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:00.284111    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-blsp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 04 03:47:00.284242 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:00.284168    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9" podUID="5a005fb9-5ac0-40f1-85eb-c26cd3347f55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 04 03:47:00.290365 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:00.290334    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mmdl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 04 03:47:00.290490 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:00.290373    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5" podUID="718877b6-c5ed-451f-9b62-e64eb4e1ee88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 04 03:47:01.234117 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:01.234079    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-w6hx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 04 03:47:01.234397 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:01.234365    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4" podUID="fb734ce3-f820-46a0-a8e3-0f492e4f80c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 04 03:47:01.284591 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:01.284454    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-blsp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 04 03:47:01.284591 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:01.284513    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9" podUID="5a005fb9-5ac0-40f1-85eb-c26cd3347f55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 04 03:47:01.290346 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:01.290323    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mmdl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 04 03:47:01.290545 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:01.290516    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5" podUID="718877b6-c5ed-451f-9b62-e64eb4e1ee88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 04 03:47:02.235104 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:02.235067    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-w6hx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 04 03:47:02.236597 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:02.236562    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4" podUID="fb734ce3-f820-46a0-a8e3-0f492e4f80c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 04 03:47:02.284503 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:02.284474    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-blsp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 04 03:47:02.284647 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:02.284524    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9" podUID="5a005fb9-5ac0-40f1-85eb-c26cd3347f55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 04 03:47:02.290855 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:02.290834    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mmdl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 04 03:47:02.291029 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:02.291011    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5" podUID="718877b6-c5ed-451f-9b62-e64eb4e1ee88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 04 03:47:02.692924 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:02.692814    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4" podStartSLOduration=6.69279842 podStartE2EDuration="6.69279842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:46:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:46:58.877929102 +0000 UTC m=+1794.141803387" watchObservedRunningTime="2026-11-04 03:47:02.69279842 +0000 UTC m=+1797.956672727"
Nov 04 03:47:02.697706 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:02.694347    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9"]
Nov 04 03:47:02.829708 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:02.829494    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp"]
Nov 04 03:47:03.237708 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:03.236186    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-w6hx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 04 03:47:03.237708 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:03.236271    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4" podUID="fb734ce3-f820-46a0-a8e3-0f492e4f80c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 04 03:47:03.284192 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:03.284152    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-blsp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 04 03:47:03.284372 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:03.284211    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9" podUID="5a005fb9-5ac0-40f1-85eb-c26cd3347f55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 04 03:47:03.290613 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:03.290570    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mmdl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 04 03:47:03.290752 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:03.290634    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5" podUID="718877b6-c5ed-451f-9b62-e64eb4e1ee88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 04 03:47:04.234268 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:04.234228    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-w6hx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 04 03:47:04.234494 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:04.234282    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4" podUID="fb734ce3-f820-46a0-a8e3-0f492e4f80c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 04 03:47:04.284703 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:04.284636    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-blsp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 04 03:47:04.285214 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:04.284728    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9" podUID="5a005fb9-5ac0-40f1-85eb-c26cd3347f55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 04 03:47:04.291158 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:04.291127    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mmdl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 04 03:47:04.291316 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:04.291184    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5" podUID="718877b6-c5ed-451f-9b62-e64eb4e1ee88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 04 03:47:05.234203 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:05.234171    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-w6hx4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 04 03:47:05.234322 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:05.234237    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4" podUID="fb734ce3-f820-46a0-a8e3-0f492e4f80c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 04 03:47:05.284729 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:05.284662    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-blsp9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 04 03:47:05.285096 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:05.284760    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9" podUID="5a005fb9-5ac0-40f1-85eb-c26cd3347f55" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 04 03:47:05.290271 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:05.290242    4510 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6dcf757899-mmdl5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused" start-of-body=
Nov 04 03:47:05.290392 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:05.290294    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5" podUID="718877b6-c5ed-451f-9b62-e64eb4e1ee88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.77:15021/healthz/ready\": dial tcp 10.133.0.77:15021: connect: connection refused"
Nov 04 03:47:07.149078 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:07.149044    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:47:07.149802 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:07.149774    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:47:07.150858 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:07.150838    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-w6hx4"
Nov 04 03:47:07.152955 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:07.152875    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:47:07.153542 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:07.153513    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:47:07.154547 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:07.154517    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-blsp9"
Nov 04 03:47:07.253199 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:07.253159    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:47:07.253573 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:07.253549    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:47:07.254450 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:07.254427    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6dcf757899-mmdl5"
Nov 04 03:47:07.694719 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:07.694667    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9" podUID="e58c8f3e-b840-4a6c-9592-888c2d03ee78" containerName="payload-processing" containerID="cri-o://c90c735988d7510b5e31b004774c801ca659be38d13f8f0998406f2fbd96df71" gracePeriod=25
Nov 04 03:47:07.876718 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:07.876067    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp" podUID="001d5e6a-505a-4f19-abe8-22c8cbb53704" containerName="payload-pre-processing" containerID="cri-o://de5bae4504a323944a40a0ab663c722e767b03f7946a9577b17cca775bbfecb9" gracePeriod=25
Nov 04 03:47:07.942173 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:07.942149    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9"
Nov 04 03:47:08.074617 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:08.074585    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e58c8f3e-b840-4a6c-9592-888c2d03ee78-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e58c8f3e-b840-4a6c-9592-888c2d03ee78-plugins-config-volume\") pod \"e58c8f3e-b840-4a6c-9592-888c2d03ee78\" (UID: \"e58c8f3e-b840-4a6c-9592-888c2d03ee78\") "
Nov 04 03:47:08.074846 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:08.074756    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e58c8f3e-b840-4a6c-9592-888c2d03ee78-kube-api-access-lsv86\" (UniqueName: \"kubernetes.io/projected/e58c8f3e-b840-4a6c-9592-888c2d03ee78-kube-api-access-lsv86\") pod \"e58c8f3e-b840-4a6c-9592-888c2d03ee78\" (UID: \"e58c8f3e-b840-4a6c-9592-888c2d03ee78\") "
Nov 04 03:47:08.074960 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:08.074935    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e58c8f3e-b840-4a6c-9592-888c2d03ee78-plugins-config-volume" pod "e58c8f3e-b840-4a6c-9592-888c2d03ee78" (UID: "e58c8f3e-b840-4a6c-9592-888c2d03ee78"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:47:08.075058 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:08.075038    4510 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e58c8f3e-b840-4a6c-9592-888c2d03ee78-plugins-config-volume\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:08.077292 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:08.077256    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e58c8f3e-b840-4a6c-9592-888c2d03ee78-kube-api-access-lsv86" pod "e58c8f3e-b840-4a6c-9592-888c2d03ee78" (UID: "e58c8f3e-b840-4a6c-9592-888c2d03ee78"). InnerVolumeSpecName "kube-api-access-lsv86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:47:08.176420 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:08.176391    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsv86\" (UniqueName: \"kubernetes.io/projected/e58c8f3e-b840-4a6c-9592-888c2d03ee78-kube-api-access-lsv86\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:08.589286 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:08.589253    4510 generic.go:356] "Generic (PLEG): container finished" podID="e58c8f3e-b840-4a6c-9592-888c2d03ee78" containerID="c90c735988d7510b5e31b004774c801ca659be38d13f8f0998406f2fbd96df71" exitCode=0
Nov 04 03:47:08.589503 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:08.589304    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9"
Nov 04 03:47:08.589503 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:08.589361    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9" event={"ID":"e58c8f3e-b840-4a6c-9592-888c2d03ee78","Type":"ContainerDied","Data":"c90c735988d7510b5e31b004774c801ca659be38d13f8f0998406f2fbd96df71"}
Nov 04 03:47:08.589503 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:08.589417    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9" event={"ID":"e58c8f3e-b840-4a6c-9592-888c2d03ee78","Type":"ContainerDied","Data":"9a410ee3259520363a7aa61385bd5dd0ba97a5e8293ac5eb1395346648069ace"}
Nov 04 03:47:08.589503 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:08.589446    4510 scope.go:122] "RemoveContainer" containerID="c90c735988d7510b5e31b004774c801ca659be38d13f8f0998406f2fbd96df71"
Nov 04 03:47:08.598993 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:08.598972    4510 scope.go:122] "RemoveContainer" containerID="c90c735988d7510b5e31b004774c801ca659be38d13f8f0998406f2fbd96df71"
Nov 04 03:47:08.599262 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:47:08.599244    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c90c735988d7510b5e31b004774c801ca659be38d13f8f0998406f2fbd96df71\": container with ID starting with c90c735988d7510b5e31b004774c801ca659be38d13f8f0998406f2fbd96df71 not found: ID does not exist" containerID="c90c735988d7510b5e31b004774c801ca659be38d13f8f0998406f2fbd96df71"
Nov 04 03:47:08.599314 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:08.599271    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c90c735988d7510b5e31b004774c801ca659be38d13f8f0998406f2fbd96df71"} err="failed to get container status \"c90c735988d7510b5e31b004774c801ca659be38d13f8f0998406f2fbd96df71\": rpc error: code = NotFound desc = could not find container \"c90c735988d7510b5e31b004774c801ca659be38d13f8f0998406f2fbd96df71\": container with ID starting with c90c735988d7510b5e31b004774c801ca659be38d13f8f0998406f2fbd96df71 not found: ID does not exist"
Nov 04 03:47:08.753942 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:08.753912    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9"]
Nov 04 03:47:08.803784 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:08.803752    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-extmod-b-5d459a-6df5c88b7d-229t9"]
Nov 04 03:47:08.862566 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:08.862487    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e58c8f3e-b840-4a6c-9592-888c2d03ee78" path="/var/lib/kubelet/pods/e58c8f3e-b840-4a6c-9592-888c2d03ee78/volumes"
Nov 04 03:47:14.404655 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:14.404616    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp" podUID="001d5e6a-505a-4f19-abe8-22c8cbb53704" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 03:47:15.368276 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.368243    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"]
Nov 04 03:47:15.368462 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.368440    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst" podUID="78da5e30-34cb-416c-93dd-00ce41a38bcf" containerName="maas-api" containerID="cri-o://2dd8ef95e53a328324f90a1404477fa8ae435a31972b0438ae0bfd182c8625c6" gracePeriod=30
Nov 04 03:47:15.632654 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.632620    4510 generic.go:356] "Generic (PLEG): container finished" podID="78da5e30-34cb-416c-93dd-00ce41a38bcf" containerID="2dd8ef95e53a328324f90a1404477fa8ae435a31972b0438ae0bfd182c8625c6" exitCode=0
Nov 04 03:47:15.633003 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.632724    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst" event={"ID":"78da5e30-34cb-416c-93dd-00ce41a38bcf","Type":"ContainerDied","Data":"2dd8ef95e53a328324f90a1404477fa8ae435a31972b0438ae0bfd182c8625c6"}
Nov 04 03:47:15.633003 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.632791    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst" event={"ID":"78da5e30-34cb-416c-93dd-00ce41a38bcf","Type":"ContainerDied","Data":"3c82dd10d88709891f8b859a005a618eb4e623a3b311e00a133b191c7905dfbe"}
Nov 04 03:47:15.633003 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.632818    4510 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c82dd10d88709891f8b859a005a618eb4e623a3b311e00a133b191c7905dfbe"
Nov 04 03:47:15.644647 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.644627    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:47:15.741842 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.741815    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/78da5e30-34cb-416c-93dd-00ce41a38bcf-metrics-certs\" (UniqueName: \"kubernetes.io/secret/78da5e30-34cb-416c-93dd-00ce41a38bcf-metrics-certs\") pod \"78da5e30-34cb-416c-93dd-00ce41a38bcf\" (UID: \"78da5e30-34cb-416c-93dd-00ce41a38bcf\") "
Nov 04 03:47:15.742002 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.741861    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/78da5e30-34cb-416c-93dd-00ce41a38bcf-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78da5e30-34cb-416c-93dd-00ce41a38bcf-openshift-service-ca\") pod \"78da5e30-34cb-416c-93dd-00ce41a38bcf\" (UID: \"78da5e30-34cb-416c-93dd-00ce41a38bcf\") "
Nov 04 03:47:15.742002 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.741919    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/78da5e30-34cb-416c-93dd-00ce41a38bcf-kube-api-access-jnp82\" (UniqueName: \"kubernetes.io/projected/78da5e30-34cb-416c-93dd-00ce41a38bcf-kube-api-access-jnp82\") pod \"78da5e30-34cb-416c-93dd-00ce41a38bcf\" (UID: \"78da5e30-34cb-416c-93dd-00ce41a38bcf\") "
Nov 04 03:47:15.742002 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.741976    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/78da5e30-34cb-416c-93dd-00ce41a38bcf-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78da5e30-34cb-416c-93dd-00ce41a38bcf-maas-api-tls\") pod \"78da5e30-34cb-416c-93dd-00ce41a38bcf\" (UID: \"78da5e30-34cb-416c-93dd-00ce41a38bcf\") "
Nov 04 03:47:15.742278 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.742253    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/78da5e30-34cb-416c-93dd-00ce41a38bcf-openshift-service-ca" pod "78da5e30-34cb-416c-93dd-00ce41a38bcf" (UID: "78da5e30-34cb-416c-93dd-00ce41a38bcf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:47:15.744501 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.744471    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78da5e30-34cb-416c-93dd-00ce41a38bcf-metrics-certs" pod "78da5e30-34cb-416c-93dd-00ce41a38bcf" (UID: "78da5e30-34cb-416c-93dd-00ce41a38bcf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:47:15.745128 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.745097    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/78da5e30-34cb-416c-93dd-00ce41a38bcf-kube-api-access-jnp82" pod "78da5e30-34cb-416c-93dd-00ce41a38bcf" (UID: "78da5e30-34cb-416c-93dd-00ce41a38bcf"). InnerVolumeSpecName "kube-api-access-jnp82". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:47:15.745360 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.745333    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/78da5e30-34cb-416c-93dd-00ce41a38bcf-maas-api-tls" pod "78da5e30-34cb-416c-93dd-00ce41a38bcf" (UID: "78da5e30-34cb-416c-93dd-00ce41a38bcf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:47:15.842758 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.842725    4510 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/78da5e30-34cb-416c-93dd-00ce41a38bcf-metrics-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:15.842758 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.842751    4510 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/78da5e30-34cb-416c-93dd-00ce41a38bcf-openshift-service-ca\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:15.842758 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.842762    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnp82\" (UniqueName: \"kubernetes.io/projected/78da5e30-34cb-416c-93dd-00ce41a38bcf-kube-api-access-jnp82\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:15.843001 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:15.842771    4510 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/78da5e30-34cb-416c-93dd-00ce41a38bcf-maas-api-tls\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:16.639994 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:16.639961    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"
Nov 04 03:47:16.805404 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:16.805373    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"]
Nov 04 03:47:16.862872 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:16.862841    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-extmod-b-5d459a-66ddb599fc-2hbst"]
Nov 04 03:47:18.863139 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:18.863097    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="78da5e30-34cb-416c-93dd-00ce41a38bcf" path="/var/lib/kubelet/pods/78da5e30-34cb-416c-93dd-00ce41a38bcf/volumes"
Nov 04 03:47:23.316244 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:47:23.316206    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:47:24.404455 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:24.404415    4510 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp" podUID="001d5e6a-505a-4f19-abe8-22c8cbb53704" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Nov 04 03:47:28.137432 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:28.137346    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp"
Nov 04 03:47:28.255733 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:28.255671    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/001d5e6a-505a-4f19-abe8-22c8cbb53704-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/001d5e6a-505a-4f19-abe8-22c8cbb53704-plugins-config-volume\") pod \"001d5e6a-505a-4f19-abe8-22c8cbb53704\" (UID: \"001d5e6a-505a-4f19-abe8-22c8cbb53704\") "
Nov 04 03:47:28.256050 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:28.255759    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/001d5e6a-505a-4f19-abe8-22c8cbb53704-kube-api-access-b7w7x\" (UniqueName: \"kubernetes.io/projected/001d5e6a-505a-4f19-abe8-22c8cbb53704-kube-api-access-b7w7x\") pod \"001d5e6a-505a-4f19-abe8-22c8cbb53704\" (UID: \"001d5e6a-505a-4f19-abe8-22c8cbb53704\") "
Nov 04 03:47:28.256143 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:28.256092    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/001d5e6a-505a-4f19-abe8-22c8cbb53704-plugins-config-volume" pod "001d5e6a-505a-4f19-abe8-22c8cbb53704" (UID: "001d5e6a-505a-4f19-abe8-22c8cbb53704"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:47:28.258284 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:28.258257    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/001d5e6a-505a-4f19-abe8-22c8cbb53704-kube-api-access-b7w7x" pod "001d5e6a-505a-4f19-abe8-22c8cbb53704" (UID: "001d5e6a-505a-4f19-abe8-22c8cbb53704"). InnerVolumeSpecName "kube-api-access-b7w7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:47:28.356851 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:28.356815    4510 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/001d5e6a-505a-4f19-abe8-22c8cbb53704-plugins-config-volume\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:28.356851 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:28.356848    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b7w7x\" (UniqueName: \"kubernetes.io/projected/001d5e6a-505a-4f19-abe8-22c8cbb53704-kube-api-access-b7w7x\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:28.704982 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:28.704943    4510 generic.go:356] "Generic (PLEG): container finished" podID="001d5e6a-505a-4f19-abe8-22c8cbb53704" containerID="de5bae4504a323944a40a0ab663c722e767b03f7946a9577b17cca775bbfecb9" exitCode=0
Nov 04 03:47:28.705187 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:28.705001    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp"
Nov 04 03:47:28.705187 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:28.705027    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp" event={"ID":"001d5e6a-505a-4f19-abe8-22c8cbb53704","Type":"ContainerDied","Data":"de5bae4504a323944a40a0ab663c722e767b03f7946a9577b17cca775bbfecb9"}
Nov 04 03:47:28.705187 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:28.705082    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp" event={"ID":"001d5e6a-505a-4f19-abe8-22c8cbb53704","Type":"ContainerDied","Data":"220f8975329f20f627c1e2cd1a4617c1b39fa5e64319da296c2fb17ba49966a3"}
Nov 04 03:47:28.705187 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:28.705103    4510 scope.go:122] "RemoveContainer" containerID="de5bae4504a323944a40a0ab663c722e767b03f7946a9577b17cca775bbfecb9"
Nov 04 03:47:28.714481 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:28.714461    4510 scope.go:122] "RemoveContainer" containerID="de5bae4504a323944a40a0ab663c722e767b03f7946a9577b17cca775bbfecb9"
Nov 04 03:47:28.714895 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:47:28.714876    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"de5bae4504a323944a40a0ab663c722e767b03f7946a9577b17cca775bbfecb9\": container with ID starting with de5bae4504a323944a40a0ab663c722e767b03f7946a9577b17cca775bbfecb9 not found: ID does not exist" containerID="de5bae4504a323944a40a0ab663c722e767b03f7946a9577b17cca775bbfecb9"
Nov 04 03:47:28.714976 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:28.714909    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"de5bae4504a323944a40a0ab663c722e767b03f7946a9577b17cca775bbfecb9"} err="failed to get container status \"de5bae4504a323944a40a0ab663c722e767b03f7946a9577b17cca775bbfecb9\": rpc error: code = NotFound desc = could not find container \"de5bae4504a323944a40a0ab663c722e767b03f7946a9577b17cca775bbfecb9\": container with ID starting with de5bae4504a323944a40a0ab663c722e767b03f7946a9577b17cca775bbfecb9 not found: ID does not exist"
Nov 04 03:47:28.902985 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:28.902948    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp"]
Nov 04 03:47:28.910797 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:28.910772    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-extmod-b-5d459a-66bdf76c4c-z6mzp"]
Nov 04 03:47:30.819291 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:30.819256    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"]
Nov 04 03:47:30.861586 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:30.861553    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="001d5e6a-505a-4f19-abe8-22c8cbb53704" path="/var/lib/kubelet/pods/001d5e6a-505a-4f19-abe8-22c8cbb53704/volumes"
Nov 04 03:47:30.869159 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:30.869135    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"]
Nov 04 03:47:30.871138 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:30.871117    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"]
Nov 04 03:47:45.842454 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:45.842340    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs" podUID="ba15e83e-3b7c-4f87-9513-dad698c4147b" containerName="main" containerID="cri-o://146f83caa1e9b7a310c6008c676596348bba781354b664c6a67d9b6362b98452" gracePeriod=45
Nov 04 03:47:45.889173 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:45.889134    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f" podUID="dd9ea1b1-0b00-4c30-a4d5-e2de30e12496" containerName="main" containerID="cri-o://9b7b949dd094a49d43922345fc17873f359130750889c78260bbc1339deb4d0c" gracePeriod=45
Nov 04 03:47:45.890041 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:45.890010    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r" podUID="207320d1-fa2f-4204-805a-ec84fec16b89" containerName="main" containerID="cri-o://e9e5b868b58f59ca3f18dba43fcca7798fbb024285d5c6168a0bb29f6a646bd6" gracePeriod=45
Nov 04 03:47:46.144537 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.144510    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:47:46.179226 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.179195    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:47:46.182394 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.182371    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:47:46.221557 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.221522    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-dshm\") pod \"ba15e83e-3b7c-4f87-9513-dad698c4147b\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") "
Nov 04 03:47:46.221557 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.221562    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-tls-certs\" (UniqueName: \"kubernetes.io/secret/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-tls-certs\") pod \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") "
Nov 04 03:47:46.221815 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.221595    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-tmp-dir\") pod \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") "
Nov 04 03:47:46.221815 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.221624    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-dshm\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-dshm\") pod \"207320d1-fa2f-4204-805a-ec84fec16b89\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") "
Nov 04 03:47:46.221815 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.221701    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/207320d1-fa2f-4204-805a-ec84fec16b89-kube-api-access-sm87v\" (UniqueName: \"kubernetes.io/projected/207320d1-fa2f-4204-805a-ec84fec16b89-kube-api-access-sm87v\") pod \"207320d1-fa2f-4204-805a-ec84fec16b89\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") "
Nov 04 03:47:46.221815 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.221730    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-tmp-dir\") pod \"207320d1-fa2f-4204-805a-ec84fec16b89\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") "
Nov 04 03:47:46.221815 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.221756    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-home\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-home\") pod \"ba15e83e-3b7c-4f87-9513-dad698c4147b\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") "
Nov 04 03:47:46.221815 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.221785    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-home\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-home\") pod \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") "
Nov 04 03:47:46.222100 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.221829    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-model-cache\") pod \"207320d1-fa2f-4204-805a-ec84fec16b89\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") "
Nov 04 03:47:46.222100 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.221869    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-dshm\") pod \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") "
Nov 04 03:47:46.222100 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.221918    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-model-cache\") pod \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") "
Nov 04 03:47:46.222100 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.221916    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-tmp-dir" pod "dd9ea1b1-0b00-4c30-a4d5-e2de30e12496" (UID: "dd9ea1b1-0b00-4c30-a4d5-e2de30e12496"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:47:46.222100 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.221964    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ba15e83e-3b7c-4f87-9513-dad698c4147b-tls-certs\" (UniqueName: \"kubernetes.io/secret/ba15e83e-3b7c-4f87-9513-dad698c4147b-tls-certs\") pod \"ba15e83e-3b7c-4f87-9513-dad698c4147b\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") "
Nov 04 03:47:46.222100 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.221992    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-tmp-dir\") pod \"ba15e83e-3b7c-4f87-9513-dad698c4147b\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") "
Nov 04 03:47:46.222100 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.222028    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ba15e83e-3b7c-4f87-9513-dad698c4147b-kube-api-access-m5gmn\" (UniqueName: \"kubernetes.io/projected/ba15e83e-3b7c-4f87-9513-dad698c4147b-kube-api-access-m5gmn\") pod \"ba15e83e-3b7c-4f87-9513-dad698c4147b\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") "
Nov 04 03:47:46.222100 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.222093    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-model-cache\") pod \"ba15e83e-3b7c-4f87-9513-dad698c4147b\" (UID: \"ba15e83e-3b7c-4f87-9513-dad698c4147b\") "
Nov 04 03:47:46.222535 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.222119    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/207320d1-fa2f-4204-805a-ec84fec16b89-tls-certs\" (UniqueName: \"kubernetes.io/secret/207320d1-fa2f-4204-805a-ec84fec16b89-tls-certs\") pod \"207320d1-fa2f-4204-805a-ec84fec16b89\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") "
Nov 04 03:47:46.222535 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.222126    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-home" pod "dd9ea1b1-0b00-4c30-a4d5-e2de30e12496" (UID: "dd9ea1b1-0b00-4c30-a4d5-e2de30e12496"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:47:46.222535 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.222143    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-kube-api-access-6dbq5\" (UniqueName: \"kubernetes.io/projected/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-kube-api-access-6dbq5\") pod \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\" (UID: \"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496\") "
Nov 04 03:47:46.222535 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.222179    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-home\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-home\") pod \"207320d1-fa2f-4204-805a-ec84fec16b89\" (UID: \"207320d1-fa2f-4204-805a-ec84fec16b89\") "
Nov 04 03:47:46.222535 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.222325    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-tmp-dir" pod "207320d1-fa2f-4204-805a-ec84fec16b89" (UID: "207320d1-fa2f-4204-805a-ec84fec16b89"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:47:46.222831 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.222719    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-home" pod "207320d1-fa2f-4204-805a-ec84fec16b89" (UID: "207320d1-fa2f-4204-805a-ec84fec16b89"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:47:46.222831 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.222748    4510 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-tmp-dir\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:46.222831 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.222770    4510 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-tmp-dir\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:46.222831 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.222784    4510 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-home\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:46.223046 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.222832    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-home" pod "ba15e83e-3b7c-4f87-9513-dad698c4147b" (UID: "ba15e83e-3b7c-4f87-9513-dad698c4147b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:47:46.223046 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.222944    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-model-cache" pod "ba15e83e-3b7c-4f87-9513-dad698c4147b" (UID: "ba15e83e-3b7c-4f87-9513-dad698c4147b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:47:46.223335 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.223320    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-model-cache" pod "207320d1-fa2f-4204-805a-ec84fec16b89" (UID: "207320d1-fa2f-4204-805a-ec84fec16b89"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:47:46.223666 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.223496    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-tmp-dir" pod "ba15e83e-3b7c-4f87-9513-dad698c4147b" (UID: "ba15e83e-3b7c-4f87-9513-dad698c4147b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:47:46.223666 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.223629    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-model-cache" pod "dd9ea1b1-0b00-4c30-a4d5-e2de30e12496" (UID: "dd9ea1b1-0b00-4c30-a4d5-e2de30e12496"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:47:46.224655 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.224608    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-dshm" pod "207320d1-fa2f-4204-805a-ec84fec16b89" (UID: "207320d1-fa2f-4204-805a-ec84fec16b89"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:47:46.224803 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.224718    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-dshm" pod "dd9ea1b1-0b00-4c30-a4d5-e2de30e12496" (UID: "dd9ea1b1-0b00-4c30-a4d5-e2de30e12496"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:47:46.224963 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.224936    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-tls-certs" pod "dd9ea1b1-0b00-4c30-a4d5-e2de30e12496" (UID: "dd9ea1b1-0b00-4c30-a4d5-e2de30e12496"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:47:46.225379 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.225359    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-kube-api-access-6dbq5" pod "dd9ea1b1-0b00-4c30-a4d5-e2de30e12496" (UID: "dd9ea1b1-0b00-4c30-a4d5-e2de30e12496"). InnerVolumeSpecName "kube-api-access-6dbq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:47:46.225488 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.225464    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-dshm" pod "ba15e83e-3b7c-4f87-9513-dad698c4147b" (UID: "ba15e83e-3b7c-4f87-9513-dad698c4147b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:47:46.225576 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.225558    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/207320d1-fa2f-4204-805a-ec84fec16b89-tls-certs" pod "207320d1-fa2f-4204-805a-ec84fec16b89" (UID: "207320d1-fa2f-4204-805a-ec84fec16b89"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:47:46.225615 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.225588    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/207320d1-fa2f-4204-805a-ec84fec16b89-kube-api-access-sm87v" pod "207320d1-fa2f-4204-805a-ec84fec16b89" (UID: "207320d1-fa2f-4204-805a-ec84fec16b89"). InnerVolumeSpecName "kube-api-access-sm87v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:47:46.226054 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.226034    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ba15e83e-3b7c-4f87-9513-dad698c4147b-tls-certs" pod "ba15e83e-3b7c-4f87-9513-dad698c4147b" (UID: "ba15e83e-3b7c-4f87-9513-dad698c4147b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 03:47:46.226570 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.226552    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba15e83e-3b7c-4f87-9513-dad698c4147b-kube-api-access-m5gmn" pod "ba15e83e-3b7c-4f87-9513-dad698c4147b" (UID: "ba15e83e-3b7c-4f87-9513-dad698c4147b"). InnerVolumeSpecName "kube-api-access-m5gmn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:47:46.323267 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.323231    4510 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ba15e83e-3b7c-4f87-9513-dad698c4147b-tls-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:46.323267 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.323261    4510 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-tmp-dir\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:46.323267 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.323271    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5gmn\" (UniqueName: \"kubernetes.io/projected/ba15e83e-3b7c-4f87-9513-dad698c4147b-kube-api-access-m5gmn\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:46.323536 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.323282    4510 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-model-cache\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:46.323536 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.323292    4510 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/207320d1-fa2f-4204-805a-ec84fec16b89-tls-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:46.323536 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.323306    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dbq5\" (UniqueName: \"kubernetes.io/projected/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-kube-api-access-6dbq5\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:46.323536 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.323319    4510 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-home\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:46.323536 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.323329    4510 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-dshm\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:46.323536 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.323338    4510 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-tls-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:46.323536 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.323346    4510 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-dshm\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:46.323536 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.323354    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sm87v\" (UniqueName: \"kubernetes.io/projected/207320d1-fa2f-4204-805a-ec84fec16b89-kube-api-access-sm87v\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:46.323536 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.323363    4510 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ba15e83e-3b7c-4f87-9513-dad698c4147b-home\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:46.323536 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.323371    4510 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/207320d1-fa2f-4204-805a-ec84fec16b89-model-cache\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:46.323536 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.323379    4510 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-dshm\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:46.323536 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.323393    4510 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496-model-cache\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:47:46.800001 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.799965    4510 generic.go:356] "Generic (PLEG): container finished" podID="dd9ea1b1-0b00-4c30-a4d5-e2de30e12496" containerID="9b7b949dd094a49d43922345fc17873f359130750889c78260bbc1339deb4d0c" exitCode=0
Nov 04 03:47:46.800190 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.800012    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"
Nov 04 03:47:46.800190 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.800044    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f" event={"ID":"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496","Type":"ContainerDied","Data":"9b7b949dd094a49d43922345fc17873f359130750889c78260bbc1339deb4d0c"}
Nov 04 03:47:46.800190 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.800088    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f" event={"ID":"dd9ea1b1-0b00-4c30-a4d5-e2de30e12496","Type":"ContainerDied","Data":"c34f374a0118e9a9ef23aef45291ea09ea3f9a143908f6fad1e5d64f1297222a"}
Nov 04 03:47:46.800190 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.800116    4510 scope.go:122] "RemoveContainer" containerID="9b7b949dd094a49d43922345fc17873f359130750889c78260bbc1339deb4d0c"
Nov 04 03:47:46.801521 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.801493    4510 generic.go:356] "Generic (PLEG): container finished" podID="ba15e83e-3b7c-4f87-9513-dad698c4147b" containerID="146f83caa1e9b7a310c6008c676596348bba781354b664c6a67d9b6362b98452" exitCode=0
Nov 04 03:47:46.801729 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.801551    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs" event={"ID":"ba15e83e-3b7c-4f87-9513-dad698c4147b","Type":"ContainerDied","Data":"146f83caa1e9b7a310c6008c676596348bba781354b664c6a67d9b6362b98452"}
Nov 04 03:47:46.801729 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.801591    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"
Nov 04 03:47:46.801729 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.801591    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs" event={"ID":"ba15e83e-3b7c-4f87-9513-dad698c4147b","Type":"ContainerDied","Data":"57bd774d103b26d25575224d8477aa3ebb9e3acaa6029df52983b0407b97a2f2"}
Nov 04 03:47:46.803167 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.803141    4510 generic.go:356] "Generic (PLEG): container finished" podID="207320d1-fa2f-4204-805a-ec84fec16b89" containerID="e9e5b868b58f59ca3f18dba43fcca7798fbb024285d5c6168a0bb29f6a646bd6" exitCode=0
Nov 04 03:47:46.803294 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.803170    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r" event={"ID":"207320d1-fa2f-4204-805a-ec84fec16b89","Type":"ContainerDied","Data":"e9e5b868b58f59ca3f18dba43fcca7798fbb024285d5c6168a0bb29f6a646bd6"}
Nov 04 03:47:46.803294 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.803184    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"
Nov 04 03:47:46.803294 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.803212    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r" event={"ID":"207320d1-fa2f-4204-805a-ec84fec16b89","Type":"ContainerDied","Data":"70f80fbd57ae23ffef79d2bab63939ec698295d3ae6a4de464aec0382f79d752"}
Nov 04 03:47:46.810312 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.810288    4510 scope.go:122] "RemoveContainer" containerID="9b7b949dd094a49d43922345fc17873f359130750889c78260bbc1339deb4d0c"
Nov 04 03:47:46.810623 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:47:46.810603    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b7b949dd094a49d43922345fc17873f359130750889c78260bbc1339deb4d0c\": container with ID starting with 9b7b949dd094a49d43922345fc17873f359130750889c78260bbc1339deb4d0c not found: ID does not exist" containerID="9b7b949dd094a49d43922345fc17873f359130750889c78260bbc1339deb4d0c"
Nov 04 03:47:46.810762 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.810633    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b7b949dd094a49d43922345fc17873f359130750889c78260bbc1339deb4d0c"} err="failed to get container status \"9b7b949dd094a49d43922345fc17873f359130750889c78260bbc1339deb4d0c\": rpc error: code = NotFound desc = could not find container \"9b7b949dd094a49d43922345fc17873f359130750889c78260bbc1339deb4d0c\": container with ID starting with 9b7b949dd094a49d43922345fc17873f359130750889c78260bbc1339deb4d0c not found: ID does not exist"
Nov 04 03:47:46.810762 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.810656    4510 scope.go:122] "RemoveContainer" containerID="146f83caa1e9b7a310c6008c676596348bba781354b664c6a67d9b6362b98452"
Nov 04 03:47:46.820290 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.820274    4510 scope.go:122] "RemoveContainer" containerID="146f83caa1e9b7a310c6008c676596348bba781354b664c6a67d9b6362b98452"
Nov 04 03:47:46.820553 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:47:46.820535    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"146f83caa1e9b7a310c6008c676596348bba781354b664c6a67d9b6362b98452\": container with ID starting with 146f83caa1e9b7a310c6008c676596348bba781354b664c6a67d9b6362b98452 not found: ID does not exist" containerID="146f83caa1e9b7a310c6008c676596348bba781354b664c6a67d9b6362b98452"
Nov 04 03:47:46.820604 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.820559    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"146f83caa1e9b7a310c6008c676596348bba781354b664c6a67d9b6362b98452"} err="failed to get container status \"146f83caa1e9b7a310c6008c676596348bba781354b664c6a67d9b6362b98452\": rpc error: code = NotFound desc = could not find container \"146f83caa1e9b7a310c6008c676596348bba781354b664c6a67d9b6362b98452\": container with ID starting with 146f83caa1e9b7a310c6008c676596348bba781354b664c6a67d9b6362b98452 not found: ID does not exist"
Nov 04 03:47:46.820604 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.820575    4510 scope.go:122] "RemoveContainer" containerID="e9e5b868b58f59ca3f18dba43fcca7798fbb024285d5c6168a0bb29f6a646bd6"
Nov 04 03:47:46.828052 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.828033    4510 scope.go:122] "RemoveContainer" containerID="e9e5b868b58f59ca3f18dba43fcca7798fbb024285d5c6168a0bb29f6a646bd6"
Nov 04 03:47:46.828313 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:47:46.828296    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9e5b868b58f59ca3f18dba43fcca7798fbb024285d5c6168a0bb29f6a646bd6\": container with ID starting with e9e5b868b58f59ca3f18dba43fcca7798fbb024285d5c6168a0bb29f6a646bd6 not found: ID does not exist" containerID="e9e5b868b58f59ca3f18dba43fcca7798fbb024285d5c6168a0bb29f6a646bd6"
Nov 04 03:47:46.828385 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.828324    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9e5b868b58f59ca3f18dba43fcca7798fbb024285d5c6168a0bb29f6a646bd6"} err="failed to get container status \"e9e5b868b58f59ca3f18dba43fcca7798fbb024285d5c6168a0bb29f6a646bd6\": rpc error: code = NotFound desc = could not find container \"e9e5b868b58f59ca3f18dba43fcca7798fbb024285d5c6168a0bb29f6a646bd6\": container with ID starting with e9e5b868b58f59ca3f18dba43fcca7798fbb024285d5c6168a0bb29f6a646bd6 not found: ID does not exist"
Nov 04 03:47:46.964914 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:46.964881    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"]
Nov 04 03:47:47.014795 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:47.014762    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-c5bec0/distinct-2-w3-c5bec0-kserve-86454ddc7f-7wpfs"]
Nov 04 03:47:47.078971 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:47.078875    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"]
Nov 04 03:47:47.082099 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:47.082070    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-c5bec0/premium-w3-c5bec0-kserve-7c4d8558d5-t428f"]
Nov 04 03:47:47.191563 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:47.191529    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"]
Nov 04 03:47:47.199964 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:47.199925    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-c5bec0/simulator-w3-c5bec0-kserve-7cff6bf99b-hpf5r"]
Nov 04 03:47:48.861444 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:48.861398    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="207320d1-fa2f-4204-805a-ec84fec16b89" path="/var/lib/kubelet/pods/207320d1-fa2f-4204-805a-ec84fec16b89/volumes"
Nov 04 03:47:48.861853 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:48.861805    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ba15e83e-3b7c-4f87-9513-dad698c4147b" path="/var/lib/kubelet/pods/ba15e83e-3b7c-4f87-9513-dad698c4147b/volumes"
Nov 04 03:47:48.862143 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:47:48.862130    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="dd9ea1b1-0b00-4c30-a4d5-e2de30e12496" path="/var/lib/kubelet/pods/dd9ea1b1-0b00-4c30-a4d5-e2de30e12496/volumes"
Nov 04 03:47:53.317583 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:47:53.317545    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:48:02.724034 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.723994    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"]
Nov 04 03:48:02.724593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.724378    4510 cpu_manager.go:414] "containerMap: removing container" podUID="e58c8f3e-b840-4a6c-9592-888c2d03ee78" containerName="payload-processing"
Nov 04 03:48:02.724593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.724391    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e58c8f3e-b840-4a6c-9592-888c2d03ee78" containerName="payload-processing"
Nov 04 03:48:02.724593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.724406    4510 cpu_manager.go:414] "containerMap: removing container" podUID="ba15e83e-3b7c-4f87-9513-dad698c4147b" containerName="main"
Nov 04 03:48:02.724593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.724412    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ba15e83e-3b7c-4f87-9513-dad698c4147b" containerName="main"
Nov 04 03:48:02.724593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.724431    4510 cpu_manager.go:414] "containerMap: removing container" podUID="207320d1-fa2f-4204-805a-ec84fec16b89" containerName="main"
Nov 04 03:48:02.724593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.724441    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="207320d1-fa2f-4204-805a-ec84fec16b89" containerName="main"
Nov 04 03:48:02.724593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.724449    4510 cpu_manager.go:414] "containerMap: removing container" podUID="dd9ea1b1-0b00-4c30-a4d5-e2de30e12496" containerName="main"
Nov 04 03:48:02.724593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.724454    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="dd9ea1b1-0b00-4c30-a4d5-e2de30e12496" containerName="main"
Nov 04 03:48:02.724593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.724462    4510 cpu_manager.go:414] "containerMap: removing container" podUID="78da5e30-34cb-416c-93dd-00ce41a38bcf" containerName="maas-api"
Nov 04 03:48:02.724593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.724467    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="78da5e30-34cb-416c-93dd-00ce41a38bcf" containerName="maas-api"
Nov 04 03:48:02.724593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.724477    4510 cpu_manager.go:414] "containerMap: removing container" podUID="001d5e6a-505a-4f19-abe8-22c8cbb53704" containerName="payload-pre-processing"
Nov 04 03:48:02.724593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.724482    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="001d5e6a-505a-4f19-abe8-22c8cbb53704" containerName="payload-pre-processing"
Nov 04 03:48:02.724593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.724539    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="207320d1-fa2f-4204-805a-ec84fec16b89" containerName="main"
Nov 04 03:48:02.724593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.724547    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="dd9ea1b1-0b00-4c30-a4d5-e2de30e12496" containerName="main"
Nov 04 03:48:02.724593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.724553    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="78da5e30-34cb-416c-93dd-00ce41a38bcf" containerName="maas-api"
Nov 04 03:48:02.724593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.724558    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="001d5e6a-505a-4f19-abe8-22c8cbb53704" containerName="payload-pre-processing"
Nov 04 03:48:02.724593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.724564    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="e58c8f3e-b840-4a6c-9592-888c2d03ee78" containerName="payload-processing"
Nov 04 03:48:02.724593 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.724570    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="ba15e83e-3b7c-4f87-9513-dad698c4147b" containerName="main"
Nov 04 03:48:02.727651 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.727633    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.780374 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.780349    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-c5bec0-openshift-default-dockercfg-fkbcb\""
Nov 04 03:48:02.865631 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.865600    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-podinfo\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.865804 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.865643    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-credential-socket\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.865804 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.865727    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-envoy\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.865804 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.865796    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-data\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.865916 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.865838    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75bm8\" (UniqueName: \"kubernetes.io/projected/9c950359-31fc-4844-bb5d-1763b7bf77d7-kube-api-access-75bm8\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.865916 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.865891    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c950359-31fc-4844-bb5d-1763b7bf77d7-istiod-ca-cert\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.865981 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.865921    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-workload-socket\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.865981 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.865970    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-workload-certs\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.866086 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.866056    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-token\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.966963 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.966935    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-workload-certs\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.966963 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.966967    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-token\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.967220 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.967018    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-podinfo\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.967220 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.967161    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-credential-socket\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.967340 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.967308    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-envoy\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.967399 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.967339    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-data\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.967399 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.967367    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75bm8\" (UniqueName: \"kubernetes.io/projected/9c950359-31fc-4844-bb5d-1763b7bf77d7-kube-api-access-75bm8\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.967399 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.967378    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-workload-certs\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.967613 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.967402    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c950359-31fc-4844-bb5d-1763b7bf77d7-istiod-ca-cert\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.967613 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.967472    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-workload-socket\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.967613 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.967531    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-credential-socket\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.967771 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.967643    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-data\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.967842 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.967822    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-workload-socket\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.968263 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.968240    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c950359-31fc-4844-bb5d-1763b7bf77d7-istiod-ca-cert\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.969594 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.969567    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-envoy\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:02.969896 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:02.969877    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-podinfo\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:03.005455 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:03.005385    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"]
Nov 04 03:48:03.039741 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:03.039714    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75bm8\" (UniqueName: \"kubernetes.io/projected/9c950359-31fc-4844-bb5d-1763b7bf77d7-kube-api-access-75bm8\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:03.047071 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:03.047047    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-token\") pod \"e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") " pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:03.341240 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:03.341141    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:03.772244 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:03.772202    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"]
Nov 04 03:48:03.810183 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:48:03.810151    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c950359_31fc_4844_bb5d_1763b7bf77d7.slice/crio-c28acd64496597d172805405dac70b217b28bbd76e9cf40bae867dd9035ccc60 WatchSource:0}: Error finding container c28acd64496597d172805405dac70b217b28bbd76e9cf40bae867dd9035ccc60: Status 404 returned error can't find the container with id c28acd64496597d172805405dac70b217b28bbd76e9cf40bae867dd9035ccc60
Nov 04 03:48:03.812254 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:03.812222    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:48:03.812357 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:03.812302    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:48:03.812357 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:03.812348    4510 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892012Ki","pods":"250"}
Nov 04 03:48:03.902595 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:03.902559    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf" event={"ID":"9c950359-31fc-4844-bb5d-1763b7bf77d7","Type":"ContainerStarted","Data":"1c91d5b349c66c89143f0ac5c94ca232941d84815a40ee1a08fe9e8bb397823b"}
Nov 04 03:48:03.902810 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:03.902620    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf" event={"ID":"9c950359-31fc-4844-bb5d-1763b7bf77d7","Type":"ContainerStarted","Data":"c28acd64496597d172805405dac70b217b28bbd76e9cf40bae867dd9035ccc60"}
Nov 04 03:48:04.024133 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:04.024018    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf" podStartSLOduration=2.024002798 podStartE2EDuration="2.024002798s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:48:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:48:04.022674623 +0000 UTC m=+1859.286548933" watchObservedRunningTime="2026-11-04 03:48:04.024002798 +0000 UTC m=+1859.287877136"
Nov 04 03:48:04.341396 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:04.341307    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:04.342491 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:04.342466    4510 patch_prober.go:29] interesting pod/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Nov 04 03:48:04.342611 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:04.342513    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf" podUID="9c950359-31fc-4844-bb5d-1763b7bf77d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Nov 04 03:48:05.235702 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:05.235655    4510 scope.go:122] "RemoveContainer" containerID="2dd8ef95e53a328324f90a1404477fa8ae435a31972b0438ae0bfd182c8625c6"
Nov 04 03:48:05.342066 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:05.342032    4510 patch_prober.go:29] interesting pod/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Nov 04 03:48:05.342251 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:05.342089    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf" podUID="9c950359-31fc-4844-bb5d-1763b7bf77d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Nov 04 03:48:06.342423 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:06.342381    4510 patch_prober.go:29] interesting pod/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Nov 04 03:48:06.342874 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:06.342440    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf" podUID="9c950359-31fc-4844-bb5d-1763b7bf77d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Nov 04 03:48:07.342468 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:07.342433    4510 patch_prober.go:29] interesting pod/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Nov 04 03:48:07.342896 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:07.342489    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf" podUID="9c950359-31fc-4844-bb5d-1763b7bf77d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Nov 04 03:48:08.342442 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:08.342408    4510 patch_prober.go:29] interesting pod/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Nov 04 03:48:08.342627 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:08.342464    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf" podUID="9c950359-31fc-4844-bb5d-1763b7bf77d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Nov 04 03:48:09.342344 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:09.342309    4510 patch_prober.go:29] interesting pod/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Nov 04 03:48:09.342546 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:09.342361    4510 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf" podUID="9c950359-31fc-4844-bb5d-1763b7bf77d7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Nov 04 03:48:10.345321 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:10.345291    4510 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:10.345810 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:10.345651    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:10.346319 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:10.346300    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:12.051403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:12.051370    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"]
Nov 04 03:48:12.968465 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:12.968431    4510 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf" podUID="9c950359-31fc-4844-bb5d-1763b7bf77d7" containerName="istio-proxy" containerID="cri-o://1c91d5b349c66c89143f0ac5c94ca232941d84815a40ee1a08fe9e8bb397823b" gracePeriod=30
Nov 04 03:48:14.035502 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:14.035472    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-57xgd_b9cf3eee-3f53-4752-a9f7-cfb673fe6452/manager/0.log"
Nov 04 03:48:14.264880 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:14.264849    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-kscfp_a00930d1-cbd5-4c54-a54f-599549dad6e3/kuadrant-console-plugin/0.log"
Nov 04 03:48:15.320224 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:15.320196    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-s7xrk_7d7e7a84-8013-47fa-9d1e-687af0d59f2c/manager/0.log"
Nov 04 03:48:17.731261 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:17.731233    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-82ql9_37844287-506b-44bb-8d42-7c5c8b37f09e/manager/0.log"
Nov 04 03:48:18.219182 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.219154    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:18.235382 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.235306    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-workload-certs\") pod \"9c950359-31fc-4844-bb5d-1763b7bf77d7\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") "
Nov 04 03:48:18.235382 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.235365    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-workload-socket\") pod \"9c950359-31fc-4844-bb5d-1763b7bf77d7\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") "
Nov 04 03:48:18.235575 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.235410    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-envoy\") pod \"9c950359-31fc-4844-bb5d-1763b7bf77d7\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") "
Nov 04 03:48:18.235575 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.235460    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-credential-socket\") pod \"9c950359-31fc-4844-bb5d-1763b7bf77d7\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") "
Nov 04 03:48:18.235575 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.235533    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9c950359-31fc-4844-bb5d-1763b7bf77d7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c950359-31fc-4844-bb5d-1763b7bf77d7-istiod-ca-cert\") pod \"9c950359-31fc-4844-bb5d-1763b7bf77d7\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") "
Nov 04 03:48:18.235779 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.235593    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-workload-certs" pod "9c950359-31fc-4844-bb5d-1763b7bf77d7" (UID: "9c950359-31fc-4844-bb5d-1763b7bf77d7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:48:18.235779 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.235621    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9c950359-31fc-4844-bb5d-1763b7bf77d7-kube-api-access-75bm8\" (UniqueName: \"kubernetes.io/projected/9c950359-31fc-4844-bb5d-1763b7bf77d7-kube-api-access-75bm8\") pod \"9c950359-31fc-4844-bb5d-1763b7bf77d7\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") "
Nov 04 03:48:18.235779 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.235712    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-workload-socket" pod "9c950359-31fc-4844-bb5d-1763b7bf77d7" (UID: "9c950359-31fc-4844-bb5d-1763b7bf77d7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:48:18.235957 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.235826    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-data\") pod \"9c950359-31fc-4844-bb5d-1763b7bf77d7\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") "
Nov 04 03:48:18.235957 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.235830    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-credential-socket" pod "9c950359-31fc-4844-bb5d-1763b7bf77d7" (UID: "9c950359-31fc-4844-bb5d-1763b7bf77d7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:48:18.235957 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.235861    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-podinfo\") pod \"9c950359-31fc-4844-bb5d-1763b7bf77d7\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") "
Nov 04 03:48:18.235957 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.235883    4510 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-token\" (UniqueName: \"kubernetes.io/projected/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-token\") pod \"9c950359-31fc-4844-bb5d-1763b7bf77d7\" (UID: \"9c950359-31fc-4844-bb5d-1763b7bf77d7\") "
Nov 04 03:48:18.235957 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.235948    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c950359-31fc-4844-bb5d-1763b7bf77d7-istiod-ca-cert" pod "9c950359-31fc-4844-bb5d-1763b7bf77d7" (UID: "9c950359-31fc-4844-bb5d-1763b7bf77d7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 03:48:18.236223 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.236082    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-data" pod "9c950359-31fc-4844-bb5d-1763b7bf77d7" (UID: "9c950359-31fc-4844-bb5d-1763b7bf77d7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:48:18.236264 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.236240    4510 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-workload-certs\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:48:18.236264 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.236254    4510 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-workload-socket\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:48:18.236264 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.236263    4510 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-credential-socket\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:48:18.236361 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.236272    4510 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9c950359-31fc-4844-bb5d-1763b7bf77d7-istiod-ca-cert\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:48:18.236361 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.236280    4510 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-data\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:48:18.238130 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.238101    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-token" pod "9c950359-31fc-4844-bb5d-1763b7bf77d7" (UID: "9c950359-31fc-4844-bb5d-1763b7bf77d7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:48:18.238396 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.238380    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-envoy" pod "9c950359-31fc-4844-bb5d-1763b7bf77d7" (UID: "9c950359-31fc-4844-bb5d-1763b7bf77d7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 03:48:18.238448 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.238415    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-podinfo" pod "9c950359-31fc-4844-bb5d-1763b7bf77d7" (UID: "9c950359-31fc-4844-bb5d-1763b7bf77d7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 03:48:18.238581 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.238562    4510 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c950359-31fc-4844-bb5d-1763b7bf77d7-kube-api-access-75bm8" pod "9c950359-31fc-4844-bb5d-1763b7bf77d7" (UID: "9c950359-31fc-4844-bb5d-1763b7bf77d7"). InnerVolumeSpecName "kube-api-access-75bm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 03:48:18.336860 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.336836    4510 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-envoy\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:48:18.336860 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.336857    4510 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75bm8\" (UniqueName: \"kubernetes.io/projected/9c950359-31fc-4844-bb5d-1763b7bf77d7-kube-api-access-75bm8\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:48:18.337066 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.336867    4510 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-podinfo\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:48:18.337066 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:18.336875    4510 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9c950359-31fc-4844-bb5d-1763b7bf77d7-istio-token\") on node \"ip-10-0-133-235.us-west-1.compute.internal\" DevicePath \"\""
Nov 04 03:48:19.007221 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:19.007185    4510 generic.go:356] "Generic (PLEG): container finished" podID="9c950359-31fc-4844-bb5d-1763b7bf77d7" containerID="1c91d5b349c66c89143f0ac5c94ca232941d84815a40ee1a08fe9e8bb397823b" exitCode=0
Nov 04 03:48:19.007636 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:19.007253    4510 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"
Nov 04 03:48:19.007636 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:19.007262    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf" event={"ID":"9c950359-31fc-4844-bb5d-1763b7bf77d7","Type":"ContainerDied","Data":"1c91d5b349c66c89143f0ac5c94ca232941d84815a40ee1a08fe9e8bb397823b"}
Nov 04 03:48:19.007636 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:19.007340    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf" event={"ID":"9c950359-31fc-4844-bb5d-1763b7bf77d7","Type":"ContainerDied","Data":"c28acd64496597d172805405dac70b217b28bbd76e9cf40bae867dd9035ccc60"}
Nov 04 03:48:19.007636 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:19.007363    4510 scope.go:122] "RemoveContainer" containerID="1c91d5b349c66c89143f0ac5c94ca232941d84815a40ee1a08fe9e8bb397823b"
Nov 04 03:48:19.016020 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:19.016005    4510 scope.go:122] "RemoveContainer" containerID="1c91d5b349c66c89143f0ac5c94ca232941d84815a40ee1a08fe9e8bb397823b"
Nov 04 03:48:19.016290 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:48:19.016270    4510 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1c91d5b349c66c89143f0ac5c94ca232941d84815a40ee1a08fe9e8bb397823b\": container with ID starting with 1c91d5b349c66c89143f0ac5c94ca232941d84815a40ee1a08fe9e8bb397823b not found: ID does not exist" containerID="1c91d5b349c66c89143f0ac5c94ca232941d84815a40ee1a08fe9e8bb397823b"
Nov 04 03:48:19.016359 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:19.016303    4510 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1c91d5b349c66c89143f0ac5c94ca232941d84815a40ee1a08fe9e8bb397823b"} err="failed to get container status \"1c91d5b349c66c89143f0ac5c94ca232941d84815a40ee1a08fe9e8bb397823b\": rpc error: code = NotFound desc = could not find container \"1c91d5b349c66c89143f0ac5c94ca232941d84815a40ee1a08fe9e8bb397823b\": container with ID starting with 1c91d5b349c66c89143f0ac5c94ca232941d84815a40ee1a08fe9e8bb397823b not found: ID does not exist"
Nov 04 03:48:19.171602 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:19.171532    4510 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"]
Nov 04 03:48:19.221551 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:19.221524    4510 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-c5bec0-openshift-default-6f85d9855f-7ldgf"]
Nov 04 03:48:20.861465 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:20.861436    4510 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9c950359-31fc-4844-bb5d-1763b7bf77d7" path="/var/lib/kubelet/pods/9c950359-31fc-4844-bb5d-1763b7bf77d7/volumes"
Nov 04 03:48:23.317858 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:48:23.317822    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:48:53.315832 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:48:53.315790    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:48:55.648696 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:48:55.648646    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-82ql9_37844287-506b-44bb-8d42-7c5c8b37f09e/manager/0.log"
Nov 04 03:49:07.990034 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:07.990004    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-59ffd9d8c6-h4rm5_c383d916-fb50-48ef-9d54-0a24ad83ef07/maas-api/0.log"
Nov 04 03:49:09.112360 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:09.112328    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-7cdbf6dc44-7xvd6_7d9966f2-d52a-40d4-b1f1-7ea817b374ea/postgres/0.log"
Nov 04 03:49:11.734616 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:11.734584    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-57xgd_b9cf3eee-3f53-4752-a9f7-cfb673fe6452/manager/0.log"
Nov 04 03:49:11.999718 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:11.999608    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-kscfp_a00930d1-cbd5-4c54-a54f-599549dad6e3/kuadrant-console-plugin/0.log"
Nov 04 03:49:12.847562 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:12.847529    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-s7xrk_7d7e7a84-8013-47fa-9d1e-687af0d59f2c/manager/0.log"
Nov 04 03:49:14.481641 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:14.481558    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4_c4e94dfc-3d18-4966-b6cf-e06ed773939b/istio-proxy/0.log"
Nov 04 03:49:15.268022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:15.267988    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d77786fb9-j8wzv_47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8/kube-auth-proxy/0.log"
Nov 04 03:49:16.237490 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:16.237442    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6dcf757899-blsp9_5a005fb9-5ac0-40f1-85eb-c26cd3347f55/istio-proxy/0.log"
Nov 04 03:49:16.977586 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:16.977559    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6dcf757899-mmdl5_718877b6-c5ed-451f-9b62-e64eb4e1ee88/istio-proxy/0.log"
Nov 04 03:49:17.691403 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:17.691371    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6dcf757899-w6hx4_fb734ce3-f820-46a0-a8e3-0f492e4f80c0/istio-proxy/0.log"
Nov 04 03:49:17.966023 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:17.966002    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk_daf49b68-23ca-478a-a48d-06db0f2f1760/istio-proxy/0.log"
Nov 04 03:49:23.315914 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:49:23.315869    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:49:51.767317 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:51.767282    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-jx6kp/must-gather-wbnkq"]
Nov 04 03:49:51.767828 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:51.767615    4510 cpu_manager.go:414] "containerMap: removing container" podUID="9c950359-31fc-4844-bb5d-1763b7bf77d7" containerName="istio-proxy"
Nov 04 03:49:51.767828 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:51.767625    4510 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9c950359-31fc-4844-bb5d-1763b7bf77d7" containerName="istio-proxy"
Nov 04 03:49:51.768351 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:51.768321    4510 memory_manager.go:365] "RemoveStaleState removing state" podUID="9c950359-31fc-4844-bb5d-1763b7bf77d7" containerName="istio-proxy"
Nov 04 03:49:51.775940 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:51.775913    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jx6kp/must-gather-wbnkq"
Nov 04 03:49:51.828153 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:51.828128    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jx6kp\"/\"kube-root-ca.crt\""
Nov 04 03:49:51.878000 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:51.877971    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-jx6kp\"/\"default-dockercfg-fmslz\""
Nov 04 03:49:51.878000 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:51.877989    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-jx6kp\"/\"openshift-service-ca.crt\""
Nov 04 03:49:51.880376 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:51.880354    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jx6kp/must-gather-wbnkq"]
Nov 04 03:49:51.882291 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:51.882271    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rnkxc/must-gather-7w7n6"]
Nov 04 03:49:51.885631 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:51.885616    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rnkxc/must-gather-7w7n6"
Nov 04 03:49:51.927994 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:51.927970    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqc8d\" (UniqueName: \"kubernetes.io/projected/15335cd6-554f-405f-8761-ee9248819e4a-kube-api-access-rqc8d\") pod \"must-gather-wbnkq\" (UID: \"15335cd6-554f-405f-8761-ee9248819e4a\") " pod="openshift-must-gather-jx6kp/must-gather-wbnkq"
Nov 04 03:49:51.928092 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:51.928007    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/15335cd6-554f-405f-8761-ee9248819e4a-must-gather-output\") pod \"must-gather-wbnkq\" (UID: \"15335cd6-554f-405f-8761-ee9248819e4a\") " pod="openshift-must-gather-jx6kp/must-gather-wbnkq"
Nov 04 03:49:51.934341 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:51.934319    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rnkxc/must-gather-7w7n6"]
Nov 04 03:49:51.938046 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:51.938025    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rnkxc\"/\"kube-root-ca.crt\""
Nov 04 03:49:51.938122 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:51.938096    4510 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rnkxc\"/\"default-dockercfg-hbjsz\""
Nov 04 03:49:51.938122 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:51.938113    4510 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rnkxc\"/\"openshift-service-ca.crt\""
Nov 04 03:49:52.028797 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:52.028745    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/431b1bb1-b5f8-4158-b586-3b9872c68384-must-gather-output\") pod \"must-gather-7w7n6\" (UID: \"431b1bb1-b5f8-4158-b586-3b9872c68384\") " pod="openshift-must-gather-rnkxc/must-gather-7w7n6"
Nov 04 03:49:52.028797 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:52.028786    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mczxx\" (UniqueName: \"kubernetes.io/projected/431b1bb1-b5f8-4158-b586-3b9872c68384-kube-api-access-mczxx\") pod \"must-gather-7w7n6\" (UID: \"431b1bb1-b5f8-4158-b586-3b9872c68384\") " pod="openshift-must-gather-rnkxc/must-gather-7w7n6"
Nov 04 03:49:52.028915 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:52.028886    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqc8d\" (UniqueName: \"kubernetes.io/projected/15335cd6-554f-405f-8761-ee9248819e4a-kube-api-access-rqc8d\") pod \"must-gather-wbnkq\" (UID: \"15335cd6-554f-405f-8761-ee9248819e4a\") " pod="openshift-must-gather-jx6kp/must-gather-wbnkq"
Nov 04 03:49:52.028915 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:52.028910    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/15335cd6-554f-405f-8761-ee9248819e4a-must-gather-output\") pod \"must-gather-wbnkq\" (UID: \"15335cd6-554f-405f-8761-ee9248819e4a\") " pod="openshift-must-gather-jx6kp/must-gather-wbnkq"
Nov 04 03:49:52.029230 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:52.029215    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/15335cd6-554f-405f-8761-ee9248819e4a-must-gather-output\") pod \"must-gather-wbnkq\" (UID: \"15335cd6-554f-405f-8761-ee9248819e4a\") " pod="openshift-must-gather-jx6kp/must-gather-wbnkq"
Nov 04 03:49:52.090381 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:52.090358    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqc8d\" (UniqueName: \"kubernetes.io/projected/15335cd6-554f-405f-8761-ee9248819e4a-kube-api-access-rqc8d\") pod \"must-gather-wbnkq\" (UID: \"15335cd6-554f-405f-8761-ee9248819e4a\") " pod="openshift-must-gather-jx6kp/must-gather-wbnkq"
Nov 04 03:49:52.129615 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:52.129590    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/431b1bb1-b5f8-4158-b586-3b9872c68384-must-gather-output\") pod \"must-gather-7w7n6\" (UID: \"431b1bb1-b5f8-4158-b586-3b9872c68384\") " pod="openshift-must-gather-rnkxc/must-gather-7w7n6"
Nov 04 03:49:52.129723 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:52.129639    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mczxx\" (UniqueName: \"kubernetes.io/projected/431b1bb1-b5f8-4158-b586-3b9872c68384-kube-api-access-mczxx\") pod \"must-gather-7w7n6\" (UID: \"431b1bb1-b5f8-4158-b586-3b9872c68384\") " pod="openshift-must-gather-rnkxc/must-gather-7w7n6"
Nov 04 03:49:52.129911 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:52.129894    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/431b1bb1-b5f8-4158-b586-3b9872c68384-must-gather-output\") pod \"must-gather-7w7n6\" (UID: \"431b1bb1-b5f8-4158-b586-3b9872c68384\") " pod="openshift-must-gather-rnkxc/must-gather-7w7n6"
Nov 04 03:49:52.190664 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:52.190646    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mczxx\" (UniqueName: \"kubernetes.io/projected/431b1bb1-b5f8-4158-b586-3b9872c68384-kube-api-access-mczxx\") pod \"must-gather-7w7n6\" (UID: \"431b1bb1-b5f8-4158-b586-3b9872c68384\") " pod="openshift-must-gather-rnkxc/must-gather-7w7n6"
Nov 04 03:49:52.198584 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:52.198566    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rnkxc/must-gather-7w7n6"
Nov 04 03:49:52.390200 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:52.390119    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-jx6kp/must-gather-wbnkq"
Nov 04 03:49:52.573760 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:52.573735    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rnkxc/must-gather-7w7n6"]
Nov 04 03:49:52.575776 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:49:52.575748    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod431b1bb1_b5f8_4158_b586_3b9872c68384.slice/crio-f0a1e5e0f654bd922ff23dec83de1b7f8b1791c4528b89f332e424ad2a780f9c WatchSource:0}: Error finding container f0a1e5e0f654bd922ff23dec83de1b7f8b1791c4528b89f332e424ad2a780f9c: Status 404 returned error can't find the container with id f0a1e5e0f654bd922ff23dec83de1b7f8b1791c4528b89f332e424ad2a780f9c
Nov 04 03:49:52.577651 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:52.577637    4510 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 03:49:52.763251 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:52.763214    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-jx6kp/must-gather-wbnkq"]
Nov 04 03:49:52.765558 ip-10-0-133-235 kubenswrapper[4510]: W1104 03:49:52.765533    4510 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15335cd6_554f_405f_8761_ee9248819e4a.slice/crio-ed50b245bf9f4b1d88699bf9586ad2c0e421980cc63f4bb580f5ef0b76975b34 WatchSource:0}: Error finding container ed50b245bf9f4b1d88699bf9586ad2c0e421980cc63f4bb580f5ef0b76975b34: Status 404 returned error can't find the container with id ed50b245bf9f4b1d88699bf9586ad2c0e421980cc63f4bb580f5ef0b76975b34
Nov 04 03:49:53.317761 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:49:53.317728    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:49:53.475825 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:53.475793    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jx6kp/must-gather-wbnkq" event={"ID":"15335cd6-554f-405f-8761-ee9248819e4a","Type":"ContainerStarted","Data":"ed50b245bf9f4b1d88699bf9586ad2c0e421980cc63f4bb580f5ef0b76975b34"}
Nov 04 03:49:53.476903 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:53.476877    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rnkxc/must-gather-7w7n6" event={"ID":"431b1bb1-b5f8-4158-b586-3b9872c68384","Type":"ContainerStarted","Data":"f0a1e5e0f654bd922ff23dec83de1b7f8b1791c4528b89f332e424ad2a780f9c"}
Nov 04 03:49:54.484064 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:54.484020    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rnkxc/must-gather-7w7n6" event={"ID":"431b1bb1-b5f8-4158-b586-3b9872c68384","Type":"ContainerStarted","Data":"3b4c5e038233c8025d6a93d6e95d22d8adfb9e5df681063dd35ba2260cc9ab2b"}
Nov 04 03:49:54.484455 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:54.484074    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rnkxc/must-gather-7w7n6" event={"ID":"431b1bb1-b5f8-4158-b586-3b9872c68384","Type":"ContainerStarted","Data":"014599fdbef8f46fb55d312e3b4eec89df88dc8f6d375110486501ca158ca3b9"}
Nov 04 03:49:54.599279 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:49:54.599225    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-rnkxc/must-gather-7w7n6" podStartSLOduration=2.307184565 podStartE2EDuration="3.599212266s" totalImagesPullingTime="1.292027701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:49:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:49:54.598417638 +0000 UTC m=+1969.862291944" watchObservedRunningTime="2026-11-04 03:49:54.599212266 +0000 UTC m=+1969.863086574"
Nov 04 03:50:00.530996 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:00.530954    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jx6kp/must-gather-wbnkq" event={"ID":"15335cd6-554f-405f-8761-ee9248819e4a","Type":"ContainerStarted","Data":"daa53d569fafaded3b34a0ccab01e1ee8c72785da0d8fb6086bfd9216e4d73a4"}
Nov 04 03:50:00.531446 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:00.531015    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-jx6kp/must-gather-wbnkq" event={"ID":"15335cd6-554f-405f-8761-ee9248819e4a","Type":"ContainerStarted","Data":"b24f4238c3a3f639a3fd18bc203b71d89601a3d8cc9888da88b303602d70533a"}
Nov 04 03:50:00.654252 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:00.654198    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-jx6kp/must-gather-wbnkq" podStartSLOduration=2.875946465 podStartE2EDuration="9.654185439s" totalImagesPullingTime="6.778238974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 03:49:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:50:00.652828922 +0000 UTC m=+1975.916703230" watchObservedRunningTime="2026-11-04 03:50:00.654185439 +0000 UTC m=+1975.918059781"
Nov 04 03:50:02.288755 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:02.287961    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tnstt_ebbc4d63-f22e-4763-89c4-e521051fd3f1/global-pull-secret-syncer/0.log"
Nov 04 03:50:04.778304 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:04.774079    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-c45lh_ed2535b3-99cd-4eb4-9475-8fa24337d022/konnectivity-agent/0.log"
Nov 04 03:50:05.839992 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:05.839956    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-82ql9_37844287-506b-44bb-8d42-7c5c8b37f09e/manager/0.log"
Nov 04 03:50:06.173950 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:06.173870    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-235.us-west-1.compute.internal_3c765b34c16910e2f80f9fa5e61a7a31/haproxy/0.log"
Nov 04 03:50:11.650595 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:11.650559    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-82ql9_37844287-506b-44bb-8d42-7c5c8b37f09e/manager/0.log"
Nov 04 03:50:12.034098 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.034070    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-57xgd_b9cf3eee-3f53-4752-a9f7-cfb673fe6452/manager/0.log"
Nov 04 03:50:12.478332 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.478302    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-kscfp_a00930d1-cbd5-4c54-a54f-599549dad6e3/kuadrant-console-plugin/0.log"
Nov 04 03:50:12.624111 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.621920    4510 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"]
Nov 04 03:50:12.631714 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.627301    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:12.677604 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.677576    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjflw\" (UniqueName: \"kubernetes.io/projected/87858096-0d2e-43e7-9ea6-f160badbd55c-kube-api-access-mjflw\") pod \"perf-node-gather-daemonset-rlbl4\" (UID: \"87858096-0d2e-43e7-9ea6-f160badbd55c\") " pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:12.678117 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.677724    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87858096-0d2e-43e7-9ea6-f160badbd55c-lib-modules\") pod \"perf-node-gather-daemonset-rlbl4\" (UID: \"87858096-0d2e-43e7-9ea6-f160badbd55c\") " pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:12.678117 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.677773    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/87858096-0d2e-43e7-9ea6-f160badbd55c-podres\") pod \"perf-node-gather-daemonset-rlbl4\" (UID: \"87858096-0d2e-43e7-9ea6-f160badbd55c\") " pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:12.678117 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.677806    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/87858096-0d2e-43e7-9ea6-f160badbd55c-proc\") pod \"perf-node-gather-daemonset-rlbl4\" (UID: \"87858096-0d2e-43e7-9ea6-f160badbd55c\") " pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:12.678117 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.677836    4510 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87858096-0d2e-43e7-9ea6-f160badbd55c-sys\") pod \"perf-node-gather-daemonset-rlbl4\" (UID: \"87858096-0d2e-43e7-9ea6-f160badbd55c\") " pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:12.715594 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.715562    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"]
Nov 04 03:50:12.779022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.778937    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjflw\" (UniqueName: \"kubernetes.io/projected/87858096-0d2e-43e7-9ea6-f160badbd55c-kube-api-access-mjflw\") pod \"perf-node-gather-daemonset-rlbl4\" (UID: \"87858096-0d2e-43e7-9ea6-f160badbd55c\") " pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:12.779022 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.779007    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87858096-0d2e-43e7-9ea6-f160badbd55c-lib-modules\") pod \"perf-node-gather-daemonset-rlbl4\" (UID: \"87858096-0d2e-43e7-9ea6-f160badbd55c\") " pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:12.779232 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.779048    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/87858096-0d2e-43e7-9ea6-f160badbd55c-podres\") pod \"perf-node-gather-daemonset-rlbl4\" (UID: \"87858096-0d2e-43e7-9ea6-f160badbd55c\") " pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:12.779232 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.779065    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/87858096-0d2e-43e7-9ea6-f160badbd55c-proc\") pod \"perf-node-gather-daemonset-rlbl4\" (UID: \"87858096-0d2e-43e7-9ea6-f160badbd55c\") " pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:12.779232 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.779080    4510 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87858096-0d2e-43e7-9ea6-f160badbd55c-sys\") pod \"perf-node-gather-daemonset-rlbl4\" (UID: \"87858096-0d2e-43e7-9ea6-f160badbd55c\") " pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:12.779232 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.779093    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87858096-0d2e-43e7-9ea6-f160badbd55c-lib-modules\") pod \"perf-node-gather-daemonset-rlbl4\" (UID: \"87858096-0d2e-43e7-9ea6-f160badbd55c\") " pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:12.779232 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.779191    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/87858096-0d2e-43e7-9ea6-f160badbd55c-podres\") pod \"perf-node-gather-daemonset-rlbl4\" (UID: \"87858096-0d2e-43e7-9ea6-f160badbd55c\") " pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:12.779232 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.779206    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87858096-0d2e-43e7-9ea6-f160badbd55c-sys\") pod \"perf-node-gather-daemonset-rlbl4\" (UID: \"87858096-0d2e-43e7-9ea6-f160badbd55c\") " pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:12.779480 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.779243    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/87858096-0d2e-43e7-9ea6-f160badbd55c-proc\") pod \"perf-node-gather-daemonset-rlbl4\" (UID: \"87858096-0d2e-43e7-9ea6-f160badbd55c\") " pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:12.840117 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.840080    4510 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjflw\" (UniqueName: \"kubernetes.io/projected/87858096-0d2e-43e7-9ea6-f160badbd55c-kube-api-access-mjflw\") pod \"perf-node-gather-daemonset-rlbl4\" (UID: \"87858096-0d2e-43e7-9ea6-f160badbd55c\") " pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:12.943496 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:12.943452    4510 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:13.294095 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:13.294051    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-s7xrk_7d7e7a84-8013-47fa-9d1e-687af0d59f2c/manager/0.log"
Nov 04 03:50:13.331635 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:13.331601    4510 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"]
Nov 04 03:50:13.682094 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:13.682001    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4" event={"ID":"87858096-0d2e-43e7-9ea6-f160badbd55c","Type":"ContainerStarted","Data":"08aeb94e57536f57e3f7cdd35fedc93601280a8c4d3496adf25cc2c51e22e514"}
Nov 04 03:50:13.682094 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:13.682072    4510 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4" event={"ID":"87858096-0d2e-43e7-9ea6-f160badbd55c","Type":"ContainerStarted","Data":"53a2335b7895b38118142e4354eec60999f0ec7154ff3f54936381c0e8882b3c"}
Nov 04 03:50:13.682659 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:13.682180    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:13.799202 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:13.799156    4510 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4" podStartSLOduration=1.799142855 podStartE2EDuration="1.799142855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 03:50:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 03:50:13.797917929 +0000 UTC m=+1989.061792248" watchObservedRunningTime="2026-11-04 03:50:13.799142855 +0000 UTC m=+1989.063017162"
Nov 04 03:50:16.928817 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:16.928777    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-6466c554d8-82ql9_37844287-506b-44bb-8d42-7c5c8b37f09e/manager/0.log"
Nov 04 03:50:19.698377 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:19.698348    4510 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rnkxc/perf-node-gather-daemonset-rlbl4"
Nov 04 03:50:21.704104 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:21.704066    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4_c4e94dfc-3d18-4966-b6cf-e06ed773939b/istio-proxy/0.log"
Nov 04 03:50:23.319962 ip-10-0-133-235 kubenswrapper[4510]: E1104 03:50:23.319914    4510 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-9dc9l" containerName="extractor"
Nov 04 03:50:23.622636 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:23.622112    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dq5vb_b097a546-e7b4-4a9b-b747-4f5cf12c5ed1/node-exporter/0.log"
Nov 04 03:50:23.694244 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:23.694221    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d77786fb9-j8wzv_47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8/kube-auth-proxy/0.log"
Nov 04 03:50:24.044501 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:24.044472    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dq5vb_b097a546-e7b4-4a9b-b747-4f5cf12c5ed1/kube-rbac-proxy/0.log"
Nov 04 03:50:24.467065 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:24.467042    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dq5vb_b097a546-e7b4-4a9b-b747-4f5cf12c5ed1/init-textfile/0.log"
Nov 04 03:50:24.582131 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:24.582097    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6dcf757899-blsp9_5a005fb9-5ac0-40f1-85eb-c26cd3347f55/istio-proxy/0.log"
Nov 04 03:50:25.264870 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:25.264841    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6dcf757899-mmdl5_718877b6-c5ed-451f-9b62-e64eb4e1ee88/istio-proxy/0.log"
Nov 04 03:50:25.908554 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:25.908521    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6dcf757899-w6hx4_fb734ce3-f820-46a0-a8e3-0f492e4f80c0/istio-proxy/0.log"
Nov 04 03:50:26.124040 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:26.124012    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-58fd47455f-5r9gk_daf49b68-23ca-478a-a48d-06db0f2f1760/istio-proxy/0.log"
Nov 04 03:50:30.404711 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:30.404551    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-jl6bs_62fc46c7-2c38-4fbb-ad7c-e690e403b8e5/prometheus-operator/0.log"
Nov 04 03:50:30.821443 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:30.821415    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-jl6bs_62fc46c7-2c38-4fbb-ad7c-e690e403b8e5/kube-rbac-proxy/0.log"
Nov 04 03:50:30.930461 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:30.930437    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-57xgd_b9cf3eee-3f53-4752-a9f7-cfb673fe6452/manager/0.log"
Nov 04 03:50:31.144006 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:31.143930    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-kscfp_a00930d1-cbd5-4c54-a54f-599549dad6e3/kuadrant-console-plugin/0.log"
Nov 04 03:50:31.247859 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:31.247828    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6489d8bf89-b72tp_cb42ed12-7192-4fce-a9e3-e9240081d662/prometheus-operator-admission-webhook/0.log"
Nov 04 03:50:31.853924 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:31.853886    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-s7xrk_7d7e7a84-8013-47fa-9d1e-687af0d59f2c/manager/0.log"
Nov 04 03:50:35.293380 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:35.293349    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7d699c9f7ctz9j4_c4e94dfc-3d18-4966-b6cf-e06ed773939b/istio-proxy/0.log"
Nov 04 03:50:37.302737 ip-10-0-133-235 kubenswrapper[4510]: I1104 03:50:37.302709    4510 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5d77786fb9-j8wzv_47b4d3a0-e1b5-444c-8524-1b6ec3b9cfb8/kube-auth-proxy/0.log"