Nov 04 02:13:03.034505 ip-10-0-130-155 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Nov 04 02:13:03.034515 ip-10-0-130-155 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Nov 04 02:13:03.034522 ip-10-0-130-155 systemd[1]: kubelet.service: Failed with result 'resources'.
Nov 04 02:13:03.034764 ip-10-0-130-155 systemd[1]: Failed to start Kubernetes Kubelet.
Nov 04 02:13:13.168225 ip-10-0-130-155 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Nov 04 02:13:13.168242 ip-10-0-130-155 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot c00ddae0cf3d420c833c04f2560dd9da --
Nov 04 02:15:24.908560 ip-10-0-130-155 systemd[1]: Starting Kubernetes Kubelet...
Nov 04 02:15:25.293598 ip-10-0-130-155 kubenswrapper[2577]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 02:15:25.293598 ip-10-0-130-155 kubenswrapper[2577]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 04 02:15:25.293598 ip-10-0-130-155 kubenswrapper[2577]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 02:15:25.293598 ip-10-0-130-155 kubenswrapper[2577]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 02:15:25.300658 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300123    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:25.300658 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300648    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:25.300658 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300653    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:25.300658 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300657    2577 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:25.300658 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300661    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:25.300658 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300664    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:25.300658 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300668    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:25.300658 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300672    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300680    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300684    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300688    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300692    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300696    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300702    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300707    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300711    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300714    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300718    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300722    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300726    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300730    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300734    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300738    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300742    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300746    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300749    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300753    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:25.301111 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300757    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300768    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300772    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300777    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300780    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300785    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300789    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300793    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300797    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300801    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300805    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300809    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300812    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300816    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300821    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300825    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300830    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300834    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300839    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:25.301917 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300843    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300847    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300851    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300856    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300860    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300864    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300868    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300872    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300877    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300881    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300885    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300890    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300895    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300899    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300904    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300908    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300912    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300916    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300921    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300926    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:25.302704 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300930    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300935    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300940    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300944    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300949    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300953    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300957    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300963    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300967    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300972    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300976    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300981    2577 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300985    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300989    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.300995    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301005    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301011    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301016    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301020    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:25.303536 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301025    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301029    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301033    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301038    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301043    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301047    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301052    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301056    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301060    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301064    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301069    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301073    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301078    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301083    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301087    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301091    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301095    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301099    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301105    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301109    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:25.304362 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.301114    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302537    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302550    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302555    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302559    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302564    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302569    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302573    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302577    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302582    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302587    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302591    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302595    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302600    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302604    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302608    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302612    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302616    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302620    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302624    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:25.304984 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302629    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302633    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302638    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302642    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302647    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302652    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302656    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302661    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302666    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302670    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302675    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302679    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302684    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302688    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302693    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302698    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302701    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302706    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302710    2577 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302714    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:25.305671 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302718    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302722    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302731    2577 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302735    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302740    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302745    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302749    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302753    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302757    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302762    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302766    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302771    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302775    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302780    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302784    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302788    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302793    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302797    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302801    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302806    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:25.306538 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302810    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302814    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302820    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302824    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302829    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302833    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302837    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302841    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302845    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302850    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302855    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302859    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302864    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302868    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302872    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302877    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302881    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302885    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302893    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:25.307465 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302899    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302904    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302909    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302913    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302917    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302921    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302925    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302929    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302934    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302939    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302951    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302958    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302964    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302968    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302972    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302977    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302981    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302985    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302990    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:25.308157 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302994    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.302998    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303002    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303006    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303010    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303014    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303018    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303022    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303026    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303944    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303953    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303958    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303963    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303968    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303972    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303976    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303981    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303986    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303990    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303994    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:25.308696 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.303998    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304004    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304008    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304013    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304017    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304021    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304026    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304031    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304035    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304039    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304044    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304048    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304052    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304056    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304060    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304064    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304069    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304073    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304077    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:25.309433 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304085    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304090    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304095    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304101    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304105    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304110    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304114    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304118    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304123    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304127    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304132    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304136    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304140    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304144    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304148    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304153    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304157    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304162    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304191    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304196    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:25.309918 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304200    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304205    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304210    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304214    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304218    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304223    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304229    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304235    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304241    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304246    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304251    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304256    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304260    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304264    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304268    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304273    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304278    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304283    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304288    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:25.310423 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304292    2577 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304296    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304301    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304305    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304310    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304314    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304318    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304322    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304327    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304332    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304337    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304341    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304346    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304350    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304354    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304358    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304362    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304366    2577 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304370    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304374    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:25.310995 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304378    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304382    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304386    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304390    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304394    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304398    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304411    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304416    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304420    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304424    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304433    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304438    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304445    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304449    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304453    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304457    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.304461    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305537    2577 flags.go:64] FLAG: --address="0.0.0.0"
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305561    2577 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305573    2577 flags.go:64] FLAG: --anonymous-auth="true"
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305584    2577 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 04 02:15:25.311501 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305592    2577 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305598    2577 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305605    2577 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305613    2577 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305619    2577 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305624    2577 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305629    2577 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305635    2577 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305640    2577 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305645    2577 flags.go:64] FLAG: --cgroup-root=""
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305650    2577 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305655    2577 flags.go:64] FLAG: --client-ca-file=""
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305659    2577 flags.go:64] FLAG: --cloud-provider="external"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305664    2577 flags.go:64] FLAG: --cluster-dns="[]"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305673    2577 flags.go:64] FLAG: --cluster-domain=""
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305677    2577 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305682    2577 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305687    2577 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305692    2577 flags.go:64] FLAG: --container-log-max-files="5"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305699    2577 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305704    2577 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305713    2577 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305720    2577 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305725    2577 flags.go:64] FLAG: --contention-profiling="false"
Nov 04 02:15:25.312007 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305730    2577 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305735    2577 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305740    2577 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305745    2577 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305754    2577 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305759    2577 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305764    2577 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305769    2577 flags.go:64] FLAG: --enable-load-reader="false"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305774    2577 flags.go:64] FLAG: --enable-server="true"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305779    2577 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305786    2577 flags.go:64] FLAG: --event-burst="100"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305792    2577 flags.go:64] FLAG: --event-qps="50"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305796    2577 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305801    2577 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305806    2577 flags.go:64] FLAG: --eviction-hard=""
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305814    2577 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305819    2577 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305824    2577 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305829    2577 flags.go:64] FLAG: --eviction-soft=""
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305834    2577 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305839    2577 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305844    2577 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305849    2577 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305854    2577 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305859    2577 flags.go:64] FLAG: --fail-swap-on="true"
Nov 04 02:15:25.312672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305863    2577 flags.go:64] FLAG: --feature-gates=""
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305870    2577 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305875    2577 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305881    2577 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305888    2577 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305893    2577 flags.go:64] FLAG: --healthz-port="10248"
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305899    2577 flags.go:64] FLAG: --help="false"
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305905    2577 flags.go:64] FLAG: --hostname-override="ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305910    2577 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305915    2577 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305920    2577 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305925    2577 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305931    2577 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305937    2577 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305942    2577 flags.go:64] FLAG: --image-service-endpoint=""
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305946    2577 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305951    2577 flags.go:64] FLAG: --kube-api-burst="100"
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305956    2577 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305961    2577 flags.go:64] FLAG: --kube-api-qps="50"
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305966    2577 flags.go:64] FLAG: --kube-reserved=""
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305971    2577 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305976    2577 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305981    2577 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 04 02:15:25.313316 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305986    2577 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305990    2577 flags.go:64] FLAG: --lock-file=""
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.305995    2577 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306000    2577 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306005    2577 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306014    2577 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306019    2577 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306024    2577 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306029    2577 flags.go:64] FLAG: --logging-format="text"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306033    2577 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306040    2577 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306045    2577 flags.go:64] FLAG: --manifest-url=""
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306049    2577 flags.go:64] FLAG: --manifest-url-header=""
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306059    2577 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306064    2577 flags.go:64] FLAG: --max-open-files="1000000"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306071    2577 flags.go:64] FLAG: --max-pods="110"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306085    2577 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306091    2577 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306095    2577 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306100    2577 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306105    2577 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306109    2577 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306114    2577 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306130    2577 flags.go:64] FLAG: --node-status-max-images="50"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306135    2577 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 04 02:15:25.313901 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306140    2577 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306145    2577 flags.go:64] FLAG: --pod-cidr=""
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306149    2577 flags.go:64] FLAG: --pod-manifest-path=""
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306154    2577 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306159    2577 flags.go:64] FLAG: --pods-per-core="0"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306163    2577 flags.go:64] FLAG: --port="10250"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306190    2577 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306195    2577 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-0baaeaf15c4ff4778"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306201    2577 flags.go:64] FLAG: --qos-reserved=""
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306206    2577 flags.go:64] FLAG: --read-only-port="10255"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306211    2577 flags.go:64] FLAG: --register-node="true"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306216    2577 flags.go:64] FLAG: --register-with-taints=""
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306223    2577 flags.go:64] FLAG: --registry-burst="10"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306227    2577 flags.go:64] FLAG: --registry-qps="5"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306231    2577 flags.go:64] FLAG: --reserved-cpus=""
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306236    2577 flags.go:64] FLAG: --reserved-memory=""
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306243    2577 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306248    2577 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306253    2577 flags.go:64] FLAG: --rotate-certificates="false"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306257    2577 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306264    2577 flags.go:64] FLAG: --runonce="false"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306269    2577 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306274    2577 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306279    2577 flags.go:64] FLAG: --seccomp-default="false"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306293    2577 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306298    2577 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 04 02:15:25.314580 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306303    2577 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306309    2577 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306314    2577 flags.go:64] FLAG: --storage-driver-password="root"
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306318    2577 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306323    2577 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306328    2577 flags.go:64] FLAG: --storage-driver-user="root"
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306333    2577 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306337    2577 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306342    2577 flags.go:64] FLAG: --system-cgroups=""
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306347    2577 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306357    2577 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306362    2577 flags.go:64] FLAG: --tls-cert-file=""
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306367    2577 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306379    2577 flags.go:64] FLAG: --tls-min-version=""
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306384    2577 flags.go:64] FLAG: --tls-private-key-file=""
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306389    2577 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306394    2577 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306399    2577 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306404    2577 flags.go:64] FLAG: --v="2"
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306412    2577 flags.go:64] FLAG: --version="false"
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306419    2577 flags.go:64] FLAG: --vmodule=""
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306425    2577 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.306430    2577 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306670    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:25.315263 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306678    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306684    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306689    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306695    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306702    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306706    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306711    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306716    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306721    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306725    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306729    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306733    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306737    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306742    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306746    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306750    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306754    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306759    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306763    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:25.315819 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306767    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306778    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306783    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306787    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306791    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306796    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306800    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306804    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306808    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306813    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306817    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306821    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306825    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306829    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306834    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306838    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306842    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306849    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306853    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:25.316297 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306857    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306861    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306866    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306870    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306875    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306881    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306888    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306892    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306897    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306901    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306905    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306910    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306914    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306918    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306922    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306927    2577 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306931    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306935    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306939    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:25.316768 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306943    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306949    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306956    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306962    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306966    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306971    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306975    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306980    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306984    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306988    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306993    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.306999    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307003    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307008    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307012    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307016    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307022    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307027    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307031    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:25.317236 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307035    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307039    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307044    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307048    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307053    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307057    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307061    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307065    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307069    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307073    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307077    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307082    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307087    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307091    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307095    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307099    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307104    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307108    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307138    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307145    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:25.317684 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307149    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:25.318158 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307154    2577 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:25.318158 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307159    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:25.318158 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307182    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:25.318158 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307189    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:25.318158 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307194    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:25.318158 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307199    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:25.318158 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307203    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:25.318158 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307207    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:25.318158 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.307257    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 02:15:25.318158 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307326    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:25.318158 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307334    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:25.318158 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307339    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:25.318158 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307344    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:25.318158 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307349    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:25.318158 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307353    2577 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:25.318158 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307359    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307363    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307367    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307371    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307375    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307380    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307384    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307388    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307394    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307398    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307402    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307407    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307411    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307416    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307420    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307424    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307428    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307433    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307437    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307443    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:25.318556 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307449    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307454    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307458    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307462    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307466    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307470    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307474    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307479    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307483    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307488    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307492    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307496    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307501    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307505    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307509    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307514    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307518    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307522    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307527    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:25.319026 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307531    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307535    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307539    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307543    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307547    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307551    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307555    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307560    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307564    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307568    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307572    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307576    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307588    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307596    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307602    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307607    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307612    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307616    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307620    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:25.319497 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307624    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307628    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307634    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307639    2577 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307644    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307648    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307652    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307657    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307663    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307669    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307673    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307678    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307682    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307686    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307691    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307695    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307700    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307704    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307708    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:25.319951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307712    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307716    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307721    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307725    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307729    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307734    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307739    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307746    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307750    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307754    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307758    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307764    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307768    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307773    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307777    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307781    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307787    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307791    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307795    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307801    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:25.320467 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307805    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307809    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.307814    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.315871    2577 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.315895    2577 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.315912    2577 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.315917    2577 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.315996    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316002    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316006    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316009    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316012    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316015    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316018    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316020    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316023    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316026    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316029    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316032    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:25.320945 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316034    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316038    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316045    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316052    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316057    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316060    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316063    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316066    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316069    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316074    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316077    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316080    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316082    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316085    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316088    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316090    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316093    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316096    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316099    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:25.321464 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316102    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316105    2577 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316107    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316110    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316113    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316115    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316119    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316124    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316129    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316133    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316137    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316139    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316142    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316145    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316147    2577 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316150    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316152    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316155    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316157    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316160    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:25.321907 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316183    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316187    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316190    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316193    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316196    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316200    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316204    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316208    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316213    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316217    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316222    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316225    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316228    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316231    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316233    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316236    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316239    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316241    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316245    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316247    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:25.322411 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316250    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316252    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316255    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316258    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316260    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316262    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316265    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316268    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316271    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316273    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316276    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316279    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316284    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316288    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316292    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316296    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316300    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316305    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316309    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:25.322928 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316312    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:25.323502 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316315    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:25.323502 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316317    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:25.323502 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316321    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:25.323502 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316323    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:25.323502 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316326    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:25.323502 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316329    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:25.323502 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316331    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:25.323502 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316334    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:25.323502 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316336    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:25.323502 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316339    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:25.323502 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316341    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:25.323502 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316344    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:25.323502 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316346    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:25.323502 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316348    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:25.323502 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316351    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:25.323502 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.316389    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316589    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316595    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316600    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316607    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316613    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316618    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316621    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316624    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316626    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316629    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316632    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316635    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316637    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316641    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316644    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316646    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316649    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316652    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:25.323882 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316655    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316658    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316661    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316676    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316683    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316689    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316694    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316698    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316701    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316703    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316707    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316710    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316712    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316714    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316717    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316720    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316723    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316725    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316728    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316730    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:25.324402 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316733    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316735    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316738    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316740    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316743    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316746    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316748    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316750    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316754    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316756    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316759    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316762    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316768    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316773    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316777    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316780    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316783    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316786    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316788    2577 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316791    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:25.324883 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316794    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316796    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316799    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316802    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316805    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316807    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316810    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316812    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316816    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316820    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316823    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316826    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316829    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316831    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316834    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316836    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316839    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316842    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316847    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:25.325454 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316852    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316856    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316860    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316863    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316865    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316869    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316872    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316875    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316877    2577 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316880    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316883    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316885    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316888    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316890    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316893    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316895    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316898    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316900    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316902    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316905    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:25.326009 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316907    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:25.326827 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316910    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:25.326827 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316912    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:25.326827 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316915    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:25.326827 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316917    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:25.326827 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316921    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:25.326827 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316924    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:25.326827 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316929    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:25.326827 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316933    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:25.326827 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.316960    2577 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 02:15:25.326827 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316994    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:15:25.326827 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.316998    2577 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:15:25.326827 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317003    2577 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:15:25.326827 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317008    2577 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:15:25.326827 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317013    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:15:25.326827 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317019    2577 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317022    2577 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317024    2577 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317028    2577 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317033    2577 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317036    2577 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317038    2577 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317041    2577 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317043    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317046    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317049    2577 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317051    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317054    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317056    2577 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317059    2577 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317062    2577 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317064    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317067    2577 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317069    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:15:25.327338 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317072    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317074    2577 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317077    2577 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317080    2577 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317084    2577 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317088    2577 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317094    2577 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317098    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317101    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317104    2577 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317106    2577 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317109    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317111    2577 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317113    2577 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317117    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317120    2577 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317122    2577 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317125    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317127    2577 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317129    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:15:25.327906 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317131    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317134    2577 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317136    2577 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317139    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317141    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317143    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317146    2577 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317149    2577 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317153    2577 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317155    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317158    2577 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317162    2577 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317181    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317186    2577 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317191    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317195    2577 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317198    2577 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317201    2577 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317204    2577 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:15:25.328420 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317207    2577 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317212    2577 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317215    2577 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317217    2577 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317220    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317223    2577 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317225    2577 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317228    2577 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317231    2577 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317234    2577 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317236    2577 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317239    2577 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317242    2577 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317244    2577 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317247    2577 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317250    2577 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317253    2577 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317256    2577 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317261    2577 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317265    2577 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:15:25.328895 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317270    2577 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317273    2577 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317276    2577 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317278    2577 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317281    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317283    2577 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317286    2577 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317289    2577 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317291    2577 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317294    2577 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317296    2577 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317299    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317301    2577 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317305    2577 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317308    2577 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317310    2577 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317313    2577 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317315    2577 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317318    2577 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317321    2577 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:15:25.329431 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317323    2577 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:15:25.329951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317328    2577 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:15:25.329951 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:25.317331    2577 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:15:25.329951 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.317400    2577 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 04 02:15:25.329951 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.321775    2577 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Nov 04 02:15:25.329951 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.322799    2577 server.go:1014] "Starting client certificate rotation"
Nov 04 02:15:25.329951 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.322911    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 02:15:25.329951 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.322979    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 02:15:25.329951 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.325001    2577 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 02:15:25.329951 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.326623    2577 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 02:15:25.339626 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.339600    2577 log.go:25] "Validated CRI v1 runtime API"
Nov 04 02:15:25.344700 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.344676    2577 log.go:25] "Validated CRI v1 image API"
Nov 04 02:15:25.345598 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.345574    2577 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 04 02:15:25.352100 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.352064    2577 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c764da64-b959-48da-933c-8d569e467107:/dev/nvme0n1p3 cdaf79f0-570b-4f42-a377-057edcde3337:/dev/nvme0n1p4]
Nov 04 02:15:25.352100 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.352096    2577 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Nov 04 02:15:25.358355 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.358218    2577 manager.go:217] Machine: {Timestamp:2026-11-04 02:15:25.356765712 +0000 UTC m=+0.331431965 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3059781 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25ce143c5843654258376515129b17 SystemUUID:ec25ce14-3c58-4365-4258-376515129b17 BootID:c00ddae0-cf3d-420c-833c-04f2560dd9da Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:06:ff:d0:84:b7:17 Speed:0 Mtu:9001} {Name:ens5 MacAddress:06:ff:d0:84:b7:17 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5e:70:ad:27:69:5f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 04 02:15:25.358355 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.358347    2577 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 04 02:15:25.358512 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.358498    2577 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 04 02:15:25.359919 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.359880    2577 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 04 02:15:25.360127 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.359921    2577 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-155.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 04 02:15:25.360193 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.360131    2577 topology_manager.go:143] "Creating topology manager with none policy"
Nov 04 02:15:25.360193 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.360140    2577 container_manager_linux.go:311] "Creating device plugin manager"
Nov 04 02:15:25.360193 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.360185    2577 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 02:15:25.360287 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.360201    2577 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 02:15:25.361447 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.361434    2577 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 04 02:15:25.366079 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.366061    2577 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 04 02:15:25.366235 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.366224    2577 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 04 02:15:25.367091 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.367080    2577 kubelet.go:493] "Attempting to sync node with API server"
Nov 04 02:15:25.367138 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.367123    2577 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 04 02:15:25.367196 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.367142    2577 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 04 02:15:25.367196 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.367152    2577 kubelet.go:405] "Adding apiserver pod source"
Nov 04 02:15:25.367196 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.367163    2577 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 04 02:15:25.367605 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.367584    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 02:15:25.370510 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.370491    2577 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 04 02:15:25.377107 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.377088    2577 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 02:15:25.378110 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.378096    2577 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 04 02:15:25.378149 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.378128    2577 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 04 02:15:25.378335 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.378324    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 04 02:15:25.378366 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.378342    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 04 02:15:25.378366 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.378349    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 04 02:15:25.378366 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.378355    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 04 02:15:25.378366 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.378364    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 04 02:15:25.378461 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.378373    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 04 02:15:25.379073 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.379063    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 04 02:15:25.379111 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.379074    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 04 02:15:25.379111 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.379089    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 04 02:15:25.379111 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.379095    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 04 02:15:25.379111 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.379108    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 04 02:15:25.379245 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.379118    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 04 02:15:25.379861 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.379850    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 04 02:15:25.379893 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.379864    2577 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 04 02:15:25.383949 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.383933    2577 server.go:1263] "Started kubelet"
Nov 04 02:15:25.384094 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.384036    2577 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 04 02:15:25.384269 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.384043    2577 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 04 02:15:25.384329 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.384293    2577 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 04 02:15:25.384817 ip-10-0-130-155 systemd[1]: Started Kubernetes Kubelet.
Nov 04 02:15:25.385775 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.385758    2577 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 04 02:15:25.389464 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.388667    2577 server.go:317] "Adding debug handlers to kubelet server"
Nov 04 02:15:25.390713 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:25.390692    2577 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Nov 04 02:15:25.395290 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.395269    2577 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 04 02:15:25.396588 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.396573    2577 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 04 02:15:25.396720 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:25.396700    2577 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-155.us-west-2.compute.internal\" not found"
Nov 04 02:15:25.397841 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.397315    2577 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 04 02:15:25.397841 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.397333    2577 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 04 02:15:25.397841 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.397350    2577 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 04 02:15:25.397841 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.397575    2577 reconstruct.go:97] "Volume reconstruction finished"
Nov 04 02:15:25.397841 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.397583    2577 reconciler.go:29] "Reconciler: start to sync state"
Nov 04 02:15:25.397841 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.397679    2577 factory.go:55] Registering systemd factory
Nov 04 02:15:25.397841 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.397719    2577 factory.go:223] Registration of the systemd container factory successfully
Nov 04 02:15:25.398293 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.398281    2577 factory.go:153] Registering CRI-O factory
Nov 04 02:15:25.398639 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.398294    2577 factory.go:223] Registration of the crio container factory successfully
Nov 04 02:15:25.398639 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.398337    2577 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 04 02:15:25.398639 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.398354    2577 factory.go:103] Registering Raw factory
Nov 04 02:15:25.398639 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.398365    2577 manager.go:1199] Started watching for new ooms in manager
Nov 04 02:15:25.399462 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.399445    2577 manager.go:319] Starting recovery of all containers
Nov 04 02:15:25.406605 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.406552    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 04 02:15:25.409949 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.409928    2577 manager.go:324] Recovery completed
Nov 04 02:15:25.415310 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.415288    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:25.417540 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.417515    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:25.417644 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.417555    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:25.417644 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.417567    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:25.418148 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.418133    2577 cpu_manager.go:226] "Starting" policy="none"
Nov 04 02:15:25.418148 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.418141    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:25.418148 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.418146    2577 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 04 02:15:25.418350 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.418275    2577 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 04 02:15:25.418848 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.418830    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:25.418920 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.418859    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:25.418920 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.418870    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:25.420474 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.420461    2577 policy_none.go:50] "Start"
Nov 04 02:15:25.420532 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.420482    2577 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 04 02:15:25.420532 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.420496    2577 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 04 02:15:25.422627 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.422612    2577 policy_none.go:44] "Start"
Nov 04 02:15:25.458992 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.458955    2577 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 04 02:15:25.463358 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.463343    2577 manager.go:341] "Starting Device Plugin manager"
Nov 04 02:15:25.463416 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:25.463383    2577 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 04 02:15:25.463416 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.463393    2577 server.go:87] "Starting device plugin registration server"
Nov 04 02:15:25.463669 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.463658    2577 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 04 02:15:25.463699 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.463670    2577 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 04 02:15:25.463796 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.463768    2577 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 04 02:15:25.463871 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.463860    2577 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 04 02:15:25.466257 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.464426    2577 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 04 02:15:25.466257 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:25.465760    2577 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 04 02:15:25.466257 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:25.465823    2577 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-155.us-west-2.compute.internal\" not found"
Nov 04 02:15:25.519633 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.517682    2577 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-155.us-west-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Nov 04 02:15:25.558128 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.558053    2577 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 04 02:15:25.558128 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.558090    2577 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 04 02:15:25.558128 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.558114    2577 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 04 02:15:25.558384 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:25.558150    2577 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Nov 04 02:15:25.563227 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:25.563185    2577 controller.go:201] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-155.us-west-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Nov 04 02:15:25.564087 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:25.563120    2577 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-155.us-west-2.compute.internal.18e4b5e00655e485  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-155.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-155.us-west-2.compute.internal,},FirstTimestamp:2026-11-04 02:15:25.383894149 +0000 UTC m=+0.358560394,LastTimestamp:2026-11-04 02:15:25.383894149 +0000 UTC m=+0.358560394,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-155.us-west-2.compute.internal,}"
Nov 04 02:15:25.564212 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.564198    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:25.565583 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.565568    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:25.565635 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.565604    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:25.565635 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.565618    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:25.565708 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.565645    2577 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:25.581727 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:25.581695    2577 reflector.go:204] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver"
Nov 04 02:15:25.597389 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.597358    2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 04 02:15:25.597565 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.597459    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-69rcn"
Nov 04 02:15:25.659102 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.659051    2577 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal"]
Nov 04 02:15:25.659294 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.659140    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:25.661305 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.661278    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:25.661431 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.661323    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:25.661431 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.661336    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:25.663502 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.663488    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:25.663649 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.663635    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:25.663695 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.663666    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:25.664407 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.664390    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:25.664498 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.664408    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:25.664498 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.664439    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:25.664498 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.664452    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:25.664498 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.664419    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:25.664498 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.664498    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:25.666455 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.666440    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:25.666500 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.666470    2577 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:15:25.667333 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.667311    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:15:25.667410 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.667349    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:15:25.667410 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.667363    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:15:25.671211 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.671194    2577 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:15:25.695186 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:25.695143    2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-155.us-west-2.compute.internal\" not found" node="ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:25.698063 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:25.698039    2577 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-155.us-west-2.compute.internal\" not found" node="ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:25.699329 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.699310    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88378d56a64bde54980a55721812b463-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal\" (UID: \"88378d56a64bde54980a55721812b463\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:25.699404 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.699336    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88378d56a64bde54980a55721812b463-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal\" (UID: \"88378d56a64bde54980a55721812b463\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:25.699404 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.699355    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e236c28d3c011f48f26e1ef488876d0-config\") pod \"kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal\" (UID: \"9e236c28d3c011f48f26e1ef488876d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:25.762644 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.762602    2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:15:25.763697 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.763675    2577 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:25.763845 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:25.763703    2577 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-155.us-west-2.compute.internal\": node \"ip-10-0-130-155.us-west-2.compute.internal\" not found"
Nov 04 02:15:25.763845 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.763809    2577 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:15:25.797348 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.797316    2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:25.799526 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.799498    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88378d56a64bde54980a55721812b463-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal\" (UID: \"88378d56a64bde54980a55721812b463\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:25.799614 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.799536    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88378d56a64bde54980a55721812b463-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal\" (UID: \"88378d56a64bde54980a55721812b463\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:25.799614 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.799553    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e236c28d3c011f48f26e1ef488876d0-config\") pod \"kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal\" (UID: \"9e236c28d3c011f48f26e1ef488876d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:25.799614 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.799611    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e236c28d3c011f48f26e1ef488876d0-config\") pod \"kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal\" (UID: \"9e236c28d3c011f48f26e1ef488876d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:25.799710 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.799613    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88378d56a64bde54980a55721812b463-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal\" (UID: \"88378d56a64bde54980a55721812b463\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:25.799710 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.799613    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88378d56a64bde54980a55721812b463-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal\" (UID: \"88378d56a64bde54980a55721812b463\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:25.859495 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.859399    2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 02:15:25.860242 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.860212    2577 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:25.917339 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.917305    2577 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 02:15:25.997940 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:25.997895    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:26.000893 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.000865    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:15:26.323792 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.323677    2577 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Nov 04 02:15:26.324375 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.323868    2577 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Nov 04 02:15:26.324375 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:26.323945    2577 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a002968538e68413697f26034184b0ae-7fcf7513c18704a7.elb.us-east-2.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-130-155.us-west-2.compute.internal.18e4b5e0085747ec\": read tcp 10.0.130.155:46948->77.112.180.169:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-130-155.us-west-2.compute.internal.18e4b5e0085747ec  default   5078 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-155.us-west-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-155.us-west-2.compute.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-155.us-west-2.compute.internal,},FirstTimestamp:2026-11-04 02:15:25 +0000 UTC,LastTimestamp:2026-11-04 02:15:25.661305163 +0000 UTC m=+0.635971420,Count:4,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-155.us-west-2.compute.internal,}"
Nov 04 02:15:26.367723 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.367683    2577 apiserver.go:52] "Watching apiserver"
Nov 04 02:15:26.395547 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.395508    2577 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Nov 04 02:15:26.601926 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.601817    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 02:10:26 +0000 UTC" deadline="2028-06-02 14:14:10.711133136 +0000 UTC"
Nov 04 02:15:26.601926 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.601859    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13835h58m44.109277539s"
Nov 04 02:15:26.614101 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.614071    2577 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 04 02:15:26.614412 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.614394    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-g4rp8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal","openshift-network-diagnostics/network-check-target-5pvtj","kube-system/global-pull-secret-syncer-bfrx9","kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal","openshift-network-operator/iptables-alerter-z558g","openshift-ovn-kubernetes/ovnkube-node-g86jv","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl","openshift-dns/node-resolver-tprts","openshift-image-registry/node-ca-465v4","openshift-multus/multus-hkzpl","openshift-cluster-node-tuning-operator/tuned-k46hl","openshift-multus/multus-additional-cni-plugins-p7425","openshift-multus/network-metrics-daemon-ff4lm"]
Nov 04 02:15:26.616805 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.616784    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g4rp8"
Nov 04 02:15:26.618821 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.618799    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:26.618905 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:26.618882    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pvtj" podUID="aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5"
Nov 04 02:15:26.620939 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.620916    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:26.621015 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:26.620984    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfrx9" podUID="c36eb6b7-750c-49f0-a11d-5a168f75eb29"
Nov 04 02:15:26.623042 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.623023    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z558g"
Nov 04 02:15:26.625284 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.625266    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.627416 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.627395    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.629559 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.629543    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tprts"
Nov 04 02:15:26.631667 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.631653    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-465v4"
Nov 04 02:15:26.633838 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.633821    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.637339 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.637322    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.639775 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.639759    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.642261 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.642242    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:26.642339 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:26.642303    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ff4lm" podUID="fe7e4369-7004-46e9-9821-cf3e8628e4df"
Nov 04 02:15:26.666836 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.666805    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 04 02:15:26.666994 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.666910    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-n8x9d\""
Nov 04 02:15:26.666994 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.666946    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 04 02:15:26.672314 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.672294    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 04 02:15:26.672521 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.672508    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 04 02:15:26.672852 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.672841    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:15:26.673302 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.673281    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h2f9b\""
Nov 04 02:15:26.673699 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.673687    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 04 02:15:26.673914 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.673899    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wpmk6\""
Nov 04 02:15:26.674045 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.674029    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 04 02:15:26.674215 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.674199    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 04 02:15:26.674262 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.674236    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 04 02:15:26.675085 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.675056    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 04 02:15:26.675360 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.675348    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 04 02:15:26.676336 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.676317    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 04 02:15:26.698444 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.698418    2577 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 04 02:15:26.704534 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.704502    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c36eb6b7-750c-49f0-a11d-5a168f75eb29-kubelet-config\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:26.704680 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.704545    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d0d738a-4b36-416e-bf3b-3411b084ee41-tmp\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.704680 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.704579    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-etc-openvswitch\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.704680 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.704610    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-cni-bin\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.704680 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.704639    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-cnibin\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.704680 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.704669    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a5c331c-c911-474a-b893-f39e9285a677-agent-certs\") pod \"konnectivity-agent-g4rp8\" (UID: \"7a5c331c-c911-474a-b893-f39e9285a677\") " pod="kube-system/konnectivity-agent-g4rp8"
Nov 04 02:15:26.704894 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.704696    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrx2h\" (UniqueName: \"kubernetes.io/projected/cf87debc-dfe4-4dce-85f0-0ecab689c59d-kube-api-access-nrx2h\") pod \"node-ca-465v4\" (UID: \"cf87debc-dfe4-4dce-85f0-0ecab689c59d\") " pod="openshift-image-registry/node-ca-465v4"
Nov 04 02:15:26.704894 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.704726    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-var-lib-kubelet\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.704894 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.704761    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-log-socket\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.704894 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.704788    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fl4lf\" (UniqueName: \"kubernetes.io/projected/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95-kube-api-access-fl4lf\") pod \"node-resolver-tprts\" (UID: \"4daf9bec-b4b4-44b5-8582-7f4c95f9ec95\") " pod="openshift-dns/node-resolver-tprts"
Nov 04 02:15:26.704894 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.704821    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9813e2dc-dbcb-4166-bd17-62eb60ced426-system-cni-dir\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.704894 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.704843    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-host\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.704894 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.704869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-slash\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.705209 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.704896    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-run-openvswitch\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.705209 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.704923    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-etc-selinux\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.705209 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.704951    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-run-k8s-cni-cncf-io\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.705209 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.704974    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9813e2dc-dbcb-4166-bd17-62eb60ced426-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.705209 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705005    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-sysctl-d\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.705209 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705032    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-run-netns\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.705209 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705062    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-cni-netd\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.705209 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705093    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9813e2dc-dbcb-4166-bd17-62eb60ced426-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.705209 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705116    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/50068ac4-0a6a-48ca-84dd-611fc3a87b65-env-overrides\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.705209 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705145    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95-hosts-file\") pod \"node-resolver-tprts\" (UID: \"4daf9bec-b4b4-44b5-8582-7f4c95f9ec95\") " pod="openshift-dns/node-resolver-tprts"
Nov 04 02:15:26.705209 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705194    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9813e2dc-dbcb-4166-bd17-62eb60ced426-cni-binary-copy\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.705706 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705226    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c36eb6b7-750c-49f0-a11d-5a168f75eb29-dbus\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:26.705706 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705257    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-tuned\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.705706 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705280    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmq8d\" (UniqueName: \"kubernetes.io/projected/2d0d738a-4b36-416e-bf3b-3411b084ee41-kube-api-access-mmq8d\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.705706 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705442    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-run-ovn-kubernetes\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.705706 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705478    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/50068ac4-0a6a-48ca-84dd-611fc3a87b65-ovnkube-config\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.705706 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705513    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa9c7d67-d4ef-4900-873e-046523ea039e-cni-binary-copy\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.705706 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705594    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf87debc-dfe4-4dce-85f0-0ecab689c59d-host\") pod \"node-ca-465v4\" (UID: \"cf87debc-dfe4-4dce-85f0-0ecab689c59d\") " pod="openshift-image-registry/node-ca-465v4"
Nov 04 02:15:26.705706 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705618    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9813e2dc-dbcb-4166-bd17-62eb60ced426-cnibin\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.705706 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705647    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:26.705706 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705677    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e86306b-74a7-4f2f-84fa-0e297b78c7aa-host-slash\") pod \"iptables-alerter-z558g\" (UID: \"1e86306b-74a7-4f2f-84fa-0e297b78c7aa\") " pod="openshift-network-operator/iptables-alerter-z558g"
Nov 04 02:15:26.706204 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705743    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-sysctl-conf\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.706204 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705773    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6qzt\" (UniqueName: \"kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt\") pod \"network-check-target-5pvtj\" (UID: \"aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5\") " pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:26.706204 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705802    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95-tmp-dir\") pod \"node-resolver-tprts\" (UID: \"4daf9bec-b4b4-44b5-8582-7f4c95f9ec95\") " pod="openshift-dns/node-resolver-tprts"
Nov 04 02:15:26.706204 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705825    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-system-cni-dir\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.706204 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705885    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e86306b-74a7-4f2f-84fa-0e297b78c7aa-iptables-alerter-script\") pod \"iptables-alerter-z558g\" (UID: \"1e86306b-74a7-4f2f-84fa-0e297b78c7aa\") " pod="openshift-network-operator/iptables-alerter-z558g"
Nov 04 02:15:26.706204 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705914    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf87debc-dfe4-4dce-85f0-0ecab689c59d-serviceca\") pod \"node-ca-465v4\" (UID: \"cf87debc-dfe4-4dce-85f0-0ecab689c59d\") " pod="openshift-image-registry/node-ca-465v4"
Nov 04 02:15:26.706204 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.705972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-kubernetes\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.706204 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.706001    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-systemd-units\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.706204 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.706024    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-socket-dir-parent\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.706559 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.706269    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-var-lib-kubelet\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.706559 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.706298    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-run-multus-certs\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.706559 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.706454    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8hsx\" (UniqueName: \"kubernetes.io/projected/9813e2dc-dbcb-4166-bd17-62eb60ced426-kube-api-access-j8hsx\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.706559 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.706555    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a5c331c-c911-474a-b893-f39e9285a677-konnectivity-ca\") pod \"konnectivity-agent-g4rp8\" (UID: \"7a5c331c-c911-474a-b893-f39e9285a677\") " pod="kube-system/konnectivity-agent-g4rp8"
Nov 04 02:15:26.706736 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.706597    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-sys\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.706736 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.706685    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-conf-dir\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.706736 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.706714    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs\") pod \"network-metrics-daemon-ff4lm\" (UID: \"fe7e4369-7004-46e9-9821-cf3e8628e4df\") " pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:26.707100 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707061    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lfmx\" (UniqueName: \"kubernetes.io/projected/fe7e4369-7004-46e9-9821-cf3e8628e4df-kube-api-access-8lfmx\") pod \"network-metrics-daemon-ff4lm\" (UID: \"fe7e4369-7004-46e9-9821-cf3e8628e4df\") " pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:26.707198 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707119    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-modprobe-d\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.707257 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707210    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-systemd\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.707257 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707241    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-lib-modules\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.707352 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707288    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7z88\" (UniqueName: \"kubernetes.io/projected/fa9c7d67-d4ef-4900-873e-046523ea039e-kube-api-access-m7z88\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.707352 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707339    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-run\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.707442 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707374    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rg2cw\" (UniqueName: \"kubernetes.io/projected/50068ac4-0a6a-48ca-84dd-611fc3a87b65-kube-api-access-rg2cw\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.707442 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707400    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-socket-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.707533 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707442    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-sys-fs\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.707533 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707501    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7rqb\" (UniqueName: \"kubernetes.io/projected/4bcbd86c-05d7-4132-8e50-c79c54ba683f-kube-api-access-k7rqb\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.707611 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707565    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-var-lib-cni-bin\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.707643 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707627    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-daemon-config\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.707715 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707694    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-etc-kubernetes\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.707800 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707784    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-sysconfig\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.707849 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707826    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-run-systemd\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.707881 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707854    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-node-log\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.707912 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707890    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.707944 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707919    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/50068ac4-0a6a-48ca-84dd-611fc3a87b65-ovn-node-metrics-cert\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.707977 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707944    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-registration-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.708008 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.707977    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-cni-dir\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.708040 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.708004    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9813e2dc-dbcb-4166-bd17-62eb60ced426-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.708070 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.708049    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6klz\" (UniqueName: \"kubernetes.io/projected/1e86306b-74a7-4f2f-84fa-0e297b78c7aa-kube-api-access-f6klz\") pod \"iptables-alerter-z558g\" (UID: \"1e86306b-74a7-4f2f-84fa-0e297b78c7aa\") " pod="openshift-network-operator/iptables-alerter-z558g"
Nov 04 02:15:26.708101 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.708074    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-kubelet\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.708133 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.708100    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/50068ac4-0a6a-48ca-84dd-611fc3a87b65-ovnkube-script-lib\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.708133 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.708123    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-device-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.708210 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.708142    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-var-lib-openvswitch\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.708210 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.708193    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.708273 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.708229    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-var-lib-cni-multus\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.708273 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.708249    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-run-ovn\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.708273 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.708264    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-run-netns\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.708360 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.708294    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-hostroot\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.709047 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.709019    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 04 02:15:26.709047 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.709038    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 04 02:15:26.709223 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.709041    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m589d\""
Nov 04 02:15:26.709223 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.709039    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 04 02:15:26.709329 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.709225    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 04 02:15:26.709329 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.709299    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 04 02:15:26.709329 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.709314    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6q9ld\""
Nov 04 02:15:26.709329 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.709322    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 04 02:15:26.717996 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.717967    2577 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:15:26.763044 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.763012    2577 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Nov 04 02:15:26.763229 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.763076    2577 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vc72j"
Nov 04 02:15:26.766509 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.766487    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 04 02:15:26.766625 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.766531    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 04 02:15:26.766625 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.766559    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 04 02:15:26.766625 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.766577    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 04 02:15:26.766625 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.766589    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:15:26.766834 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.766652    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 04 02:15:26.766834 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.766709    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 04 02:15:26.766834 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.766710    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-275xk\""
Nov 04 02:15:26.766834 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.766723    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 04 02:15:26.766834 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.766750    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 04 02:15:26.766834 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.766764    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zrn9f\""
Nov 04 02:15:26.766834 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.766779    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-px2wd\""
Nov 04 02:15:26.766834 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.766807    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zjj5c\""
Nov 04 02:15:26.808778 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.808745    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmq8d\" (UniqueName: \"kubernetes.io/projected/2d0d738a-4b36-416e-bf3b-3411b084ee41-kube-api-access-mmq8d\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.808966 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.808781    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-run-ovn-kubernetes\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.808966 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.808814    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/50068ac4-0a6a-48ca-84dd-611fc3a87b65-ovnkube-config\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.808966 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.808835    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa9c7d67-d4ef-4900-873e-046523ea039e-cni-binary-copy\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.808966 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.808882    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-run-ovn-kubernetes\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.808966 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.808856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf87debc-dfe4-4dce-85f0-0ecab689c59d-host\") pod \"node-ca-465v4\" (UID: \"cf87debc-dfe4-4dce-85f0-0ecab689c59d\") " pod="openshift-image-registry/node-ca-465v4"
Nov 04 02:15:26.808966 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.808932    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf87debc-dfe4-4dce-85f0-0ecab689c59d-host\") pod \"node-ca-465v4\" (UID: \"cf87debc-dfe4-4dce-85f0-0ecab689c59d\") " pod="openshift-image-registry/node-ca-465v4"
Nov 04 02:15:26.809255 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.808958    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9813e2dc-dbcb-4166-bd17-62eb60ced426-cnibin\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.809255 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809004    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:26.809255 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809029    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e86306b-74a7-4f2f-84fa-0e297b78c7aa-host-slash\") pod \"iptables-alerter-z558g\" (UID: \"1e86306b-74a7-4f2f-84fa-0e297b78c7aa\") " pod="openshift-network-operator/iptables-alerter-z558g"
Nov 04 02:15:26.809255 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-sysctl-conf\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.809255 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809055    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9813e2dc-dbcb-4166-bd17-62eb60ced426-cnibin\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.809255 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809076    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6qzt\" (UniqueName: \"kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt\") pod \"network-check-target-5pvtj\" (UID: \"aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5\") " pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:26.809255 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809102    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95-tmp-dir\") pod \"node-resolver-tprts\" (UID: \"4daf9bec-b4b4-44b5-8582-7f4c95f9ec95\") " pod="openshift-dns/node-resolver-tprts"
Nov 04 02:15:26.809255 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809136    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e86306b-74a7-4f2f-84fa-0e297b78c7aa-host-slash\") pod \"iptables-alerter-z558g\" (UID: \"1e86306b-74a7-4f2f-84fa-0e297b78c7aa\") " pod="openshift-network-operator/iptables-alerter-z558g"
Nov 04 02:15:26.809255 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:26.809103    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:26.809255 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809127    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-system-cni-dir\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.809255 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809218    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e86306b-74a7-4f2f-84fa-0e297b78c7aa-iptables-alerter-script\") pod \"iptables-alerter-z558g\" (UID: \"1e86306b-74a7-4f2f-84fa-0e297b78c7aa\") " pod="openshift-network-operator/iptables-alerter-z558g"
Nov 04 02:15:26.809255 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809236    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-sysctl-conf\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.809255 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809247    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf87debc-dfe4-4dce-85f0-0ecab689c59d-serviceca\") pod \"node-ca-465v4\" (UID: \"cf87debc-dfe4-4dce-85f0-0ecab689c59d\") " pod="openshift-image-registry/node-ca-465v4"
Nov 04 02:15:26.809255 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809246    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-system-cni-dir\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.809884 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:26.809356    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret podName:c36eb6b7-750c-49f0-a11d-5a168f75eb29 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:27.309318237 +0000 UTC m=+2.283984506 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret") pod "global-pull-secret-syncer-bfrx9" (UID: "c36eb6b7-750c-49f0-a11d-5a168f75eb29") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:26.809884 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809399    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-kubernetes\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.809884 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809430    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-systemd-units\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.809884 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809456    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-socket-dir-parent\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.809884 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809478    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-var-lib-kubelet\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.809884 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809478    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-kubernetes\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.809884 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809482    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95-tmp-dir\") pod \"node-resolver-tprts\" (UID: \"4daf9bec-b4b4-44b5-8582-7f4c95f9ec95\") " pod="openshift-dns/node-resolver-tprts"
Nov 04 02:15:26.809884 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809509    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-run-multus-certs\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.809884 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809532    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-var-lib-kubelet\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.809884 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809535    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8hsx\" (UniqueName: \"kubernetes.io/projected/9813e2dc-dbcb-4166-bd17-62eb60ced426-kube-api-access-j8hsx\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.809884 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809598    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa9c7d67-d4ef-4900-873e-046523ea039e-cni-binary-copy\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.809884 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809599    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/50068ac4-0a6a-48ca-84dd-611fc3a87b65-ovnkube-config\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.809884 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809645    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-socket-dir-parent\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.809884 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809689    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a5c331c-c911-474a-b893-f39e9285a677-konnectivity-ca\") pod \"konnectivity-agent-g4rp8\" (UID: \"7a5c331c-c911-474a-b893-f39e9285a677\") " pod="kube-system/konnectivity-agent-g4rp8"
Nov 04 02:15:26.809884 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809708    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-run-multus-certs\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.809884 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809717    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-sys\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.809884 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809746    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-systemd-units\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.810595 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809810    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-conf-dir\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.810595 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809834    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-sys\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.810595 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809875    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs\") pod \"network-metrics-daemon-ff4lm\" (UID: \"fe7e4369-7004-46e9-9821-cf3e8628e4df\") " pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:26.810595 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809903    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lfmx\" (UniqueName: \"kubernetes.io/projected/fe7e4369-7004-46e9-9821-cf3e8628e4df-kube-api-access-8lfmx\") pod \"network-metrics-daemon-ff4lm\" (UID: \"fe7e4369-7004-46e9-9821-cf3e8628e4df\") " pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:26.810595 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809930    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf87debc-dfe4-4dce-85f0-0ecab689c59d-serviceca\") pod \"node-ca-465v4\" (UID: \"cf87debc-dfe4-4dce-85f0-0ecab689c59d\") " pod="openshift-image-registry/node-ca-465v4"
Nov 04 02:15:26.810595 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809958    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e86306b-74a7-4f2f-84fa-0e297b78c7aa-iptables-alerter-script\") pod \"iptables-alerter-z558g\" (UID: \"1e86306b-74a7-4f2f-84fa-0e297b78c7aa\") " pod="openshift-network-operator/iptables-alerter-z558g"
Nov 04 02:15:26.810595 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809970    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-modprobe-d\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.810595 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:26.809980    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:26.810595 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.809987    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-conf-dir\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.810595 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810032    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-systemd\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.810595 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810061    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-lib-modules\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.810595 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810075    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-systemd\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.810595 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810088    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7z88\" (UniqueName: \"kubernetes.io/projected/fa9c7d67-d4ef-4900-873e-046523ea039e-kube-api-access-m7z88\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.810595 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810111    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-run\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.810595 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:26.810154    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs podName:fe7e4369-7004-46e9-9821-cf3e8628e4df nodeName:}" failed. No retries permitted until 2026-11-04 02:15:27.310138452 +0000 UTC m=+2.284804699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs") pod "network-metrics-daemon-ff4lm" (UID: "fe7e4369-7004-46e9-9821-cf3e8628e4df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:26.810595 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810153    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-modprobe-d\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.810595 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810189    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg2cw\" (UniqueName: \"kubernetes.io/projected/50068ac4-0a6a-48ca-84dd-611fc3a87b65-kube-api-access-rg2cw\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.811241 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810210    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-lib-modules\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.811241 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810215    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-socket-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.811241 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810238    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-run\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.811241 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810321    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a5c331c-c911-474a-b893-f39e9285a677-konnectivity-ca\") pod \"konnectivity-agent-g4rp8\" (UID: \"7a5c331c-c911-474a-b893-f39e9285a677\") " pod="kube-system/konnectivity-agent-g4rp8"
Nov 04 02:15:26.811241 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810337    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-sys-fs\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.811241 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810355    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-socket-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.811241 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810363    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7rqb\" (UniqueName: \"kubernetes.io/projected/4bcbd86c-05d7-4132-8e50-c79c54ba683f-kube-api-access-k7rqb\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.811241 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810389    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-sys-fs\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.811241 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810395    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-var-lib-cni-bin\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.811241 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810429    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-var-lib-cni-bin\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.811241 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810436    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-daemon-config\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.811241 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810476    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-etc-kubernetes\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.811241 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810500    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-sysconfig\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.811241 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810522    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-etc-kubernetes\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.811241 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810525    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-run-systemd\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.811241 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810559    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-sysconfig\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.811241 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810561    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-node-log\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.811241 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810586    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-run-systemd\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.812013 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810600    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.812013 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810627    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-node-log\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.812013 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810651    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.812013 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810627    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/50068ac4-0a6a-48ca-84dd-611fc3a87b65-ovn-node-metrics-cert\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.812013 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810682    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-registration-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.812013 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810701    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-cni-dir\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.812013 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810729    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9813e2dc-dbcb-4166-bd17-62eb60ced426-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.812013 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810735    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-registration-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.812013 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810760    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6klz\" (UniqueName: \"kubernetes.io/projected/1e86306b-74a7-4f2f-84fa-0e297b78c7aa-kube-api-access-f6klz\") pod \"iptables-alerter-z558g\" (UID: \"1e86306b-74a7-4f2f-84fa-0e297b78c7aa\") " pod="openshift-network-operator/iptables-alerter-z558g"
Nov 04 02:15:26.812013 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810784    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-kubelet\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.812013 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810793    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-cni-dir\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.812013 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810793    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-daemon-config\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.812013 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810808    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/50068ac4-0a6a-48ca-84dd-611fc3a87b65-ovnkube-script-lib\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.812013 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810837    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-device-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.812013 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810851    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-kubelet\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.812013 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810860    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-var-lib-openvswitch\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.812013 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810895    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-var-lib-openvswitch\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.812628 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810899    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.812628 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810928    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-var-lib-cni-multus\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.812628 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810928    2577 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 04 02:15:26.812628 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810938    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-device-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.812628 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810952    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-run-ovn\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.812628 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810969    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-var-lib-cni-multus\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.812628 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810940    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.812628 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810985    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-run-ovn\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.812628 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.810985    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-run-netns\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.812628 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811019    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-hostroot\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.812628 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811037    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c36eb6b7-750c-49f0-a11d-5a168f75eb29-kubelet-config\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:26.812628 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811018    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-run-netns\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.812628 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811060    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d0d738a-4b36-416e-bf3b-3411b084ee41-tmp\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.812628 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811070    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-hostroot\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.812628 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-etc-openvswitch\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.812628 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811103    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c36eb6b7-750c-49f0-a11d-5a168f75eb29-kubelet-config\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:26.812628 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811138    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-cni-bin\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.812628 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811151    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-etc-openvswitch\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.813226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811163    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-cnibin\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.813226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811205    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a5c331c-c911-474a-b893-f39e9285a677-agent-certs\") pod \"konnectivity-agent-g4rp8\" (UID: \"7a5c331c-c911-474a-b893-f39e9285a677\") " pod="kube-system/konnectivity-agent-g4rp8"
Nov 04 02:15:26.813226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811210    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-cni-bin\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.813226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811230    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrx2h\" (UniqueName: \"kubernetes.io/projected/cf87debc-dfe4-4dce-85f0-0ecab689c59d-kube-api-access-nrx2h\") pod \"node-ca-465v4\" (UID: \"cf87debc-dfe4-4dce-85f0-0ecab689c59d\") " pod="openshift-image-registry/node-ca-465v4"
Nov 04 02:15:26.813226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811259    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-var-lib-kubelet\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.813226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811262    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-cnibin\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.813226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811283    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-log-socket\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.813226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811311    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl4lf\" (UniqueName: \"kubernetes.io/projected/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95-kube-api-access-fl4lf\") pod \"node-resolver-tprts\" (UID: \"4daf9bec-b4b4-44b5-8582-7f4c95f9ec95\") " pod="openshift-dns/node-resolver-tprts"
Nov 04 02:15:26.813226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811336    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9813e2dc-dbcb-4166-bd17-62eb60ced426-system-cni-dir\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.813226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811351    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/50068ac4-0a6a-48ca-84dd-611fc3a87b65-ovnkube-script-lib\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.813226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811358    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-host\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.813226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811348    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9813e2dc-dbcb-4166-bd17-62eb60ced426-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.813226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811382    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-slash\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.813226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811431    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9813e2dc-dbcb-4166-bd17-62eb60ced426-system-cni-dir\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.813226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811444    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-var-lib-kubelet\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.813226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811474    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-log-socket\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.813226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811471    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-host\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.813226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811441    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-run-openvswitch\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.813838 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811516    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-etc-selinux\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.813838 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811558    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-run-openvswitch\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.813838 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811575    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-run-k8s-cni-cncf-io\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.813838 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811580    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-slash\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.813838 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811597    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9813e2dc-dbcb-4166-bd17-62eb60ced426-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.813838 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811653    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-sysctl-d\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.813838 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811681    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-run-netns\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.813838 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811685    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-etc-selinux\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.813838 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811716    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-cni-netd\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.813838 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811719    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-run-netns\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.813838 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811683    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-run-k8s-cni-cncf-io\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.813838 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811765    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9813e2dc-dbcb-4166-bd17-62eb60ced426-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.813838 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811791    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/50068ac4-0a6a-48ca-84dd-611fc3a87b65-env-overrides\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.813838 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811768    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-cni-netd\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.813838 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811815    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95-hosts-file\") pod \"node-resolver-tprts\" (UID: \"4daf9bec-b4b4-44b5-8582-7f4c95f9ec95\") " pod="openshift-dns/node-resolver-tprts"
Nov 04 02:15:26.813838 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811818    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9813e2dc-dbcb-4166-bd17-62eb60ced426-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.813838 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811792    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-sysctl-d\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.814320 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811880    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95-hosts-file\") pod \"node-resolver-tprts\" (UID: \"4daf9bec-b4b4-44b5-8582-7f4c95f9ec95\") " pod="openshift-dns/node-resolver-tprts"
Nov 04 02:15:26.814320 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811912    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9813e2dc-dbcb-4166-bd17-62eb60ced426-cni-binary-copy\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.814320 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811937    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c36eb6b7-750c-49f0-a11d-5a168f75eb29-dbus\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:26.814320 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.811958    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-tuned\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.814320 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.812191    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c36eb6b7-750c-49f0-a11d-5a168f75eb29-dbus\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:26.814320 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.812733    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9813e2dc-dbcb-4166-bd17-62eb60ced426-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.814320 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.813658    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/50068ac4-0a6a-48ca-84dd-611fc3a87b65-env-overrides\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.814320 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.813798    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9813e2dc-dbcb-4166-bd17-62eb60ced426-cni-binary-copy\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.814624 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.814600    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-tuned\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.814723 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.814710    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/50068ac4-0a6a-48ca-84dd-611fc3a87b65-ovn-node-metrics-cert\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.814913 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.814891    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a5c331c-c911-474a-b893-f39e9285a677-agent-certs\") pod \"konnectivity-agent-g4rp8\" (UID: \"7a5c331c-c911-474a-b893-f39e9285a677\") " pod="kube-system/konnectivity-agent-g4rp8"
Nov 04 02:15:26.815347 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.815324    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d0d738a-4b36-416e-bf3b-3411b084ee41-tmp\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.864382 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:26.864285    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:15:26.864382 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:26.864316    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:15:26.864382 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:26.864332    2577 projected.go:196] Error preparing data for projected volume kube-api-access-s6qzt for pod openshift-network-diagnostics/network-check-target-5pvtj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:26.864656 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:26.864403    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt podName:aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:27.364381906 +0000 UTC m=+2.339048157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-s6qzt" (UniqueName: "kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt") pod "network-check-target-5pvtj" (UID: "aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:26.867558 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.867531    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8hsx\" (UniqueName: \"kubernetes.io/projected/9813e2dc-dbcb-4166-bd17-62eb60ced426-kube-api-access-j8hsx\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:26.867699 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.867607    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lfmx\" (UniqueName: \"kubernetes.io/projected/fe7e4369-7004-46e9-9821-cf3e8628e4df-kube-api-access-8lfmx\") pod \"network-metrics-daemon-ff4lm\" (UID: \"fe7e4369-7004-46e9-9821-cf3e8628e4df\") " pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:26.867774 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.867745    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7z88\" (UniqueName: \"kubernetes.io/projected/fa9c7d67-d4ef-4900-873e-046523ea039e-kube-api-access-m7z88\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:26.868100 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.868079    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6klz\" (UniqueName: \"kubernetes.io/projected/1e86306b-74a7-4f2f-84fa-0e297b78c7aa-kube-api-access-f6klz\") pod \"iptables-alerter-z558g\" (UID: \"1e86306b-74a7-4f2f-84fa-0e297b78c7aa\") " pod="openshift-network-operator/iptables-alerter-z558g"
Nov 04 02:15:26.868266 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.868247    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7rqb\" (UniqueName: \"kubernetes.io/projected/4bcbd86c-05d7-4132-8e50-c79c54ba683f-kube-api-access-k7rqb\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:26.868538 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.868517    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrx2h\" (UniqueName: \"kubernetes.io/projected/cf87debc-dfe4-4dce-85f0-0ecab689c59d-kube-api-access-nrx2h\") pod \"node-ca-465v4\" (UID: \"cf87debc-dfe4-4dce-85f0-0ecab689c59d\") " pod="openshift-image-registry/node-ca-465v4"
Nov 04 02:15:26.868854 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.868838    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl4lf\" (UniqueName: \"kubernetes.io/projected/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95-kube-api-access-fl4lf\") pod \"node-resolver-tprts\" (UID: \"4daf9bec-b4b4-44b5-8582-7f4c95f9ec95\") " pod="openshift-dns/node-resolver-tprts"
Nov 04 02:15:26.868893 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.868865    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmq8d\" (UniqueName: \"kubernetes.io/projected/2d0d738a-4b36-416e-bf3b-3411b084ee41-kube-api-access-mmq8d\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:26.870286 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.870263    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg2cw\" (UniqueName: \"kubernetes.io/projected/50068ac4-0a6a-48ca-84dd-611fc3a87b65-kube-api-access-rg2cw\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.942338 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.942300    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-g4rp8"
Nov 04 02:15:26.963532 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.963494    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-z558g"
Nov 04 02:15:26.990406 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.990353    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:26.997684 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:26.997660    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:15:27.008721 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:27.008691    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-tprts"
Nov 04 02:15:27.015140 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:27.015115    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-465v4"
Nov 04 02:15:27.029347 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:27.029302    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hkzpl"
Nov 04 02:15:27.049434 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:27.049401    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:15:27.066080 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:27.066036    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:15:27.243430 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:27.243392    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88378d56a64bde54980a55721812b463.slice/crio-11aa6181157b0231250680c37f0cf1a4c6c01e071842a682e7033051a287700f WatchSource:0}: Error finding container 11aa6181157b0231250680c37f0cf1a4c6c01e071842a682e7033051a287700f: Status 404 returned error can't find the container with id 11aa6181157b0231250680c37f0cf1a4c6c01e071842a682e7033051a287700f
Nov 04 02:15:27.254010 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:27.253986    2577 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 02:15:27.255282 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:27.255141    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e236c28d3c011f48f26e1ef488876d0.slice/crio-ffa5f598651b47d776ee78e53f09d7bb129dd19dd347b9b0e4e5ccb6a789c326 WatchSource:0}: Error finding container ffa5f598651b47d776ee78e53f09d7bb129dd19dd347b9b0e4e5ccb6a789c326: Status 404 returned error can't find the container with id ffa5f598651b47d776ee78e53f09d7bb129dd19dd347b9b0e4e5ccb6a789c326
Nov 04 02:15:27.315843 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:27.315798    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:27.315843 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:27.315856    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs\") pod \"network-metrics-daemon-ff4lm\" (UID: \"fe7e4369-7004-46e9-9821-cf3e8628e4df\") " pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:27.316077 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:27.315968    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:27.316077 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:27.315970    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:27.316077 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:27.316028    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs podName:fe7e4369-7004-46e9-9821-cf3e8628e4df nodeName:}" failed. No retries permitted until 2026-11-04 02:15:28.316012727 +0000 UTC m=+3.290678961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs") pod "network-metrics-daemon-ff4lm" (UID: "fe7e4369-7004-46e9-9821-cf3e8628e4df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:27.316077 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:27.316043    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret podName:c36eb6b7-750c-49f0-a11d-5a168f75eb29 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:28.31603589 +0000 UTC m=+3.290702126 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret") pod "global-pull-secret-syncer-bfrx9" (UID: "c36eb6b7-750c-49f0-a11d-5a168f75eb29") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:27.374616 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:27.374579    2577 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:15:27.416235 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:27.416158    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6qzt\" (UniqueName: \"kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt\") pod \"network-check-target-5pvtj\" (UID: \"aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5\") " pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:27.416430 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:27.416356    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:15:27.416430 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:27.416381    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:15:27.416430 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:27.416393    2577 projected.go:196] Error preparing data for projected volume kube-api-access-s6qzt for pod openshift-network-diagnostics/network-check-target-5pvtj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:27.416530 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:27.416450    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt podName:aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:28.416435867 +0000 UTC m=+3.391102103 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-s6qzt" (UniqueName: "kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt") pod "network-check-target-5pvtj" (UID: "aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:27.562739 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:27.562620    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal" event={"ID":"9e236c28d3c011f48f26e1ef488876d0","Type":"ContainerStarted","Data":"ffa5f598651b47d776ee78e53f09d7bb129dd19dd347b9b0e4e5ccb6a789c326"}
Nov 04 02:15:27.563714 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:27.563687    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal" event={"ID":"88378d56a64bde54980a55721812b463","Type":"ContainerStarted","Data":"11aa6181157b0231250680c37f0cf1a4c6c01e071842a682e7033051a287700f"}
Nov 04 02:15:27.766529 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:27.766443    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 02:10:27 +0000 UTC" deadline="2028-08-01 08:57:20.565216196 +0000 UTC"
Nov 04 02:15:27.766529 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:27.766493    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15270h41m52.798725931s"
Nov 04 02:15:27.974240 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:27.974202    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a5c331c_c911_474a_b893_f39e9285a677.slice/crio-d4cc6683d698401b6c71c09b24ccec01c6756c6fc4fd92c851756075728d9d1d WatchSource:0}: Error finding container d4cc6683d698401b6c71c09b24ccec01c6756c6fc4fd92c851756075728d9d1d: Status 404 returned error can't find the container with id d4cc6683d698401b6c71c09b24ccec01c6756c6fc4fd92c851756075728d9d1d
Nov 04 02:15:27.983686 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:27.983658    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e86306b_74a7_4f2f_84fa_0e297b78c7aa.slice/crio-9827fde1cf67bd10d3cff68fac876a2d37a4617674f2322be57e670b23b2e517 WatchSource:0}: Error finding container 9827fde1cf67bd10d3cff68fac876a2d37a4617674f2322be57e670b23b2e517: Status 404 returned error can't find the container with id 9827fde1cf67bd10d3cff68fac876a2d37a4617674f2322be57e670b23b2e517
Nov 04 02:15:27.984455 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:27.984385    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4daf9bec_b4b4_44b5_8582_7f4c95f9ec95.slice/crio-e04aa035b00b4597b08d301b9677eb7cb22fb1edc0608b668c7a2da15b900ddd WatchSource:0}: Error finding container e04aa035b00b4597b08d301b9677eb7cb22fb1edc0608b668c7a2da15b900ddd: Status 404 returned error can't find the container with id e04aa035b00b4597b08d301b9677eb7cb22fb1edc0608b668c7a2da15b900ddd
Nov 04 02:15:28.002778 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:28.002743    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50068ac4_0a6a_48ca_84dd_611fc3a87b65.slice/crio-d3af22634479af94b404ec25f707662f48024cbfb2fbe378a7b5fb637a6c6169 WatchSource:0}: Error finding container d3af22634479af94b404ec25f707662f48024cbfb2fbe378a7b5fb637a6c6169: Status 404 returned error can't find the container with id d3af22634479af94b404ec25f707662f48024cbfb2fbe378a7b5fb637a6c6169
Nov 04 02:15:28.061938 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:28.061905    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf87debc_dfe4_4dce_85f0_0ecab689c59d.slice/crio-aabdd754b83e0e6b30e10f6ca64430f5bed1bbed13530c0a5d6aa2e88cd915cf WatchSource:0}: Error finding container aabdd754b83e0e6b30e10f6ca64430f5bed1bbed13530c0a5d6aa2e88cd915cf: Status 404 returned error can't find the container with id aabdd754b83e0e6b30e10f6ca64430f5bed1bbed13530c0a5d6aa2e88cd915cf
Nov 04 02:15:28.067041 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:28.067014    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d0d738a_4b36_416e_bf3b_3411b084ee41.slice/crio-636aefcaac8be5d985c637157bea963a11e7b2ac74f69793246fd369811dd3ee WatchSource:0}: Error finding container 636aefcaac8be5d985c637157bea963a11e7b2ac74f69793246fd369811dd3ee: Status 404 returned error can't find the container with id 636aefcaac8be5d985c637157bea963a11e7b2ac74f69793246fd369811dd3ee
Nov 04 02:15:28.070313 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:28.070275    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bcbd86c_05d7_4132_8e50_c79c54ba683f.slice/crio-0ee725add4802cd03fac36d508302a41012caa57a9abb3349c9950fc636c7153 WatchSource:0}: Error finding container 0ee725add4802cd03fac36d508302a41012caa57a9abb3349c9950fc636c7153: Status 404 returned error can't find the container with id 0ee725add4802cd03fac36d508302a41012caa57a9abb3349c9950fc636c7153
Nov 04 02:15:28.078153 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:28.078117    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9813e2dc_dbcb_4166_bd17_62eb60ced426.slice/crio-ff699ad09e7c5838ed8aa74b94e8d6dbebc360acd6aeb5fd71a84f93e88944e9 WatchSource:0}: Error finding container ff699ad09e7c5838ed8aa74b94e8d6dbebc360acd6aeb5fd71a84f93e88944e9: Status 404 returned error can't find the container with id ff699ad09e7c5838ed8aa74b94e8d6dbebc360acd6aeb5fd71a84f93e88944e9
Nov 04 02:15:28.105963 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:28.105933    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa9c7d67_d4ef_4900_873e_046523ea039e.slice/crio-705b26ce00961ec61a7f17adbf7b003d3a0f3d163c372fc595f081a6824c6d49 WatchSource:0}: Error finding container 705b26ce00961ec61a7f17adbf7b003d3a0f3d163c372fc595f081a6824c6d49: Status 404 returned error can't find the container with id 705b26ce00961ec61a7f17adbf7b003d3a0f3d163c372fc595f081a6824c6d49
Nov 04 02:15:28.324336 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:28.324221    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:28.324336 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:28.324286    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs\") pod \"network-metrics-daemon-ff4lm\" (UID: \"fe7e4369-7004-46e9-9821-cf3e8628e4df\") " pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:28.324593 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:28.324381    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:28.324593 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:28.324455    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:28.324593 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:28.324469    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret podName:c36eb6b7-750c-49f0-a11d-5a168f75eb29 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:30.324452699 +0000 UTC m=+5.299118936 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret") pod "global-pull-secret-syncer-bfrx9" (UID: "c36eb6b7-750c-49f0-a11d-5a168f75eb29") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:28.324593 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:28.324509    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs podName:fe7e4369-7004-46e9-9821-cf3e8628e4df nodeName:}" failed. No retries permitted until 2026-11-04 02:15:30.324493001 +0000 UTC m=+5.299159251 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs") pod "network-metrics-daemon-ff4lm" (UID: "fe7e4369-7004-46e9-9821-cf3e8628e4df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:28.425198 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:28.425142    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6qzt\" (UniqueName: \"kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt\") pod \"network-check-target-5pvtj\" (UID: \"aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5\") " pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:28.425775 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:28.425334    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:15:28.425775 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:28.425357    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:15:28.425775 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:28.425369    2577 projected.go:196] Error preparing data for projected volume kube-api-access-s6qzt for pod openshift-network-diagnostics/network-check-target-5pvtj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:28.425775 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:28.425429    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt podName:aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:30.425414083 +0000 UTC m=+5.400080341 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-s6qzt" (UniqueName: "kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt") pod "network-check-target-5pvtj" (UID: "aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:28.558992 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:28.558955    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:28.558992 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:28.558986    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:28.559300 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:28.558970    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:28.559300 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:28.559097    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfrx9" podUID="c36eb6b7-750c-49f0-a11d-5a168f75eb29"
Nov 04 02:15:28.559300 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:28.559166    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pvtj" podUID="aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5"
Nov 04 02:15:28.559300 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:28.559290    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ff4lm" podUID="fe7e4369-7004-46e9-9821-cf3e8628e4df"
Nov 04 02:15:28.566692 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:28.566652    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl" event={"ID":"4bcbd86c-05d7-4132-8e50-c79c54ba683f","Type":"ContainerStarted","Data":"0ee725add4802cd03fac36d508302a41012caa57a9abb3349c9950fc636c7153"}
Nov 04 02:15:28.567958 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:28.567929    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k46hl" event={"ID":"2d0d738a-4b36-416e-bf3b-3411b084ee41","Type":"ContainerStarted","Data":"636aefcaac8be5d985c637157bea963a11e7b2ac74f69793246fd369811dd3ee"}
Nov 04 02:15:28.569330 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:28.569297    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-465v4" event={"ID":"cf87debc-dfe4-4dce-85f0-0ecab689c59d","Type":"ContainerStarted","Data":"aabdd754b83e0e6b30e10f6ca64430f5bed1bbed13530c0a5d6aa2e88cd915cf"}
Nov 04 02:15:28.570743 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:28.570708    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv" event={"ID":"50068ac4-0a6a-48ca-84dd-611fc3a87b65","Type":"ContainerStarted","Data":"d3af22634479af94b404ec25f707662f48024cbfb2fbe378a7b5fb637a6c6169"}
Nov 04 02:15:28.572065 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:28.572029    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z558g" event={"ID":"1e86306b-74a7-4f2f-84fa-0e297b78c7aa","Type":"ContainerStarted","Data":"9827fde1cf67bd10d3cff68fac876a2d37a4617674f2322be57e670b23b2e517"}
Nov 04 02:15:28.573451 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:28.573422    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tprts" event={"ID":"4daf9bec-b4b4-44b5-8582-7f4c95f9ec95","Type":"ContainerStarted","Data":"e04aa035b00b4597b08d301b9677eb7cb22fb1edc0608b668c7a2da15b900ddd"}
Nov 04 02:15:28.574708 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:28.574633    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g4rp8" event={"ID":"7a5c331c-c911-474a-b893-f39e9285a677","Type":"ContainerStarted","Data":"d4cc6683d698401b6c71c09b24ccec01c6756c6fc4fd92c851756075728d9d1d"}
Nov 04 02:15:28.576031 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:28.576003    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hkzpl" event={"ID":"fa9c7d67-d4ef-4900-873e-046523ea039e","Type":"ContainerStarted","Data":"705b26ce00961ec61a7f17adbf7b003d3a0f3d163c372fc595f081a6824c6d49"}
Nov 04 02:15:28.577567 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:28.577546    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7425" event={"ID":"9813e2dc-dbcb-4166-bd17-62eb60ced426","Type":"ContainerStarted","Data":"ff699ad09e7c5838ed8aa74b94e8d6dbebc360acd6aeb5fd71a84f93e88944e9"}
Nov 04 02:15:28.767655 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:28.767586    2577 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 02:10:27 +0000 UTC" deadline="2028-08-05 17:31:05.156824974 +0000 UTC"
Nov 04 02:15:28.767655 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:28.767644    2577 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15375h15m36.389184326s"
Nov 04 02:15:30.342622 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:30.342579    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:30.343236 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:30.342657    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs\") pod \"network-metrics-daemon-ff4lm\" (UID: \"fe7e4369-7004-46e9-9821-cf3e8628e4df\") " pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:30.343236 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:30.342833    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:30.343236 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:30.342904    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs podName:fe7e4369-7004-46e9-9821-cf3e8628e4df nodeName:}" failed. No retries permitted until 2026-11-04 02:15:34.342882531 +0000 UTC m=+9.317548795 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs") pod "network-metrics-daemon-ff4lm" (UID: "fe7e4369-7004-46e9-9821-cf3e8628e4df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:30.343236 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:30.342976    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:30.343236 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:30.343016    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret podName:c36eb6b7-750c-49f0-a11d-5a168f75eb29 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:34.343003901 +0000 UTC m=+9.317670142 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret") pod "global-pull-secret-syncer-bfrx9" (UID: "c36eb6b7-750c-49f0-a11d-5a168f75eb29") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:30.443993 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:30.443279    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6qzt\" (UniqueName: \"kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt\") pod \"network-check-target-5pvtj\" (UID: \"aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5\") " pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:30.443993 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:30.443508    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:15:30.443993 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:30.443529    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:15:30.443993 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:30.443544    2577 projected.go:196] Error preparing data for projected volume kube-api-access-s6qzt for pod openshift-network-diagnostics/network-check-target-5pvtj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:30.443993 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:30.443607    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt podName:aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:34.443587243 +0000 UTC m=+9.418253504 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-s6qzt" (UniqueName: "kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt") pod "network-check-target-5pvtj" (UID: "aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:30.559308 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:30.558575    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:30.559308 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:30.558645    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:30.559308 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:30.558593    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:30.559308 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:30.558769    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfrx9" podUID="c36eb6b7-750c-49f0-a11d-5a168f75eb29"
Nov 04 02:15:30.559308 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:30.558949    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pvtj" podUID="aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5"
Nov 04 02:15:30.559308 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:30.559056    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ff4lm" podUID="fe7e4369-7004-46e9-9821-cf3e8628e4df"
Nov 04 02:15:32.558760 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:32.558398    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:32.558760 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:32.558532    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ff4lm" podUID="fe7e4369-7004-46e9-9821-cf3e8628e4df"
Nov 04 02:15:32.558760 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:32.558583    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:32.558760 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:32.558633    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfrx9" podUID="c36eb6b7-750c-49f0-a11d-5a168f75eb29"
Nov 04 02:15:32.558760 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:32.558660    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:32.558760 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:32.558709    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pvtj" podUID="aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5"
Nov 04 02:15:32.612124 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:32.610461    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7425" event={"ID":"9813e2dc-dbcb-4166-bd17-62eb60ced426","Type":"ContainerStarted","Data":"1af78038e9eb8f8f92c73351b708e50f127be621b86929d969c3f8a0fc6b8076"}
Nov 04 02:15:32.618473 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:32.618429    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal" event={"ID":"88378d56a64bde54980a55721812b463","Type":"ContainerStarted","Data":"0fb586e7544756f2eeea593c430a8e24197899b1c28d59335338a8fb77ecb6ed"}
Nov 04 02:15:33.624879 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:33.624770    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal" event={"ID":"9e236c28d3c011f48f26e1ef488876d0","Type":"ContainerStarted","Data":"dd174140bbdb7a2bf40fb36123baaba3b1c5e6216f264d940ac13129d4c305fd"}
Nov 04 02:15:33.630933 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:33.630894    2577 generic.go:356] "Generic (PLEG): container finished" podID="9813e2dc-dbcb-4166-bd17-62eb60ced426" containerID="1af78038e9eb8f8f92c73351b708e50f127be621b86929d969c3f8a0fc6b8076" exitCode=0
Nov 04 02:15:33.631118 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:33.630996    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7425" event={"ID":"9813e2dc-dbcb-4166-bd17-62eb60ced426","Type":"ContainerDied","Data":"1af78038e9eb8f8f92c73351b708e50f127be621b86929d969c3f8a0fc6b8076"}
Nov 04 02:15:33.636010 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:33.635982    2577 generic.go:356] "Generic (PLEG): container finished" podID="88378d56a64bde54980a55721812b463" containerID="0fb586e7544756f2eeea593c430a8e24197899b1c28d59335338a8fb77ecb6ed" exitCode=0
Nov 04 02:15:33.636266 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:33.636219    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal" event={"ID":"88378d56a64bde54980a55721812b463","Type":"ContainerDied","Data":"0fb586e7544756f2eeea593c430a8e24197899b1c28d59335338a8fb77ecb6ed"}
Nov 04 02:15:33.642254 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:33.641800    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-g4rp8" event={"ID":"7a5c331c-c911-474a-b893-f39e9285a677","Type":"ContainerStarted","Data":"011be44a3a166348bf4fe92194efc8fd141e5775e8f0bd97f28b237d56d1261c"}
Nov 04 02:15:33.866342 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:33.866240    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal" podStartSLOduration=7.866219591 podStartE2EDuration="7.866219591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:33.742327751 +0000 UTC m=+8.716994013" watchObservedRunningTime="2026-11-04 02:15:33.866219591 +0000 UTC m=+8.840885852"
Nov 04 02:15:34.101226 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:34.101135    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-g4rp8" podStartSLOduration=2.745154689 podStartE2EDuration="8.101113942s" totalImagesPullingTime="5.355959253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:34.100245599 +0000 UTC m=+9.074911856" watchObservedRunningTime="2026-11-04 02:15:34.101113942 +0000 UTC m=+9.075780203"
Nov 04 02:15:34.382801 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:34.382730    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:34.382989 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:34.382811    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs\") pod \"network-metrics-daemon-ff4lm\" (UID: \"fe7e4369-7004-46e9-9821-cf3e8628e4df\") " pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:34.383054 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:34.382984    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:34.383109 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:34.383062    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs podName:fe7e4369-7004-46e9-9821-cf3e8628e4df nodeName:}" failed. No retries permitted until 2026-11-04 02:15:42.383035809 +0000 UTC m=+17.357702067 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs") pod "network-metrics-daemon-ff4lm" (UID: "fe7e4369-7004-46e9-9821-cf3e8628e4df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:34.383179 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:34.383134    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:34.383179 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:34.383172    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret podName:c36eb6b7-750c-49f0-a11d-5a168f75eb29 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:42.383159885 +0000 UTC m=+17.357826121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret") pod "global-pull-secret-syncer-bfrx9" (UID: "c36eb6b7-750c-49f0-a11d-5a168f75eb29") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:34.483660 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:34.483610    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6qzt\" (UniqueName: \"kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt\") pod \"network-check-target-5pvtj\" (UID: \"aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5\") " pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:34.483906 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:34.483845    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:15:34.483906 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:34.483876    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:15:34.483906 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:34.483890    2577 projected.go:196] Error preparing data for projected volume kube-api-access-s6qzt for pod openshift-network-diagnostics/network-check-target-5pvtj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:34.484129 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:34.483950    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt podName:aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:42.483931558 +0000 UTC m=+17.458597794 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-s6qzt" (UniqueName: "kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt") pod "network-check-target-5pvtj" (UID: "aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:34.559084 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:34.558549    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:34.559084 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:34.558705    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfrx9" podUID="c36eb6b7-750c-49f0-a11d-5a168f75eb29"
Nov 04 02:15:34.559084 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:34.558796    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:34.559084 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:34.558872    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pvtj" podUID="aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5"
Nov 04 02:15:34.559084 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:34.558939    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:34.559084 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:34.559036    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ff4lm" podUID="fe7e4369-7004-46e9-9821-cf3e8628e4df"
Nov 04 02:15:34.648980 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:34.648883    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-465v4" event={"ID":"cf87debc-dfe4-4dce-85f0-0ecab689c59d","Type":"ContainerStarted","Data":"43bbef776bdd5cb015a68dee5107a1f61d85cdec9a61ce45450bd821f7b5e385"}
Nov 04 02:15:34.661073 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:34.661033    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal" event={"ID":"88378d56a64bde54980a55721812b463","Type":"ContainerStarted","Data":"f923b521eda07db50bee5bc071518cc127ce243f9cffbe2d1558f06ae600febb"}
Nov 04 02:15:34.766474 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:34.766414    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-465v4" podStartSLOduration=2.482682099 podStartE2EDuration="8.76639951s" totalImagesPullingTime="6.283717411s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:34.765655609 +0000 UTC m=+9.740321868" watchObservedRunningTime="2026-11-04 02:15:34.76639951 +0000 UTC m=+9.741065766"
Nov 04 02:15:34.886115 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:34.886041    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal" podStartSLOduration=8.88602309 podStartE2EDuration="8.88602309s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:34.885031146 +0000 UTC m=+9.859697406" watchObservedRunningTime="2026-11-04 02:15:34.88602309 +0000 UTC m=+9.860689351"
Nov 04 02:15:34.958214 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:34.957339    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-g4rp8"
Nov 04 02:15:34.958214 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:34.958007    2577 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-g4rp8"
Nov 04 02:15:35.666269 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:35.666222    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl" event={"ID":"4bcbd86c-05d7-4132-8e50-c79c54ba683f","Type":"ContainerStarted","Data":"0ddc3d95d458508bbda3f3b319f8152a110721e07189d94265d7ed7a312e021b"}
Nov 04 02:15:35.667246 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:35.667223    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-g4rp8"
Nov 04 02:15:35.668268 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:35.668245    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g4rp8"
Nov 04 02:15:36.559408 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:36.559371    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:36.559602 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:36.559497    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ff4lm" podUID="fe7e4369-7004-46e9-9821-cf3e8628e4df"
Nov 04 02:15:36.559831 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:36.559814    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:36.559912 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:36.559885    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfrx9" podUID="c36eb6b7-750c-49f0-a11d-5a168f75eb29"
Nov 04 02:15:36.559976 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:36.559924    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:36.559976 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:36.559962    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pvtj" podUID="aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5"
Nov 04 02:15:37.369939 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:37.369876    2577 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 04 02:15:37.473114 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:37.472982    2577 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T02:15:37.369910576Z","UUID":"d1bfe812-5f1a-41cc-aa6a-70ef2c09ee1f","Handler":null,"Name":"","Endpoint":""}
Nov 04 02:15:37.475619 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:37.475143    2577 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 04 02:15:37.475619 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:37.475194    2577 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 04 02:15:37.675675 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:37.675591    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hkzpl" event={"ID":"fa9c7d67-d4ef-4900-873e-046523ea039e","Type":"ContainerStarted","Data":"e805696f43f1ec04cb392d2471f417b366aa167e9f8e46fe18048e79791425c8"}
Nov 04 02:15:37.678648 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:37.678614    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl" event={"ID":"4bcbd86c-05d7-4132-8e50-c79c54ba683f","Type":"ContainerStarted","Data":"5ff45eebfd71a8c7677043c01decd61817c6e0ab0d4d10ae586ecaf6406191ed"}
Nov 04 02:15:38.559470 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:38.559238    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:38.559470 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:38.559471    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:38.559890 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:38.559590    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ff4lm" podUID="fe7e4369-7004-46e9-9821-cf3e8628e4df"
Nov 04 02:15:38.559925 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:38.559427    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:38.560000 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:38.559975    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pvtj" podUID="aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5"
Nov 04 02:15:38.560135 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:38.560057    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfrx9" podUID="c36eb6b7-750c-49f0-a11d-5a168f75eb29"
Nov 04 02:15:38.683066 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:38.683012    2577 generic.go:356] "Generic (PLEG): container finished" podID="9813e2dc-dbcb-4166-bd17-62eb60ced426" containerID="5855bb26c9b0154b0dfcee92186bf13300231a3e6520b3b903a103892e97d5cc" exitCode=0
Nov 04 02:15:38.683284 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:38.683125    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7425" event={"ID":"9813e2dc-dbcb-4166-bd17-62eb60ced426","Type":"ContainerDied","Data":"5855bb26c9b0154b0dfcee92186bf13300231a3e6520b3b903a103892e97d5cc"}
Nov 04 02:15:38.687217 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:38.687048    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-tprts" event={"ID":"4daf9bec-b4b4-44b5-8582-7f4c95f9ec95","Type":"ContainerStarted","Data":"e0a726e1e438aa6bd92cb8e410fa0ff8de596f9bdab8801ed6fe4518c8f60a3e"}
Nov 04 02:15:38.808903 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:38.808835    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-hkzpl" podStartSLOduration=3.681192969 podStartE2EDuration="12.808815457s" totalImagesPullingTime="9.127622488s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:37.789112017 +0000 UTC m=+12.763778274" watchObservedRunningTime="2026-11-04 02:15:38.808815457 +0000 UTC m=+13.783481713"
Nov 04 02:15:39.691523 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:39.691475    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl" event={"ID":"4bcbd86c-05d7-4132-8e50-c79c54ba683f","Type":"ContainerStarted","Data":"897d8d738deb23f450e518e79dc195ac54818e4f9553241afd0f3ba4ee414491"}
Nov 04 02:15:39.693578 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:39.693541    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k46hl" event={"ID":"2d0d738a-4b36-416e-bf3b-3411b084ee41","Type":"ContainerStarted","Data":"8adfaa9e48137164a6957c6160cb68577ed2c93d3110f727102516306958cc90"}
Nov 04 02:15:39.695223 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:39.695198    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-z558g" event={"ID":"1e86306b-74a7-4f2f-84fa-0e297b78c7aa","Type":"ContainerStarted","Data":"e2833ed00232c1c5dd5babd66da160b97c953cf1c90a8c790ac57f901c58ba19"}
Nov 04 02:15:39.802771 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:39.802657    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl" podStartSLOduration=3.159981672 podStartE2EDuration="13.802640091s" totalImagesPullingTime="10.642658419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:26 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:39.802427393 +0000 UTC m=+14.777093650" watchObservedRunningTime="2026-11-04 02:15:39.802640091 +0000 UTC m=+14.777306351"
Nov 04 02:15:39.802947 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:39.802773    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-tprts" podStartSLOduration=4.037528574 podStartE2EDuration="13.802768117s" totalImagesPullingTime="9.765239543s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:38.91837083 +0000 UTC m=+13.893037086" watchObservedRunningTime="2026-11-04 02:15:39.802768117 +0000 UTC m=+14.777434373"
Nov 04 02:15:39.913228 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:39.913150    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k46hl" podStartSLOduration=2.471524804 podStartE2EDuration="13.913140745s" totalImagesPullingTime="11.441615941s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:39.913094708 +0000 UTC m=+14.887760964" watchObservedRunningTime="2026-11-04 02:15:39.913140745 +0000 UTC m=+14.887807001"
Nov 04 02:15:40.021815 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:40.021758    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-z558g" podStartSLOduration=4.987373231 podStartE2EDuration="14.021737736s" totalImagesPullingTime="9.034364505s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:40.021363208 +0000 UTC m=+14.996029465" watchObservedRunningTime="2026-11-04 02:15:40.021737736 +0000 UTC m=+14.996403990"
Nov 04 02:15:40.559414 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:40.559374    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:40.559584 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:40.559386    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:40.559584 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:40.559526    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ff4lm" podUID="fe7e4369-7004-46e9-9821-cf3e8628e4df"
Nov 04 02:15:40.559698 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:40.559638    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfrx9" podUID="c36eb6b7-750c-49f0-a11d-5a168f75eb29"
Nov 04 02:15:40.559698 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:40.559400    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:40.559794 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:40.559765    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pvtj" podUID="aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5"
Nov 04 02:15:40.700756 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:40.700721    2577 generic.go:356] "Generic (PLEG): container finished" podID="9813e2dc-dbcb-4166-bd17-62eb60ced426" containerID="c4b4f8ba76bf6da42624b2edea3be7add45d0f6af41c6aeb5df83199380ca7b3" exitCode=0
Nov 04 02:15:40.701340 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:40.700810    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7425" event={"ID":"9813e2dc-dbcb-4166-bd17-62eb60ced426","Type":"ContainerDied","Data":"c4b4f8ba76bf6da42624b2edea3be7add45d0f6af41c6aeb5df83199380ca7b3"}
Nov 04 02:15:42.454409 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:42.454132    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:42.454409 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:42.454405    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs\") pod \"network-metrics-daemon-ff4lm\" (UID: \"fe7e4369-7004-46e9-9821-cf3e8628e4df\") " pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:42.454998 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:42.454303    2577 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:42.454998 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:42.454508    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret podName:c36eb6b7-750c-49f0-a11d-5a168f75eb29 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:58.454485206 +0000 UTC m=+33.429151484 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret") pod "global-pull-secret-syncer-bfrx9" (UID: "c36eb6b7-750c-49f0-a11d-5a168f75eb29") : object "kube-system"/"original-pull-secret" not registered
Nov 04 02:15:42.454998 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:42.454568    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:42.454998 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:42.454621    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs podName:fe7e4369-7004-46e9-9821-cf3e8628e4df nodeName:}" failed. No retries permitted until 2026-11-04 02:15:58.454604883 +0000 UTC m=+33.429271117 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs") pod "network-metrics-daemon-ff4lm" (UID: "fe7e4369-7004-46e9-9821-cf3e8628e4df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:42.555404 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:42.555356    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6qzt\" (UniqueName: \"kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt\") pod \"network-check-target-5pvtj\" (UID: \"aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5\") " pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:42.555589 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:42.555504    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Nov 04 02:15:42.555589 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:42.555526    2577 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Nov 04 02:15:42.555589 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:42.555537    2577 projected.go:196] Error preparing data for projected volume kube-api-access-s6qzt for pod openshift-network-diagnostics/network-check-target-5pvtj: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:42.555716 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:42.555601    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt podName:aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:58.555584195 +0000 UTC m=+33.530250432 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-s6qzt" (UniqueName: "kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt") pod "network-check-target-5pvtj" (UID: "aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Nov 04 02:15:42.558422 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:42.558387    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:42.558561 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:42.558401    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:42.558561 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:42.558511    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:42.558561 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:42.558511    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfrx9" podUID="c36eb6b7-750c-49f0-a11d-5a168f75eb29"
Nov 04 02:15:42.558709 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:42.558583    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ff4lm" podUID="fe7e4369-7004-46e9-9821-cf3e8628e4df"
Nov 04 02:15:42.558709 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:42.558628    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pvtj" podUID="aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5"
Nov 04 02:15:42.708548 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:42.708425    2577 generic.go:356] "Generic (PLEG): container finished" podID="9813e2dc-dbcb-4166-bd17-62eb60ced426" containerID="09372ada5209782a5c9224cc751db03d1464bdd9d28829a217aeb7efe79739e5" exitCode=0
Nov 04 02:15:42.708548 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:42.708505    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7425" event={"ID":"9813e2dc-dbcb-4166-bd17-62eb60ced426","Type":"ContainerDied","Data":"09372ada5209782a5c9224cc751db03d1464bdd9d28829a217aeb7efe79739e5"}
Nov 04 02:15:44.559160 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:44.558978    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:44.559160 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:44.558978    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:44.559660 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:44.558987    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:44.559660 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:44.559317    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ff4lm" podUID="fe7e4369-7004-46e9-9821-cf3e8628e4df"
Nov 04 02:15:44.559660 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:44.559391    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfrx9" podUID="c36eb6b7-750c-49f0-a11d-5a168f75eb29"
Nov 04 02:15:44.559660 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:44.559385    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pvtj" podUID="aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5"
Nov 04 02:15:44.716449 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:44.716369    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:15:44.716768 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:44.716743    2577 generic.go:356] "Generic (PLEG): container finished" podID="50068ac4-0a6a-48ca-84dd-611fc3a87b65" containerID="a0259bf010b2942b942f7d3f3034c4565f49a2cbf78929acd0133b99f8c99738" exitCode=1
Nov 04 02:15:44.716887 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:44.716789    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv" event={"ID":"50068ac4-0a6a-48ca-84dd-611fc3a87b65","Type":"ContainerStarted","Data":"0f0b9edb43960eeb63c6f6094065bb299402fde52d9a5bcb4219466cd40c82c1"}
Nov 04 02:15:44.716887 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:44.716870    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv" event={"ID":"50068ac4-0a6a-48ca-84dd-611fc3a87b65","Type":"ContainerStarted","Data":"ab8f3ee3d7d3241d0eac2af7b2e411db3bdf5c3a8bc079b667cf4124ebee021b"}
Nov 04 02:15:44.716987 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:44.716916    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv" event={"ID":"50068ac4-0a6a-48ca-84dd-611fc3a87b65","Type":"ContainerStarted","Data":"1241303e527fefe272e1424a07f20a14939bd378aeda1e7cd3209c24bc6701c1"}
Nov 04 02:15:44.716987 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:44.716963    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv" event={"ID":"50068ac4-0a6a-48ca-84dd-611fc3a87b65","Type":"ContainerStarted","Data":"52d394a9fe2c1cefcd7582e7d4cf06602d915363723509ef4e2f5be744adf682"}
Nov 04 02:15:44.717089 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:44.717008    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv" event={"ID":"50068ac4-0a6a-48ca-84dd-611fc3a87b65","Type":"ContainerDied","Data":"a0259bf010b2942b942f7d3f3034c4565f49a2cbf78929acd0133b99f8c99738"}
Nov 04 02:15:44.717089 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:44.717055    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv" event={"ID":"50068ac4-0a6a-48ca-84dd-611fc3a87b65","Type":"ContainerStarted","Data":"155fa21c1e881f1d40839233fb61266864fe106bb6ab73caddaacfb29d1ad962"}
Nov 04 02:15:45.721863 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:45.721831    2577 generic.go:356] "Generic (PLEG): container finished" podID="9813e2dc-dbcb-4166-bd17-62eb60ced426" containerID="b1190d67d6d3e2db20571d33803d3ffc78401d826c6c2e72ab0d8abe66d735df" exitCode=0
Nov 04 02:15:45.722267 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:45.721893    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7425" event={"ID":"9813e2dc-dbcb-4166-bd17-62eb60ced426","Type":"ContainerDied","Data":"b1190d67d6d3e2db20571d33803d3ffc78401d826c6c2e72ab0d8abe66d735df"}
Nov 04 02:15:46.558952 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:46.558920    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:46.558952 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:46.558945    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:46.559092 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:46.558954    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:46.559092 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:46.559045    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pvtj" podUID="aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5"
Nov 04 02:15:46.559216 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:46.559127    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ff4lm" podUID="fe7e4369-7004-46e9-9821-cf3e8628e4df"
Nov 04 02:15:46.559262 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:46.559233    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfrx9" podUID="c36eb6b7-750c-49f0-a11d-5a168f75eb29"
Nov 04 02:15:46.727620 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:46.727591    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:15:46.728194 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:46.727978    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv" event={"ID":"50068ac4-0a6a-48ca-84dd-611fc3a87b65","Type":"ContainerStarted","Data":"350a215e976842c08b0c297f072d7ca0180c94c58d32b130528b49f8735ddad2"}
Nov 04 02:15:46.731018 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:46.730992    2577 generic.go:356] "Generic (PLEG): container finished" podID="9813e2dc-dbcb-4166-bd17-62eb60ced426" containerID="b4d90cce257552be54028ba930b5d1adeac82e5c8e0cf990f45ba6b353ead78c" exitCode=0
Nov 04 02:15:46.731133 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:46.731036    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7425" event={"ID":"9813e2dc-dbcb-4166-bd17-62eb60ced426","Type":"ContainerDied","Data":"b4d90cce257552be54028ba930b5d1adeac82e5c8e0cf990f45ba6b353ead78c"}
Nov 04 02:15:47.737159 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:47.737122    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-p7425" event={"ID":"9813e2dc-dbcb-4166-bd17-62eb60ced426","Type":"ContainerStarted","Data":"783084cb7ba4d69f9b8714973dc5cf3c3d6c19bb58a96fab28e0badd2d51d2c0"}
Nov 04 02:15:47.944691 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:47.944628    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-p7425" podStartSLOduration=8.387312285 podStartE2EDuration="21.944613166s" totalImagesPullingTime="13.557300881s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:47.94438182 +0000 UTC m=+22.919048077" watchObservedRunningTime="2026-11-04 02:15:47.944613166 +0000 UTC m=+22.919279422"
Nov 04 02:15:48.558789 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:48.558744    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:48.558967 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:48.558814    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:48.558967 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:48.558912    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:48.558967 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:48.558916    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfrx9" podUID="c36eb6b7-750c-49f0-a11d-5a168f75eb29"
Nov 04 02:15:48.559123 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:48.558998    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ff4lm" podUID="fe7e4369-7004-46e9-9821-cf3e8628e4df"
Nov 04 02:15:48.559123 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:48.559072    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pvtj" podUID="aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5"
Nov 04 02:15:48.743529 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:48.743504    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:15:48.744193 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:48.743940    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv" event={"ID":"50068ac4-0a6a-48ca-84dd-611fc3a87b65","Type":"ContainerStarted","Data":"329ead3e985add0a203a7777d5cfc9aa03e97c3c097c6ba8be1451e221eb5d17"}
Nov 04 02:15:48.744612 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:48.744595    2577 scope.go:122] "RemoveContainer" containerID="a0259bf010b2942b942f7d3f3034c4565f49a2cbf78929acd0133b99f8c99738"
Nov 04 02:15:49.749757 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:49.749584    2577 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:15:49.750240 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:49.750098    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv" event={"ID":"50068ac4-0a6a-48ca-84dd-611fc3a87b65","Type":"ContainerStarted","Data":"3f658e71ba9f83dcc4376e3d93c65aec2732ff08b157c8fd1a72cde2130204b3"}
Nov 04 02:15:49.750240 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:49.750209    2577 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 02:15:49.750484 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:49.750454    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:49.750616 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:49.750535    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:49.767012 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:49.766982    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:49.767159 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:49.767092    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:50.009533 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:50.009426    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv" podStartSLOduration=8.086774763 podStartE2EDuration="24.009411812s" totalImagesPullingTime="15.922637049s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:15:49.963250123 +0000 UTC m=+24.937916381" watchObservedRunningTime="2026-11-04 02:15:50.009411812 +0000 UTC m=+24.984078067"
Nov 04 02:15:50.558528 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:50.558479    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:50.558528 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:50.558534    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:50.558798 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:50.558499    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:50.558798 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:50.558615    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ff4lm" podUID="fe7e4369-7004-46e9-9821-cf3e8628e4df"
Nov 04 02:15:50.558798 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:50.558697    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfrx9" podUID="c36eb6b7-750c-49f0-a11d-5a168f75eb29"
Nov 04 02:15:50.558798 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:50.558790    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pvtj" podUID="aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5"
Nov 04 02:15:50.752006 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:50.751974    2577 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 02:15:51.446066 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:51.445970    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5pvtj"]
Nov 04 02:15:51.446303 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:51.446095    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:51.446303 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:51.446215    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pvtj" podUID="aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5"
Nov 04 02:15:51.449015 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:51.448978    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bfrx9"]
Nov 04 02:15:51.449154 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:51.449092    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:51.449241 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:51.449224    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfrx9" podUID="c36eb6b7-750c-49f0-a11d-5a168f75eb29"
Nov 04 02:15:51.449734 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:51.449711    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ff4lm"]
Nov 04 02:15:51.449821 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:51.449812    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:51.449946 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:51.449926    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ff4lm" podUID="fe7e4369-7004-46e9-9821-cf3e8628e4df"
Nov 04 02:15:51.754372 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:51.754301    2577 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 02:15:52.141659 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:52.141571    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:15:52.558478 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:52.558389    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:52.558626 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:52.558513    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ff4lm" podUID="fe7e4369-7004-46e9-9821-cf3e8628e4df"
Nov 04 02:15:53.559413 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:53.559369    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:53.559851 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:53.559493    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfrx9" podUID="c36eb6b7-750c-49f0-a11d-5a168f75eb29"
Nov 04 02:15:53.559851 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:53.559546    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:53.559851 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:53.559696    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pvtj" podUID="aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5"
Nov 04 02:15:54.559041 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:54.559003    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:54.559256 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:54.559119    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ff4lm" podUID="fe7e4369-7004-46e9-9821-cf3e8628e4df"
Nov 04 02:15:55.559669 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:55.559630    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:55.560083 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:55.559753    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5pvtj" podUID="aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5"
Nov 04 02:15:55.560083 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:55.559831    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:55.560083 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:55.559999    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bfrx9" podUID="c36eb6b7-750c-49f0-a11d-5a168f75eb29"
Nov 04 02:15:56.558684 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:56.558639    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:56.558868 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:56.558768    2577 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ff4lm" podUID="fe7e4369-7004-46e9-9821-cf3e8628e4df"
Nov 04 02:15:57.349562 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.349480    2577 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeReady"
Nov 04 02:15:57.349926 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.349604    2577 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Nov 04 02:15:57.496366 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.496328    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fj84x"]
Nov 04 02:15:57.512120 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.512090    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qcfqf"]
Nov 04 02:15:57.512276 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.512232    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fj84x"
Nov 04 02:15:57.526231 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.526200    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fj84x"]
Nov 04 02:15:57.526388 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.526338    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qcfqf"
Nov 04 02:15:57.539239 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.539039    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qcfqf"]
Nov 04 02:15:57.559146 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.559111    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:57.559345 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.559319    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:57.567764 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.567741    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 04 02:15:57.568491 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.568467    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 04 02:15:57.568819 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.568807    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n2j4c\""
Nov 04 02:15:57.626037 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.625945    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 04 02:15:57.626242 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.626044    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-nw2cx\""
Nov 04 02:15:57.626242 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.626044    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-v7b9k\""
Nov 04 02:15:57.626242 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.626064    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-gsgrb\""
Nov 04 02:15:57.626242 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.626104    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 02:15:57.663474 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.663427    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-config-volume\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:15:57.663651 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.663481    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13b8bca5-57ac-42c5-a5fe-a87a2a0ff775-cert\") pod \"ingress-canary-qcfqf\" (UID: \"13b8bca5-57ac-42c5-a5fe-a87a2a0ff775\") " pod="openshift-ingress-canary/ingress-canary-qcfqf"
Nov 04 02:15:57.663651 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.663512    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp6gp\" (UniqueName: \"kubernetes.io/projected/13b8bca5-57ac-42c5-a5fe-a87a2a0ff775-kube-api-access-tp6gp\") pod \"ingress-canary-qcfqf\" (UID: \"13b8bca5-57ac-42c5-a5fe-a87a2a0ff775\") " pod="openshift-ingress-canary/ingress-canary-qcfqf"
Nov 04 02:15:57.663651 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.663574    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96wdc\" (UniqueName: \"kubernetes.io/projected/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-kube-api-access-96wdc\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:15:57.663651 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.663618    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:15:57.663770 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.663691    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-tmp-dir\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:15:57.668672 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.668654    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 04 02:15:57.671927 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.671896    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 02:15:57.671985 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.671909    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 02:15:57.671985 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.671911    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 04 02:15:57.764095 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.764052    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:15:57.764313 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.764106    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-tmp-dir\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:15:57.764313 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.764155    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-config-volume\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:15:57.764313 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.764210    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13b8bca5-57ac-42c5-a5fe-a87a2a0ff775-cert\") pod \"ingress-canary-qcfqf\" (UID: \"13b8bca5-57ac-42c5-a5fe-a87a2a0ff775\") " pod="openshift-ingress-canary/ingress-canary-qcfqf"
Nov 04 02:15:57.764313 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.764225    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp6gp\" (UniqueName: \"kubernetes.io/projected/13b8bca5-57ac-42c5-a5fe-a87a2a0ff775-kube-api-access-tp6gp\") pod \"ingress-canary-qcfqf\" (UID: \"13b8bca5-57ac-42c5-a5fe-a87a2a0ff775\") " pod="openshift-ingress-canary/ingress-canary-qcfqf"
Nov 04 02:15:57.764313 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:57.764256    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 02:15:57.764313 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.764297    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96wdc\" (UniqueName: \"kubernetes.io/projected/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-kube-api-access-96wdc\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:15:57.764570 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:57.764330    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls podName:d3b93c5f-3df3-49d6-af5a-3d330ecc5318 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:58.264309009 +0000 UTC m=+33.238975274 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls") pod "dns-default-fj84x" (UID: "d3b93c5f-3df3-49d6-af5a-3d330ecc5318") : secret "dns-default-metrics-tls" not found
Nov 04 02:15:57.764806 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.764786    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-tmp-dir\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:15:57.765084 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.765062    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-config-volume\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:15:57.768785 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.768762    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13b8bca5-57ac-42c5-a5fe-a87a2a0ff775-cert\") pod \"ingress-canary-qcfqf\" (UID: \"13b8bca5-57ac-42c5-a5fe-a87a2a0ff775\") " pod="openshift-ingress-canary/ingress-canary-qcfqf"
Nov 04 02:15:57.802611 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.802573    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-b92z2"]
Nov 04 02:15:57.825755 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.825718    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-b92z2"
Nov 04 02:15:57.833531 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.832926    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp6gp\" (UniqueName: \"kubernetes.io/projected/13b8bca5-57ac-42c5-a5fe-a87a2a0ff775-kube-api-access-tp6gp\") pod \"ingress-canary-qcfqf\" (UID: \"13b8bca5-57ac-42c5-a5fe-a87a2a0ff775\") " pod="openshift-ingress-canary/ingress-canary-qcfqf"
Nov 04 02:15:57.833531 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.833330    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96wdc\" (UniqueName: \"kubernetes.io/projected/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-kube-api-access-96wdc\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:15:57.853080 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.853042    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qcfqf"
Nov 04 02:15:57.860931 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.860902    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-b92z2"]
Nov 04 02:15:57.876073 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.876014    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-b2fnf\""
Nov 04 02:15:57.876753 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.876738    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 04 02:15:57.877013 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.876994    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 04 02:15:57.915122 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.915092    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xctgd"]
Nov 04 02:15:57.937484 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.937451    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:15:57.967037 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.966869    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mhz2q\" (UniqueName: \"kubernetes.io/projected/545569f5-aa5b-4b5b-bd9b-bf886ac96bd7-kube-api-access-mhz2q\") pod \"migrator-66df5d496b-b92z2\" (UID: \"545569f5-aa5b-4b5b-bd9b-bf886ac96bd7\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-b92z2"
Nov 04 02:15:57.977217 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:57.977094    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xctgd"]
Nov 04 02:15:58.068075 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.068030    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/db7921f7-4844-4111-9f43-6aa6eeccf9c6-crio-socket\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:15:58.068075 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.068079    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhz2q\" (UniqueName: \"kubernetes.io/projected/545569f5-aa5b-4b5b-bd9b-bf886ac96bd7-kube-api-access-mhz2q\") pod \"migrator-66df5d496b-b92z2\" (UID: \"545569f5-aa5b-4b5b-bd9b-bf886ac96bd7\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-b92z2"
Nov 04 02:15:58.068366 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.068137    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:15:58.068366 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.068278    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:15:58.068366 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.068313    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmb8q\" (UniqueName: \"kubernetes.io/projected/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-api-access-kmb8q\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:15:58.068366 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.068353    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/db7921f7-4844-4111-9f43-6aa6eeccf9c6-data-volume\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:15:58.074911 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.074872    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 04 02:15:58.075046 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.074937    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 04 02:15:58.075046 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.074954    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 04 02:15:58.075453 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.075436    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 04 02:15:58.075554 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.075540    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pszzf\""
Nov 04 02:15:58.125902 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.125861    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhz2q\" (UniqueName: \"kubernetes.io/projected/545569f5-aa5b-4b5b-bd9b-bf886ac96bd7-kube-api-access-mhz2q\") pod \"migrator-66df5d496b-b92z2\" (UID: \"545569f5-aa5b-4b5b-bd9b-bf886ac96bd7\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-b92z2"
Nov 04 02:15:58.162691 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.162609    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-b92z2"
Nov 04 02:15:58.168840 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.168811    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/periodic-gathering-lrnr2-ck96b"]
Nov 04 02:15:58.169032 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.169012    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:15:58.169086 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.169060    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:15:58.169130 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.169086    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmb8q\" (UniqueName: \"kubernetes.io/projected/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-api-access-kmb8q\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:15:58.169199 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.169127    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/db7921f7-4844-4111-9f43-6aa6eeccf9c6-data-volume\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:15:58.169199 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.169189    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/db7921f7-4844-4111-9f43-6aa6eeccf9c6-crio-socket\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:15:58.169290 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:58.169205    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 02:15:58.169290 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:58.169229    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 02:15:58.169290 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:58.169281    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls podName:db7921f7-4844-4111-9f43-6aa6eeccf9c6 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:58.669261226 +0000 UTC m=+33.643927476 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xctgd" (UID: "db7921f7-4844-4111-9f43-6aa6eeccf9c6") : secret "insights-runtime-extractor-tls" not found
Nov 04 02:15:58.169422 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:58.169317    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-rbac-proxy-cm podName:db7921f7-4844-4111-9f43-6aa6eeccf9c6 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:58.669290196 +0000 UTC m=+33.643956455 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xctgd" (UID: "db7921f7-4844-4111-9f43-6aa6eeccf9c6") : configmap "kube-rbac-proxy" not found
Nov 04 02:15:58.169422 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.169392    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/db7921f7-4844-4111-9f43-6aa6eeccf9c6-crio-socket\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:15:58.169511 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.169486    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/db7921f7-4844-4111-9f43-6aa6eeccf9c6-data-volume\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:15:58.202434 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.202393    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:15:58.228629 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.228595    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-lrnr2-ck96b"]
Nov 04 02:15:58.229106 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.229084    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmb8q\" (UniqueName: \"kubernetes.io/projected/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-api-access-kmb8q\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:15:58.255816 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.255780    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 04 02:15:58.270000 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.269972    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/ae0be1c5-e730-4d02-84d7-f66a9666af87-archives-path\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:15:58.270157 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.270019    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:15:58.270157 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.270042    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-trusted-ca-bundle\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:15:58.270157 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.270066    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzl2p\" (UniqueName: \"kubernetes.io/projected/ae0be1c5-e730-4d02-84d7-f66a9666af87-kube-api-access-dzl2p\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:15:58.270318 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.270206    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-service-ca-bundle\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:15:58.270318 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:58.270210    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 02:15:58.270318 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:58.270285    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls podName:d3b93c5f-3df3-49d6-af5a-3d330ecc5318 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:59.27026956 +0000 UTC m=+34.244935815 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls") pod "dns-default-fj84x" (UID: "d3b93c5f-3df3-49d6-af5a-3d330ecc5318") : secret "dns-default-metrics-tls" not found
Nov 04 02:15:58.290879 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:58.290850    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod13b8bca5_57ac_42c5_a5fe_a87a2a0ff775.slice/crio-95ff0c1982cbc2d853c60401c9a72afcc89905c6b2b095e61a9d9a47f550e443 WatchSource:0}: Error finding container 95ff0c1982cbc2d853c60401c9a72afcc89905c6b2b095e61a9d9a47f550e443: Status 404 returned error can't find the container with id 95ff0c1982cbc2d853c60401c9a72afcc89905c6b2b095e61a9d9a47f550e443
Nov 04 02:15:58.302397 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.302366    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5gtz2\""
Nov 04 02:15:58.302526 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.302403    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 04 02:15:58.303331 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.303310    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qcfqf"]
Nov 04 02:15:58.371540 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.371502    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-service-ca-bundle\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:15:58.371916 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.371592    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/ae0be1c5-e730-4d02-84d7-f66a9666af87-archives-path\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:15:58.371916 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.371625    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-trusted-ca-bundle\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:15:58.371916 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.371647    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzl2p\" (UniqueName: \"kubernetes.io/projected/ae0be1c5-e730-4d02-84d7-f66a9666af87-kube-api-access-dzl2p\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:15:58.372094 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.372072    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/ae0be1c5-e730-4d02-84d7-f66a9666af87-archives-path\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:15:58.372145 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.372129    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-service-ca-bundle\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:15:58.372436 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.372413    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-trusted-ca-bundle\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:15:58.429695 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.429625    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzl2p\" (UniqueName: \"kubernetes.io/projected/ae0be1c5-e730-4d02-84d7-f66a9666af87-kube-api-access-dzl2p\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:15:58.472753 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.472718    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:58.472918 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.472774    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs\") pod \"network-metrics-daemon-ff4lm\" (UID: \"fe7e4369-7004-46e9-9821-cf3e8628e4df\") " pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:58.472918 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:58.472889    2577 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:58.472981 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:58.472944    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs podName:fe7e4369-7004-46e9-9821-cf3e8628e4df nodeName:}" failed. No retries permitted until 2026-11-04 02:16:30.472931165 +0000 UTC m=+65.447597398 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs") pod "network-metrics-daemon-ff4lm" (UID: "fe7e4369-7004-46e9-9821-cf3e8628e4df") : object "openshift-multus"/"metrics-daemon-secret" not registered
Nov 04 02:15:58.475230 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.475209    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:58.483250 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.483217    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:15:58.534637 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.534600    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:15:58.554438 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.554400    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-66df5d496b-b92z2"]
Nov 04 02:15:58.558936 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.558896    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:15:58.564964 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:58.564927    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod545569f5_aa5b_4b5b_bd9b_bf886ac96bd7.slice/crio-2d13a81d96656dba5daf933efa305814c877a843604250d4f5093e91ea838694 WatchSource:0}: Error finding container 2d13a81d96656dba5daf933efa305814c877a843604250d4f5093e91ea838694: Status 404 returned error can't find the container with id 2d13a81d96656dba5daf933efa305814c877a843604250d4f5093e91ea838694
Nov 04 02:15:58.574209 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.574147    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6qzt\" (UniqueName: \"kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt\") pod \"network-check-target-5pvtj\" (UID: \"aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5\") " pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:58.578959 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.578929    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6qzt\" (UniqueName: \"kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt\") pod \"network-check-target-5pvtj\" (UID: \"aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5\") " pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:58.618256 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.618224    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 02:15:58.618410 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.618335    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k925t\""
Nov 04 02:15:58.674945 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.674909    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:15:58.675140 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.674976    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:15:58.675140 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:58.675075    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 02:15:58.675140 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:58.675088    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 02:15:58.675266 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:58.675145    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls podName:db7921f7-4844-4111-9f43-6aa6eeccf9c6 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:59.675128822 +0000 UTC m=+34.649795060 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xctgd" (UID: "db7921f7-4844-4111-9f43-6aa6eeccf9c6") : secret "insights-runtime-extractor-tls" not found
Nov 04 02:15:58.675266 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:58.675159    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-rbac-proxy-cm podName:db7921f7-4844-4111-9f43-6aa6eeccf9c6 nodeName:}" failed. No retries permitted until 2026-11-04 02:15:59.675152749 +0000 UTC m=+34.649818984 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xctgd" (UID: "db7921f7-4844-4111-9f43-6aa6eeccf9c6") : configmap "kube-rbac-proxy" not found
Nov 04 02:15:58.774032 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.773944    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-b92z2" event={"ID":"545569f5-aa5b-4b5b-bd9b-bf886ac96bd7","Type":"ContainerStarted","Data":"2d13a81d96656dba5daf933efa305814c877a843604250d4f5093e91ea838694"}
Nov 04 02:15:58.775127 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.775104    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:15:58.775464 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.775441    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qcfqf" event={"ID":"13b8bca5-57ac-42c5-a5fe-a87a2a0ff775","Type":"ContainerStarted","Data":"95ff0c1982cbc2d853c60401c9a72afcc89905c6b2b095e61a9d9a47f550e443"}
Nov 04 02:15:58.782200 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.781539    2577 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-s7dqc"]
Nov 04 02:15:58.795264 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.795239    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc"
Nov 04 02:15:58.842035 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.841898    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-s7dqc"]
Nov 04 02:15:58.847248 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.847145    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Nov 04 02:15:58.847248 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.847192    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Nov 04 02:15:58.847248 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.847238    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Nov 04 02:15:58.847502 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.847295    2577 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wdjsv\""
Nov 04 02:15:58.847502 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.847378    2577 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Nov 04 02:15:58.876020 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.875990    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4f046171-a465-4614-b723-dd243a083530-signing-key\") pod \"service-ca-5fffc97bdf-s7dqc\" (UID: \"4f046171-a465-4614-b723-dd243a083530\") " pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc"
Nov 04 02:15:58.876221 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.876033    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjl9k\" (UniqueName: \"kubernetes.io/projected/4f046171-a465-4614-b723-dd243a083530-kube-api-access-fjl9k\") pod \"service-ca-5fffc97bdf-s7dqc\" (UID: \"4f046171-a465-4614-b723-dd243a083530\") " pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc"
Nov 04 02:15:58.876221 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.876054    2577 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4f046171-a465-4614-b723-dd243a083530-signing-cabundle\") pod \"service-ca-5fffc97bdf-s7dqc\" (UID: \"4f046171-a465-4614-b723-dd243a083530\") " pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc"
Nov 04 02:15:58.886353 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.886322    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bfrx9"]
Nov 04 02:15:58.893725 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:58.893696    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc36eb6b7_750c_49f0_a11d_5a168f75eb29.slice/crio-f030ce167352a9f7a335fe578f34426ee747ba66efa8cd5fc5ff6cdb5f16b1cf WatchSource:0}: Error finding container f030ce167352a9f7a335fe578f34426ee747ba66efa8cd5fc5ff6cdb5f16b1cf: Status 404 returned error can't find the container with id f030ce167352a9f7a335fe578f34426ee747ba66efa8cd5fc5ff6cdb5f16b1cf
Nov 04 02:15:58.931994 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.931949    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/periodic-gathering-lrnr2-ck96b"]
Nov 04 02:15:58.939396 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:58.939362    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae0be1c5_e730_4d02_84d7_f66a9666af87.slice/crio-bda92b0002df125ba344b3a6e05bfa2bef67825807ef59bbb91312db54cc4840 WatchSource:0}: Error finding container bda92b0002df125ba344b3a6e05bfa2bef67825807ef59bbb91312db54cc4840: Status 404 returned error can't find the container with id bda92b0002df125ba344b3a6e05bfa2bef67825807ef59bbb91312db54cc4840
Nov 04 02:15:58.977036 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.976996    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjl9k\" (UniqueName: \"kubernetes.io/projected/4f046171-a465-4614-b723-dd243a083530-kube-api-access-fjl9k\") pod \"service-ca-5fffc97bdf-s7dqc\" (UID: \"4f046171-a465-4614-b723-dd243a083530\") " pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc"
Nov 04 02:15:58.977036 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.977044    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4f046171-a465-4614-b723-dd243a083530-signing-cabundle\") pod \"service-ca-5fffc97bdf-s7dqc\" (UID: \"4f046171-a465-4614-b723-dd243a083530\") " pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc"
Nov 04 02:15:58.977326 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.977293    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4f046171-a465-4614-b723-dd243a083530-signing-key\") pod \"service-ca-5fffc97bdf-s7dqc\" (UID: \"4f046171-a465-4614-b723-dd243a083530\") " pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc"
Nov 04 02:15:58.977798 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.977770    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4f046171-a465-4614-b723-dd243a083530-signing-cabundle\") pod \"service-ca-5fffc97bdf-s7dqc\" (UID: \"4f046171-a465-4614-b723-dd243a083530\") " pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc"
Nov 04 02:15:58.980094 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:58.980060    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4f046171-a465-4614-b723-dd243a083530-signing-key\") pod \"service-ca-5fffc97bdf-s7dqc\" (UID: \"4f046171-a465-4614-b723-dd243a083530\") " pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc"
Nov 04 02:15:59.034855 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:59.034778    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjl9k\" (UniqueName: \"kubernetes.io/projected/4f046171-a465-4614-b723-dd243a083530-kube-api-access-fjl9k\") pod \"service-ca-5fffc97bdf-s7dqc\" (UID: \"4f046171-a465-4614-b723-dd243a083530\") " pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc"
Nov 04 02:15:59.125055 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:59.125018    2577 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc"
Nov 04 02:15:59.158162 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:59.158133    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5pvtj"]
Nov 04 02:15:59.164938 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:59.164889    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff26f5a_c5b8_4373_ad5d_05d8ccbed0e5.slice/crio-36408e7cec42b9a6291aec28700cf2e21c8c17077f0839cb322d0c002168a0b6 WatchSource:0}: Error finding container 36408e7cec42b9a6291aec28700cf2e21c8c17077f0839cb322d0c002168a0b6: Status 404 returned error can't find the container with id 36408e7cec42b9a6291aec28700cf2e21c8c17077f0839cb322d0c002168a0b6
Nov 04 02:15:59.279710 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:59.279675    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:15:59.279896 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:59.279796    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 02:15:59.279896 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:59.279857    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls podName:d3b93c5f-3df3-49d6-af5a-3d330ecc5318 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:01.27984382 +0000 UTC m=+36.254510054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls") pod "dns-default-fj84x" (UID: "d3b93c5f-3df3-49d6-af5a-3d330ecc5318") : secret "dns-default-metrics-tls" not found
Nov 04 02:15:59.513961 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:59.513861    2577 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-5fffc97bdf-s7dqc"]
Nov 04 02:15:59.521192 ip-10-0-130-155 kubenswrapper[2577]: W1104 02:15:59.521124    2577 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f046171_a465_4614_b723_dd243a083530.slice/crio-aefa3736ae5c3f8459ab885f57984b1a8e272ab49d18f66ef383aa1cf0e6eb1d WatchSource:0}: Error finding container aefa3736ae5c3f8459ab885f57984b1a8e272ab49d18f66ef383aa1cf0e6eb1d: Status 404 returned error can't find the container with id aefa3736ae5c3f8459ab885f57984b1a8e272ab49d18f66ef383aa1cf0e6eb1d
Nov 04 02:15:59.684844 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:59.684799    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:15:59.685015 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:59.684859    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:15:59.685015 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:59.684964    2577 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Nov 04 02:15:59.685015 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:59.684965    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 02:15:59.685109 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:59.685037    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-rbac-proxy-cm podName:db7921f7-4844-4111-9f43-6aa6eeccf9c6 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:01.685021402 +0000 UTC m=+36.659687655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xctgd" (UID: "db7921f7-4844-4111-9f43-6aa6eeccf9c6") : configmap "kube-rbac-proxy" not found
Nov 04 02:15:59.685109 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:15:59.685078    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls podName:db7921f7-4844-4111-9f43-6aa6eeccf9c6 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:01.685049975 +0000 UTC m=+36.659716223 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xctgd" (UID: "db7921f7-4844-4111-9f43-6aa6eeccf9c6") : secret "insights-runtime-extractor-tls" not found
Nov 04 02:15:59.779938 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:59.779849    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-lrnr2-ck96b" event={"ID":"ae0be1c5-e730-4d02-84d7-f66a9666af87","Type":"ContainerStarted","Data":"bda92b0002df125ba344b3a6e05bfa2bef67825807ef59bbb91312db54cc4840"}
Nov 04 02:15:59.781328 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:59.781285    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc" event={"ID":"4f046171-a465-4614-b723-dd243a083530","Type":"ContainerStarted","Data":"aefa3736ae5c3f8459ab885f57984b1a8e272ab49d18f66ef383aa1cf0e6eb1d"}
Nov 04 02:15:59.782646 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:59.782545    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bfrx9" event={"ID":"c36eb6b7-750c-49f0-a11d-5a168f75eb29","Type":"ContainerStarted","Data":"f030ce167352a9f7a335fe578f34426ee747ba66efa8cd5fc5ff6cdb5f16b1cf"}
Nov 04 02:15:59.783952 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:15:59.783926    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5pvtj" event={"ID":"aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5","Type":"ContainerStarted","Data":"36408e7cec42b9a6291aec28700cf2e21c8c17077f0839cb322d0c002168a0b6"}
Nov 04 02:16:01.300624 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:16:01.300584    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:16:01.301053 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:16:01.300775    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 02:16:01.301053 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:16:01.300859    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls podName:d3b93c5f-3df3-49d6-af5a-3d330ecc5318 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:05.300838783 +0000 UTC m=+40.275505037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls") pod "dns-default-fj84x" (UID: "d3b93c5f-3df3-49d6-af5a-3d330ecc5318") : secret "dns-default-metrics-tls" not found
Nov 04 02:16:01.704222 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:16:01.704113    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:16:01.704222 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:16:01.704198    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:16:01.704526 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:16:01.704366    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 02:16:01.704638 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:16:01.704596    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls podName:db7921f7-4844-4111-9f43-6aa6eeccf9c6 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:05.704573679 +0000 UTC m=+40.679239916 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xctgd" (UID: "db7921f7-4844-4111-9f43-6aa6eeccf9c6") : secret "insights-runtime-extractor-tls" not found
Nov 04 02:16:01.705032 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:16:01.704972    2577 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:16:01.795163 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:16:01.793984    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-b92z2" event={"ID":"545569f5-aa5b-4b5b-bd9b-bf886ac96bd7","Type":"ContainerStarted","Data":"a966dde4f33f3b7220176aa1604e682cf2259947612cae5d484c134d0045be06"}
Nov 04 02:16:03.803700 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:16:03.803666    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-lrnr2-ck96b" event={"ID":"ae0be1c5-e730-4d02-84d7-f66a9666af87","Type":"ContainerStarted","Data":"22bd27bb9add946fc54be217f3b9f8874cc7c58f4a61ff5835f250227b006c6e"}
Nov 04 02:16:03.919770 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:16:03.919709    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-b92z2" podStartSLOduration=4.205969953 podStartE2EDuration="6.919693819s" totalImagesPullingTime="2.713723866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:01.904460148 +0000 UTC m=+36.879126404" watchObservedRunningTime="2026-11-04 02:16:03.919693819 +0000 UTC m=+38.894360074"
Nov 04 02:16:03.920045 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:16:03.920021    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/periodic-gathering-lrnr2-ck96b" podStartSLOduration=1.399988456 podStartE2EDuration="5.920014593s" totalImagesPullingTime="4.520026137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:03.917792971 +0000 UTC m=+38.892459229" watchObservedRunningTime="2026-11-04 02:16:03.920014593 +0000 UTC m=+38.894680849"
Nov 04 02:16:04.809586 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:16:04.809534    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qcfqf" event={"ID":"13b8bca5-57ac-42c5-a5fe-a87a2a0ff775","Type":"ContainerStarted","Data":"0a7b8773b24ee1623fd686543e4c089914e8c6c011a13de9e3bcb0c3a96030ad"}
Nov 04 02:16:04.811731 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:16:04.811662    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc" event={"ID":"4f046171-a465-4614-b723-dd243a083530","Type":"ContainerStarted","Data":"dbed6940390d200cca6afa90ca6f6ba17df423490cd93e7501cfef61073e5e7a"}
Nov 04 02:16:05.032423 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:16:05.032349    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qcfqf" podStartSLOduration=1.622297517 podStartE2EDuration="8.032328788s" totalImagesPullingTime="6.410031271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:15:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:04.922686321 +0000 UTC m=+39.897352579" watchObservedRunningTime="2026-11-04 02:16:05.032328788 +0000 UTC m=+40.006995044"
Nov 04 02:16:05.032619 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:16:05.032485    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc" podStartSLOduration=2.291676315 podStartE2EDuration="7.032474917s" totalImagesPullingTime="4.740798602s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:05.031366902 +0000 UTC m=+40.006033161" watchObservedRunningTime="2026-11-04 02:16:05.032474917 +0000 UTC m=+40.007141176"
Nov 04 02:16:05.339872 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:16:05.339778    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:16:05.340037 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:16:05.339950    2577 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Nov 04 02:16:05.340091 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:16:05.340036    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls podName:d3b93c5f-3df3-49d6-af5a-3d330ecc5318 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:13.340015382 +0000 UTC m=+48.314681632 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls") pod "dns-default-fj84x" (UID: "d3b93c5f-3df3-49d6-af5a-3d330ecc5318") : secret "dns-default-metrics-tls" not found
Nov 04 02:16:05.743683 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:16:05.743590    2577 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:16:05.743835 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:16:05.743758    2577 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Nov 04 02:16:05.743873 ip-10-0-130-155 kubenswrapper[2577]: E1104 02:16:05.743843    2577 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls podName:db7921f7-4844-4111-9f43-6aa6eeccf9c6 nodeName:}" failed. No retries permitted until 2026-11-04 02:16:13.743827202 +0000 UTC m=+48.718493438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xctgd" (UID: "db7921f7-4844-4111-9f43-6aa6eeccf9c6") : secret "insights-runtime-extractor-tls" not found
Nov 04 02:16:05.815955 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:16:05.815909    2577 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5pvtj" event={"ID":"aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5","Type":"ContainerStarted","Data":"3e14fa510529d9d89ad6956eb1d0a7d6960f3a925fb32083195480c555427669"}
Nov 04 02:16:05.816432 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:16:05.816109    2577 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:16:05.958376 ip-10-0-130-155 kubenswrapper[2577]: I1104 02:16:05.958311    2577 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5pvtj" podStartSLOduration=34.058674591 podStartE2EDuration="39.958289199s" totalImagesPullingTime="5.899614608s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:15:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:05.957396244 +0000 UTC m=+40.932062499" watchObservedRunningTime="2026-11-04 02:16:05.958289199 +0000 UTC m=+40.932955456"
Nov 04 02:16:06.320063 ip-10-0-130-155 systemd[1]: Stopping Kubernetes Kubelet...
Nov 04 02:16:06.328808 ip-10-0-130-155 systemd[1]: kubelet.service: Deactivated successfully.
Nov 04 02:16:06.328987 ip-10-0-130-155 systemd[1]: Stopped Kubernetes Kubelet.
Nov 04 02:16:06.329050 ip-10-0-130-155 systemd[1]: kubelet.service: Consumed 2.745s CPU time.
Nov 04 02:16:06.348754 ip-10-0-130-155 systemd[1]: Starting Kubernetes Kubelet...
Nov 04 02:16:06.428295 ip-10-0-130-155 kubenswrapper[4548]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 02:16:06.428295 ip-10-0-130-155 kubenswrapper[4548]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Nov 04 02:16:06.428295 ip-10-0-130-155 kubenswrapper[4548]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 02:16:06.428295 ip-10-0-130-155 kubenswrapper[4548]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Nov 04 02:16:06.430799 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430698    4548 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:06.430799 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430793    4548 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:06.430799 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430801    4548 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:06.430799 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430806    4548 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430812    4548 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430816    4548 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430820    4548 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430823    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430827    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430831    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430836    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430839    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430843    4548 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430855    4548 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430861    4548 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430865    4548 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430870    4548 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430874    4548 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430878    4548 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430882    4548 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430886    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430890    4548 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:06.431086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430894    4548 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430898    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430902    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430906    4548 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430911    4548 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430915    4548 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430919    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430922    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430927    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430931    4548 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430935    4548 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430939    4548 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430943    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430946    4548 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430950    4548 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430954    4548 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430959    4548 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430963    4548 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430967    4548 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:06.431918 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430972    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430978    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430983    4548 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430987    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430991    4548 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430995    4548 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.430999    4548 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431004    4548 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431008    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431012    4548 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431016    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431020    4548 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431025    4548 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431029    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431033    4548 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431037    4548 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431041    4548 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431046    4548 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431050    4548 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:06.432756 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431054    4548 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431058    4548 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431063    4548 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431067    4548 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431071    4548 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431076    4548 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431080    4548 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431083    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431090    4548 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431094    4548 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431098    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431103    4548 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431107    4548 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431111    4548 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431116    4548 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431121    4548 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431126    4548 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431130    4548 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431134    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431139    4548 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:06.433616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431144    4548 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431148    4548 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431152    4548 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431157    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431162    4548 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431187    4548 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431192    4548 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431197    4548 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431201    4548 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431205    4548 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431209    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431213    4548 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431218    4548 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431222    4548 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431227    4548 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431231    4548 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431235    4548 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431240    4548 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431244    4548 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431248    4548 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:06.434577 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431253    4548 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431258    4548 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431262    4548 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431267    4548 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431271    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.431279    4548 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432690    4548 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432703    4548 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432709    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432714    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432720    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432725    4548 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432733    4548 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432739    4548 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432744    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432748    4548 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432753    4548 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432757    4548 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432761    4548 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:06.435509 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432765    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432769    4548 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432773    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432777    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432781    4548 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432785    4548 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432789    4548 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432793    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432798    4548 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432802    4548 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432807    4548 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432811    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432815    4548 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432820    4548 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432824    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432829    4548 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432833    4548 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432838    4548 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432842    4548 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432846    4548 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:06.436369 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432850    4548 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432855    4548 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432868    4548 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432872    4548 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432877    4548 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432881    4548 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432886    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432890    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432894    4548 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432898    4548 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432903    4548 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432907    4548 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432911    4548 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432915    4548 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432919    4548 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432923    4548 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432927    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432931    4548 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432936    4548 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432940    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:06.437285 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432944    4548 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432948    4548 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432952    4548 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432956    4548 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432961    4548 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432965    4548 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432969    4548 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432974    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432978    4548 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432982    4548 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432989    4548 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.432996    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433000    4548 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433005    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433009    4548 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433018    4548 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433023    4548 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433028    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433032    4548 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:06.438006 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433036    4548 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433040    4548 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433044    4548 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433048    4548 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433052    4548 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433057    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433061    4548 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433065    4548 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433069    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433073    4548 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433077    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433081    4548 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433085    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433089    4548 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433093    4548 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433098    4548 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433103    4548 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433112    4548 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433116    4548 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433120    4548 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:06.438529 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433124    4548 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433129    4548 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433133    4548 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433141    4548 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433146    4548 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433150    4548 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433155    4548 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433161    4548 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433185    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433191    4548 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433194    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433199    4548 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433202    4548 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.433207    4548 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434148    4548 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434159    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434184    4548 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434189    4548 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434193    4548 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:06.439015 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434198    4548 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434204    4548 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434211    4548 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434216    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434220    4548 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434224    4548 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434229    4548 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434233    4548 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434238    4548 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434242    4548 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434249    4548 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434253    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434258    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434262    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434266    4548 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434270    4548 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434275    4548 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434279    4548 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434284    4548 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:06.439501 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434288    4548 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:06.440023 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434292    4548 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:06.440023 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434299    4548 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:06.440023 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434315    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:06.440023 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434323    4548 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:06.440023 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434330    4548 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:06.440023 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434335    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:06.440023 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434340    4548 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:06.440023 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434344    4548 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:06.440023 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434349    4548 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:06.440023 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434353    4548 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:06.440023 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434357    4548 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:06.440023 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434361    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:06.440023 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434366    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:06.440023 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434370    4548 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:06.440023 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434374    4548 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:06.440023 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434378    4548 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:06.440023 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434383    4548 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:06.440023 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434387    4548 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434391    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434396    4548 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434400    4548 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434406    4548 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434414    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434418    4548 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434423    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434427    4548 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434431    4548 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434436    4548 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434440    4548 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434444    4548 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434449    4548 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434453    4548 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434458    4548 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434462    4548 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434466    4548 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434481    4548 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434486    4548 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:06.440489 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434490    4548 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434494    4548 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434499    4548 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434503    4548 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434507    4548 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434511    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434515    4548 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434519    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434523    4548 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434527    4548 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434531    4548 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434536    4548 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434540    4548 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434545    4548 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434549    4548 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434554    4548 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434559    4548 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434564    4548 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434569    4548 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434573    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:06.441125 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434577    4548 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434581    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434584    4548 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434588    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434592    4548 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434596    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434600    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434604    4548 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434608    4548 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434612    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434616    4548 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434629    4548 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434634    4548 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434638    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434642    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434646    4548 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434653    4548 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434660    4548 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434664    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434668    4548 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:06.441717 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434672    4548 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434676    4548 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434681    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.434685    4548 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434835    4548 flags.go:64] FLAG: --address="0.0.0.0"
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434853    4548 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434862    4548 flags.go:64] FLAG: --anonymous-auth="true"
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434870    4548 flags.go:64] FLAG: --application-metrics-count-limit="100"
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434877    4548 flags.go:64] FLAG: --authentication-token-webhook="false"
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434883    4548 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434890    4548 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434903    4548 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434908    4548 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434913    4548 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434919    4548 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434924    4548 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434929    4548 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434934    4548 flags.go:64] FLAG: --cgroup-root=""
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434939    4548 flags.go:64] FLAG: --cgroups-per-qos="true"
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434944    4548 flags.go:64] FLAG: --client-ca-file=""
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434948    4548 flags.go:64] FLAG: --cloud-provider="external"
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434953    4548 flags.go:64] FLAG: --cluster-dns="[]"
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434965    4548 flags.go:64] FLAG: --cluster-domain=""
Nov 04 02:16:06.442356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434969    4548 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434983    4548 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434989    4548 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.434994    4548 flags.go:64] FLAG: --container-log-max-files="5"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435001    4548 flags.go:64] FLAG: --container-log-max-size="10Mi"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435008    4548 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435013    4548 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435018    4548 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435023    4548 flags.go:64] FLAG: --contention-profiling="false"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435028    4548 flags.go:64] FLAG: --cpu-cfs-quota="true"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435041    4548 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435046    4548 flags.go:64] FLAG: --cpu-manager-policy="none"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435051    4548 flags.go:64] FLAG: --cpu-manager-policy-options=""
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435058    4548 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435062    4548 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435067    4548 flags.go:64] FLAG: --enable-debugging-handlers="true"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435072    4548 flags.go:64] FLAG: --enable-load-reader="false"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435077    4548 flags.go:64] FLAG: --enable-server="true"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435082    4548 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435092    4548 flags.go:64] FLAG: --event-burst="100"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435097    4548 flags.go:64] FLAG: --event-qps="50"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435102    4548 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435107    4548 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435112    4548 flags.go:64] FLAG: --eviction-hard=""
Nov 04 02:16:06.442941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435119    4548 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435124    4548 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435129    4548 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435134    4548 flags.go:64] FLAG: --eviction-soft=""
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435138    4548 flags.go:64] FLAG: --eviction-soft-grace-period=""
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435143    4548 flags.go:64] FLAG: --exit-on-lock-contention="false"
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435148    4548 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435153    4548 flags.go:64] FLAG: --experimental-mounter-path=""
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435158    4548 flags.go:64] FLAG: --fail-cgroupv1="true"
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435162    4548 flags.go:64] FLAG: --fail-swap-on="true"
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435199    4548 flags.go:64] FLAG: --feature-gates=""
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435206    4548 flags.go:64] FLAG: --file-check-frequency="20s"
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435210    4548 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435218    4548 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435223    4548 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435228    4548 flags.go:64] FLAG: --healthz-port="10248"
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435233    4548 flags.go:64] FLAG: --help="false"
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435237    4548 flags.go:64] FLAG: --hostname-override="ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435243    4548 flags.go:64] FLAG: --housekeeping-interval="10s"
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435248    4548 flags.go:64] FLAG: --http-check-frequency="20s"
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435253    4548 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435259    4548 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435264    4548 flags.go:64] FLAG: --image-gc-high-threshold="85"
Nov 04 02:16:06.443931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435269    4548 flags.go:64] FLAG: --image-gc-low-threshold="80"
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435274    4548 flags.go:64] FLAG: --image-service-endpoint=""
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435279    4548 flags.go:64] FLAG: --kernel-memcg-notification="false"
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435283    4548 flags.go:64] FLAG: --kube-api-burst="100"
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435288    4548 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435293    4548 flags.go:64] FLAG: --kube-api-qps="50"
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435298    4548 flags.go:64] FLAG: --kube-reserved=""
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435303    4548 flags.go:64] FLAG: --kube-reserved-cgroup=""
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435307    4548 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435312    4548 flags.go:64] FLAG: --kubelet-cgroups=""
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435317    4548 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435322    4548 flags.go:64] FLAG: --lock-file=""
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435326    4548 flags.go:64] FLAG: --log-cadvisor-usage="false"
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435331    4548 flags.go:64] FLAG: --log-flush-frequency="5s"
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435337    4548 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435347    4548 flags.go:64] FLAG: --log-json-split-stream="false"
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435352    4548 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435365    4548 flags.go:64] FLAG: --log-text-split-stream="false"
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435370    4548 flags.go:64] FLAG: --logging-format="text"
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435374    4548 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435389    4548 flags.go:64] FLAG: --make-iptables-util-chains="true"
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435394    4548 flags.go:64] FLAG: --manifest-url=""
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435401    4548 flags.go:64] FLAG: --manifest-url-header=""
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435409    4548 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435414    4548 flags.go:64] FLAG: --max-open-files="1000000"
Nov 04 02:16:06.444647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435420    4548 flags.go:64] FLAG: --max-pods="110"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435425    4548 flags.go:64] FLAG: --maximum-dead-containers="-1"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435430    4548 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435435    4548 flags.go:64] FLAG: --memory-manager-policy="None"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435440    4548 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435445    4548 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435449    4548 flags.go:64] FLAG: --node-ip="0.0.0.0"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435454    4548 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435466    4548 flags.go:64] FLAG: --node-status-max-images="50"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435471    4548 flags.go:64] FLAG: --node-status-update-frequency="10s"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435477    4548 flags.go:64] FLAG: --oom-score-adj="-999"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435482    4548 flags.go:64] FLAG: --pod-cidr=""
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435487    4548 flags.go:64] FLAG: --pod-manifest-path=""
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435491    4548 flags.go:64] FLAG: --pod-max-pids="-1"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435496    4548 flags.go:64] FLAG: --pods-per-core="0"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435500    4548 flags.go:64] FLAG: --port="10250"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435505    4548 flags.go:64] FLAG: --protect-kernel-defaults="false"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435509    4548 flags.go:64] FLAG: --provider-id="aws:///us-west-2a/i-0baaeaf15c4ff4778"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435515    4548 flags.go:64] FLAG: --qos-reserved=""
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435519    4548 flags.go:64] FLAG: --read-only-port="10255"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435524    4548 flags.go:64] FLAG: --register-node="true"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435529    4548 flags.go:64] FLAG: --register-with-taints=""
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435536    4548 flags.go:64] FLAG: --registry-burst="10"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435540    4548 flags.go:64] FLAG: --registry-qps="5"
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435544    4548 flags.go:64] FLAG: --reserved-cpus=""
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435606    4548 flags.go:64] FLAG: --reserved-memory=""
Nov 04 02:16:06.445519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435615    4548 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435620    4548 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435634    4548 flags.go:64] FLAG: --rotate-certificates="false"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435640    4548 flags.go:64] FLAG: --rotate-server-certificates="false"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435647    4548 flags.go:64] FLAG: --runonce="false"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435651    4548 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435656    4548 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435661    4548 flags.go:64] FLAG: --seccomp-default="false"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435666    4548 flags.go:64] FLAG: --serialize-image-pulls="true"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435673    4548 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435683    4548 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435688    4548 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435693    4548 flags.go:64] FLAG: --storage-driver-password="root"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435698    4548 flags.go:64] FLAG: --storage-driver-secure="false"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435703    4548 flags.go:64] FLAG: --storage-driver-table="stats"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435708    4548 flags.go:64] FLAG: --storage-driver-user="root"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435713    4548 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435718    4548 flags.go:64] FLAG: --sync-frequency="1m0s"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435723    4548 flags.go:64] FLAG: --system-cgroups=""
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435728    4548 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435737    4548 flags.go:64] FLAG: --system-reserved-cgroup=""
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435742    4548 flags.go:64] FLAG: --tls-cert-file=""
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435747    4548 flags.go:64] FLAG: --tls-cipher-suites="[]"
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435759    4548 flags.go:64] FLAG: --tls-min-version=""
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435765    4548 flags.go:64] FLAG: --tls-private-key-file=""
Nov 04 02:16:06.446141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435769    4548 flags.go:64] FLAG: --topology-manager-policy="none"
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435774    4548 flags.go:64] FLAG: --topology-manager-policy-options=""
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435779    4548 flags.go:64] FLAG: --topology-manager-scope="container"
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435783    4548 flags.go:64] FLAG: --v="2"
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435791    4548 flags.go:64] FLAG: --version="false"
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435798    4548 flags.go:64] FLAG: --vmodule=""
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435805    4548 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.435811    4548 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436105    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436114    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436126    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436134    4548 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436139    4548 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436144    4548 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436148    4548 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436152    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436158    4548 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436162    4548 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436187    4548 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436192    4548 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436195    4548 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:06.446776 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436200    4548 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436204    4548 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436208    4548 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436213    4548 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436217    4548 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436221    4548 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436225    4548 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436230    4548 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436234    4548 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436238    4548 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436242    4548 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436246    4548 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436251    4548 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436255    4548 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436259    4548 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436263    4548 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436267    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436271    4548 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436275    4548 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436279    4548 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:06.447305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436284    4548 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436288    4548 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436303    4548 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436308    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436312    4548 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436319    4548 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436325    4548 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436332    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436337    4548 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436341    4548 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436345    4548 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436349    4548 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436353    4548 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436358    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436363    4548 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436367    4548 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436371    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436376    4548 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436380    4548 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:06.447774 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436384    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436387    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436391    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436395    4548 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436399    4548 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436403    4548 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436408    4548 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436412    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436417    4548 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436421    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436425    4548 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436429    4548 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436434    4548 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436438    4548 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436442    4548 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436449    4548 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436462    4548 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436467    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436471    4548 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:06.448266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436476    4548 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436482    4548 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436486    4548 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436491    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436495    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436499    4548 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436503    4548 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436507    4548 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436512    4548 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436516    4548 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436520    4548 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436524    4548 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436528    4548 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436533    4548 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436537    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436541    4548 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436545    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436549    4548 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436554    4548 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:06.448927 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436558    4548 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:06.449673 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436562    4548 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:06.449673 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436566    4548 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:06.449673 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436570    4548 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:06.449673 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436574    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:06.449673 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436578    4548 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:06.449673 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436583    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:06.449673 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436587    4548 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:06.449673 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436593    4548 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:06.449673 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436601    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:06.449673 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436605    4548 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:06.449673 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436620    4548 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:06.449673 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436625    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:06.449673 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436629    4548 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:06.449673 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436636    4548 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:06.449673 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436640    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:06.450118 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.436687    4548 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 02:16:06.450118 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436760    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:06.450118 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436768    4548 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:06.450118 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436773    4548 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:06.450118 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436779    4548 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:06.450118 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436783    4548 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:06.450118 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436788    4548 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:06.450118 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436792    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:06.450118 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436797    4548 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:06.450118 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436801    4548 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:06.450118 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436805    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:06.450118 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436810    4548 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:06.450118 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436814    4548 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:06.450118 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436819    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:06.450118 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436823    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:06.450118 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436827    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436831    4548 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436836    4548 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436841    4548 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436845    4548 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436849    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436854    4548 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436858    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436862    4548 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436866    4548 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436873    4548 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436877    4548 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436882    4548 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436894    4548 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436898    4548 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436903    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436910    4548 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436914    4548 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436918    4548 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:06.450547 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436923    4548 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436927    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436931    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436936    4548 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436940    4548 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436944    4548 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436948    4548 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436953    4548 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436957    4548 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436961    4548 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436965    4548 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436970    4548 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436974    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436978    4548 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436982    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436986    4548 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436990    4548 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436994    4548 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.436998    4548 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:06.451013 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437002    4548 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437007    4548 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437011    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437015    4548 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437021    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437026    4548 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437033    4548 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437047    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437060    4548 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437065    4548 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437072    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437076    4548 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437080    4548 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437084    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437088    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437093    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437097    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437101    4548 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437105    4548 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:06.451514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437109    4548 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437113    4548 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437117    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437122    4548 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437126    4548 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437130    4548 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437134    4548 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437138    4548 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437143    4548 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437147    4548 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437151    4548 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437155    4548 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437159    4548 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437163    4548 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437186    4548 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437191    4548 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437195    4548 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437202    4548 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437206    4548 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437210    4548 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:06.452086 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437215    4548 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437219    4548 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437231    4548 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437237    4548 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437242    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437246    4548 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437250    4548 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437255    4548 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437259    4548 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437263    4548 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437267    4548 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437271    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437276    4548 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437284    4548 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.437290    4548 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.442026    4548 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.442057    4548 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.442081    4548 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.442087    4548 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Nov 04 02:16:06.452781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442204    4548 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442211    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442215    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442219    4548 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442222    4548 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442225    4548 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442228    4548 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442231    4548 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442234    4548 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442237    4548 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442240    4548 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442243    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442245    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442248    4548 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442251    4548 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442255    4548 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442259    4548 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442263    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442267    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:06.453299 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442270    4548 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442273    4548 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442275    4548 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442278    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442280    4548 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442283    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442286    4548 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442290    4548 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442293    4548 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442296    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442299    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442301    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442304    4548 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442307    4548 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442310    4548 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442313    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442316    4548 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442318    4548 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442321    4548 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442323    4548 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:06.453781 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442326    4548 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442329    4548 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442332    4548 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442335    4548 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442337    4548 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442340    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442343    4548 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442345    4548 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442348    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442350    4548 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442353    4548 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442357    4548 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442360    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442364    4548 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442367    4548 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442370    4548 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442373    4548 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442376    4548 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442379    4548 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442381    4548 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:06.454290 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442385    4548 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442388    4548 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442391    4548 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442393    4548 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442396    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442399    4548 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442402    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442405    4548 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442407    4548 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442410    4548 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442413    4548 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442415    4548 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442418    4548 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442421    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442424    4548 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442426    4548 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442429    4548 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442431    4548 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442434    4548 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442436    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:06.454801 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442439    4548 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442441    4548 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442444    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442446    4548 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442449    4548 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442452    4548 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442454    4548 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442457    4548 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442459    4548 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442461    4548 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442464    4548 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442466    4548 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442469    4548 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442473    4548 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442477    4548 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442481    4548 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442484    4548 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442487    4548 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442490    4548 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:06.455344 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442493    4548 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:06.455804 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442495    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:06.455804 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442498    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:06.455804 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442500    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:06.455804 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442503    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:06.455804 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442506    4548 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:06.455804 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442509    4548 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:06.455804 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442512    4548 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:06.455804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.442542    4548 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 02:16:06.455804 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442709    4548 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:06.455804 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442714    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:06.455804 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442717    4548 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:06.455804 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442720    4548 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:06.455804 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442723    4548 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:06.455804 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442726    4548 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:06.455804 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442728    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442730    4548 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442733    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442736    4548 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442738    4548 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442741    4548 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442743    4548 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442746    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442748    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442751    4548 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442753    4548 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442756    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442760    4548 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442762    4548 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442766    4548 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442769    4548 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442772    4548 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442775    4548 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442777    4548 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:06.456197 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442780    4548 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442782    4548 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442784    4548 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442787    4548 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442790    4548 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442793    4548 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442795    4548 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442798    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442800    4548 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442803    4548 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442805    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442807    4548 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442810    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442812    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442815    4548 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442817    4548 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442819    4548 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442822    4548 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442824    4548 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442827    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:06.456704 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442829    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442832    4548 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442834    4548 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442836    4548 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442843    4548 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442845    4548 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442848    4548 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442851    4548 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442854    4548 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442856    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442859    4548 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442861    4548 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442864    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442866    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442869    4548 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442871    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442874    4548 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442876    4548 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442879    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:06.457192 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442881    4548 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442884    4548 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442886    4548 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442889    4548 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442891    4548 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442894    4548 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442896    4548 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442899    4548 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442901    4548 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442904    4548 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442906    4548 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442909    4548 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442911    4548 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442914    4548 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442916    4548 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442919    4548 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442921    4548 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442925    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442928    4548 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442931    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:06.457740 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.442987    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443039    4548 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443104    4548 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443109    4548 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443113    4548 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443117    4548 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443120    4548 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443124    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443127    4548 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443129    4548 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443132    4548 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443136    4548 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443138    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443145    4548 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443150    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443154    4548 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443159    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443162    4548 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443165    4548 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443184    4548 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:06.458432 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443187    4548 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:06.459040 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443190    4548 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:06.459040 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.443239    4548 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Nov 04 02:16:06.459040 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443376    4548 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Nov 04 02:16:06.459040 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443405    4548 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Nov 04 02:16:06.459040 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443411    4548 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Nov 04 02:16:06.459040 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443416    4548 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Nov 04 02:16:06.459040 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443421    4548 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Nov 04 02:16:06.459040 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443425    4548 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Nov 04 02:16:06.459040 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443430    4548 feature_gate.go:386] unrecognized feature gate: Example
Nov 04 02:16:06.459040 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443436    4548 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Nov 04 02:16:06.459040 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443446    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Nov 04 02:16:06.459040 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443450    4548 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Nov 04 02:16:06.459040 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443456    4548 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Nov 04 02:16:06.459040 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443461    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Nov 04 02:16:06.459040 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443465    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443469    4548 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443474    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443479    4548 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443483    4548 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443487    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443491    4548 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443495    4548 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443504    4548 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443508    4548 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443512    4548 feature_gate.go:386] unrecognized feature gate: OSStreams
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443516    4548 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443520    4548 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443524    4548 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443528    4548 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443532    4548 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443536    4548 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443540    4548 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443545    4548 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443550    4548 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Nov 04 02:16:06.459536 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443555    4548 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443564    4548 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443568    4548 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443573    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443579    4548 feature_gate.go:386] unrecognized feature gate: Example2
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443583    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443588    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443594    4548 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443599    4548 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443608    4548 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443615    4548 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443622    4548 feature_gate.go:386] unrecognized feature gate: EventTTL
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443627    4548 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443640    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443645    4548 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443652    4548 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443656    4548 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443661    4548 feature_gate.go:386] unrecognized feature gate: SignatureStores
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443667    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443671    4548 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Nov 04 02:16:06.460233 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443679    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443683    4548 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443688    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443692    4548 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443699    4548 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443704    4548 feature_gate.go:386] unrecognized feature gate: OVNObservability
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443712    4548 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443717    4548 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443721    4548 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443726    4548 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443730    4548 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443736    4548 feature_gate.go:386] unrecognized feature gate: DualReplica
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443743    4548 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443747    4548 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443751    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443755    4548 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443760    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443764    4548 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443773    4548 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Nov 04 02:16:06.460840 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443778    4548 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443783    4548 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443787    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443791    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443795    4548 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443801    4548 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443806    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443810    4548 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443814    4548 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443821    4548 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443827    4548 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443838    4548 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443843    4548 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443848    4548 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443852    4548 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443857    4548 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443861    4548 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443869    4548 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443873    4548 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Nov 04 02:16:06.461337 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443877    4548 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443883    4548 feature_gate.go:386] unrecognized feature gate: NewOLM
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443887    4548 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443891    4548 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443900    4548 feature_gate.go:386] unrecognized feature gate: EVPN
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443904    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443908    4548 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443913    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443917    4548 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443921    4548 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443925    4548 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443929    4548 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443934    4548 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443938    4548 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443943    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:06.443947    4548 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.444072    4548 server.go:957] "Client rotation is on, will bootstrap in background"
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.445626    4548 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.445691    4548 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Nov 04 02:16:06.461788 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.445888    4548 server.go:1014] "Starting client certificate rotation"
Nov 04 02:16:06.462306 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.446029    4548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Nov 04 02:16:06.462306 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.446095    4548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-11-03 02:10:26 +0000 UTC" deadline="2028-04-01 07:21:23.493531716 +0000 UTC"
Nov 04 02:16:06.462306 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.446142    4548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12341h5m17.047392826s"
Nov 04 02:16:06.462306 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.446520    4548 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 02:16:06.462306 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.447746    4548 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Nov 04 02:16:06.462306 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.449619    4548 log.go:25] "Validated CRI v1 runtime API"
Nov 04 02:16:06.462306 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.451425    4548 log.go:25] "Validated CRI v1 image API"
Nov 04 02:16:06.462306 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.452276    4548 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Nov 04 02:16:06.462306 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.454053    4548 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c764da64-b959-48da-933c-8d569e467107:/dev/nvme0n1p3 cdaf79f0-570b-4f42-a377-057edcde3337:/dev/nvme0n1p4]
Nov 04 02:16:06.462556 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.454075    4548 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/0ee725add4802cd03fac36d508302a41012caa57a9abb3349c9950fc636c7153/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/0ee725add4802cd03fac36d508302a41012caa57a9abb3349c9950fc636c7153/userdata/shm major:0 minor:85 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/11aa6181157b0231250680c37f0cf1a4c6c01e071842a682e7033051a287700f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/11aa6181157b0231250680c37f0cf1a4c6c01e071842a682e7033051a287700f/userdata/shm major:0 minor:60 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/2d13a81d96656dba5daf933efa305814c877a843604250d4f5093e91ea838694/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/2d13a81d96656dba5daf933efa305814c877a843604250d4f5093e91ea838694/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/36408e7cec42b9a6291aec28700cf2e21c8c17077f0839cb322d0c002168a0b6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/36408e7cec42b9a6291aec28700cf2e21c8c17077f0839cb322d0c002168a0b6/userdata/shm major:0 minor:219 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/705b26ce00961ec61a7f17adbf7b003d3a0f3d163c372fc595f081a6824c6d49/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/705b26ce00961ec61a7f17adbf7b003d3a0f3d163c372fc595f081a6824c6d49/userdata/shm major:0 minor:98 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/95ff0c1982cbc2d853c60401c9a72afcc89905c6b2b095e61a9d9a47f550e443/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/95ff0c1982cbc2d853c60401c9a72afcc89905c6b2b095e61a9d9a47f550e443/userdata/shm major:0 minor:202 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9827fde1cf67bd10d3cff68fac876a2d37a4617674f2322be57e670b23b2e517/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9827fde1cf67bd10d3cff68fac876a2d37a4617674f2322be57e670b23b2e517/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/aabdd754b83e0e6b30e10f6ca64430f5bed1bbed13530c0a5d6aa2e88cd915cf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/aabdd754b83e0e6b30e10f6ca64430f5bed1bbed13530c0a5d6aa2e88cd915cf/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/aefa3736ae5c3f8459ab885f57984b1a8e272ab49d18f66ef383aa1cf0e6eb1d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/aefa3736ae5c3f8459ab885f57984b1a8e272ab49d18f66ef383aa1cf0e6eb1d/userdata/shm major:0 minor:227 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/bda92b0002df125ba344b3a6e05bfa2bef67825807ef59bbb91312db54cc4840/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/bda92b0002df125ba344b3a6e05bfa2bef67825807ef59bbb91312db54cc4840/userdata/shm major:0 minor:214 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d3af22634479af94b404ec25f707662f48024cbfb2fbe378a7b5fb637a6c6169/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d3af22634479af94b404ec25f707662f48024cbfb2fbe378a7b5fb637a6c6169/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d4cc6683d698401b6c71c09b24ccec01c6756c6fc4fd92c851756075728d9d1d/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d4cc6683d698401b6c71c09b24ccec01c6756c6fc4fd92c851756075728d9d1d/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e04aa035b00b4597b08d301b9677eb7cb22fb1edc0608b668c7a2da15b900ddd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e04aa035b00b4597b08d301b9677eb7cb22fb1edc0608b668c7a2da15b900ddd/userdata/shm major:0 minor:73 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f030ce167352a9f7a335fe578f34426ee747ba66efa8cd5fc5ff6cdb5f16b1cf/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f030ce167352a9f7a335fe578f34426ee747ba66efa8cd5fc5ff6cdb5f16b1cf/userdata/shm major:0 minor:212 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ff699ad09e7c5838ed8aa74b94e8d6dbebc360acd6aeb5fd71a84f93e88944e9/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ff699ad09e7c5838ed8aa74b94e8d6dbebc360acd6aeb5fd71a84f93e88944e9/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/ffa5f598651b47d776ee78e53f09d7bb129dd19dd347b9b0e4e5ccb6a789c326/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/ffa5f598651b47d776ee78e53f09d7bb129dd19dd347b9b0e4e5ccb6a789c326/userdata/shm major:0 minor:64 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/13b8bca5-57ac-42c5-a5fe-a87a2a0ff775/volumes/kubernetes.io~projected/kube-api-access-tp6gp:{mountpoint:/var/lib/kubelet/pods/13b8bca5-57ac-42c5-a5fe-a87a2a0ff775/volumes/kubernetes.io~projected/kube-api-access-tp6gp major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/13b8bca5-57ac-42c5-a5fe-a87a2a0ff775/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/13b8bca5-57ac-42c5-a5fe-a87a2a0ff775/volumes/kubernetes.io~secret/cert major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1e86306b-74a7-4f2f-84fa-0e297b78c7aa/volumes/kubernetes.io~projected/kube-api-access-f6klz:{mountpoint:/var/lib/kubelet/pods/1e86306b-74a7-4f2f-84fa-0e297b78c7aa/volumes/kubernetes.io~projected/kube-api-access-f6klz major:0 minor:54 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d0d738a-4b36-416e-bf3b-3411b084ee41/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/2d0d738a-4b36-416e-bf3b-3411b084ee41/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:48 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d0d738a-4b36-416e-bf3b-3411b084ee41/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/2d0d738a-4b36-416e-bf3b-3411b084ee41/volumes/kubernetes.io~empty-dir/tmp major:0 minor:49 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/2d0d738a-4b36-416e-bf3b-3411b084ee41/volumes/kubernetes.io~projected/kube-api-access-mmq8d:{mountpoint:/var/lib/kubelet/pods/2d0d738a-4b36-416e-bf3b-3411b084ee41/volumes/kubernetes.io~projected/kube-api-access-mmq8d major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4bcbd86c-05d7-4132-8e50-c79c54ba683f/volumes/kubernetes.io~projected/kube-api-access-k7rqb:{mountpoint:/var/lib/kubelet/pods/4bcbd86c-05d7-4132-8e50-c79c54ba683f/volumes/kubernetes.io~projected/kube-api-access-k7rqb major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95/volumes/kubernetes.io~projected/kube-api-access-fl4lf:{mountpoint:/var/lib/kubelet/pods/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95/volumes/kubernetes.io~projected/kube-api-access-fl4lf major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4f046171-a465-4614-b723-dd243a083530/volumes/kubernetes.io~projected/kube-api-access-fjl9k:{mountpoint:/var/lib/kubelet/pods/4f046171-a465-4614-b723-dd243a083530/volumes/kubernetes.io~projected/kube-api-access-fjl9k major:0 minor:226 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/4f046171-a465-4614-b723-dd243a083530/volumes/kubernetes.io~secret/signing-key:{mountpoint:/var/lib/kubelet/pods/4f046171-a465-4614-b723-dd243a083530/volumes/kubernetes.io~secret/signing-key major:0 minor:225 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/50068ac4-0a6a-48ca-84dd-611fc3a87b65/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/50068ac4-0a6a-48ca-84dd-611fc3a87b65/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/50068ac4-0a6a-48ca-84dd-611fc3a87b65/volumes/kubernetes.io~projected/kube-api-access-rg2cw:{mountpoint:/var/lib/kubelet/pods/50068ac4-0a6a-48ca-84dd-611fc3a87b65/volumes/kubernetes.io~projected/kube-api-access-rg2cw major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/50068ac4-0a6a-48ca-84dd-611fc3a87b65/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/50068ac4-0a6a-48ca-84dd-611fc3a87b65/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:47 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/545569f5-aa5b-4b5b-bd9b-bf886ac96bd7/volumes/kubernetes.io~projected/kube-api-access-mhz2q:{mountpoint:/var/lib/kubelet/pods/545569f5-aa5b-4b5b-bd9b-bf886ac96bd7/volumes/kubernetes.io~projected/kube-api-access-mhz2q major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7a5c331c-c911-474a-b893-f39e9285a677/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/7a5c331c-c911-474a-b893-f39e9285a677/volumes/kubernetes.io~secret/agent-certs major:0 minor:50 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/9813e2dc-dbcb-4166-bd17-62eb60ced426/volumes/kubernetes.io~projected/kube-api-access-j8hsx:{mountpoint:/var/lib/kubelet/pods/9813e2dc-dbcb-4166-bd17-62eb60ced426/volumes/kubernetes.io~projected/kube-api-access-j8hsx major:0 minor:51 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/ae0be1c5-e730-4d02-84d7-f66a9666af87/volumes/kubernetes.io~projected/kube-api-access-dzl2p:{mountpoint:/var/lib/kubelet/pods/ae0be1c5-e730-4d02-84d7-f66a9666af87/volumes/kubernetes.io~projected/kube-api-access-dzl2p major:0 minor:210 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5/volumes/kubernetes.io~projected/kube-api-access-s6qzt:{mountpoint:/var/lib/kubelet/pods/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5/volumes/kubernetes.io~projected/kube-api-access-s6qzt major:0 minor:218 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c36eb6b7-750c-49f0-a11d-5a168f75eb29/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/c36eb6b7-750c-49f0-a11d-5a168f75eb29/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:211 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cf87debc-dfe4-4dce-85f0-0ecab689c59d/volumes/kubernetes.io~projected/kube-api-access-nrx2h:{mountpoint:/var/lib/kubelet/pods/cf87debc-dfe4-4dce-85f0-0ecab689c59d/volumes/kubernetes.io~projected/kube-api-access-nrx2h major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/d3b93c5f-3df3-49d6-af5a-3d330ecc5318/volumes/kubernetes.io~projected/kube-api-access-96wdc:{mountpoint:/var/lib/kubelet/pods/d3b93c5f-3df3-49d6-af5a-3d330ecc5318/volumes/kubernetes.io~projected/kube-api-access-96wdc major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/db7921f7-4844-4111-9f43-6aa6eeccf9c6/volumes/kubernetes.io~projected/kube-api-access-kmb8q:{mountpoint:/var/lib/kubelet/pods/db7921f7-4844-4111-9f43-6aa6eeccf9c6/volumes/kubernetes.io~projected/kube-api-access-kmb8q major:0 minor:207 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fa9c7d67-d4ef-4900-873e-046523ea039e/volumes/kubernetes.io~projected/kube-api-access-m7z88:{mountpoint:/var/lib/kubelet/pods/fa9c7d67-d4ef-4900-873e-046523ea039e/volumes/kubernetes.io~projected/kube-api-access-m7z88 major:0 minor:53 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/fe7e4369-7004-46e9-9821-cf3e8628e4df/volumes/kubernetes.io~projected/kube-api-access-8lfmx:{mountpoint:/var/lib/kubelet/pods/fe7e4369-7004-46e9-9821-cf3e8628e4df/volumes/kubernetes.io~projected/kube-api-access-8lfmx major:0 minor:52 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/75d7f2cee3ff7952d77464b0a15d7798d69f982455d2117f5d89746e5098adf1/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/7f939cd344f3e18df5dbca97525be47389402eca5f7f03af31958c4dc1a9f580/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/cb5dd69f62dbc86a8267913742cc2e08dec31dafc9ef0ce34b42c060350c94e2/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-108:{mountpoint:/var/lib/containers/storage/overlay/cab6eeabcf828d92b5211c6c92467e2fa7b9fbd4dc20f3b23fd817e23e8e6be8/merged major:0 minor:108 fsType:overlay blockSize:0} overlay_0-114:{mountpoint:/var/lib/containers/storage/overlay/d07c487b2bfa5365e009bf6a7c7104554371ac1b05229b293ba3ce444769c88f/merged major:0 minor:114 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/ef1971c815cb13499bc38dd89beb6e515e4c546c0e21d628772ade8a091802c4/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/f43a52a7419f4a11062c503f54c151aa664e9390ceaa6908aa0a72367b2bb76e/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/9f56c770d2b2864ed328fa97da7b44531f1c3cfd9a45449cc2f4713024093484/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-129:{mountpoint:/var/lib/containers/storage/overlay/4e63fdbcb6d88fd06809eb68f2aa894be18037e398f6df957a3d59fd9eb5f7e3/merged major:0 minor:129 fsType:overlay blockSize:0} overlay_0-135:{mountpoint:/var/lib/containers/storage/overlay/15c69660ce43229711dade4aebc85e63311d032ee912f53599272efacb923f36/merged major:0 minor:135 fsType:overlay blockSize:0} overlay_0-138:{mountpoint:/var/lib/containers/storage/overlay/54f3d86cd90a1d6dd46050096af4f6be40f09352a3fd1027108f22f03436ce9b/merged major:0 minor:138 fsType:overlay blockSize:0} overlay_0-147:{mountpoint:/var/lib/containers/storage/overlay/e88127bed906b00d871f75ffd777cecbe8293509094049bbcf9e236a5f9b6d99/merged major:0 minor:147 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/8ae600ba857719bd1c90943006d1e6b79f60c19fbe41d3397c6f5bfb44985c9e/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/c7daa1d6f8b0b541e7a622c587e7dec7a1048f96e16ae3a8fe6b073ae4930a3b/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/eef68b34c4608943e495542aa37b66df79f5d3a84bde69a9cc2815ab7657ab3f/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-167:{mountpoint:/var/lib/containers/storage/overlay/3afafd97155a3df075e5e3b56f713346df3b1da550d236e3222b169639d3ab1f/merged major:0 minor:167 fsType:overlay blockSize:0} overlay_0-172:{mountpoint:/var/lib/containers/storage/overlay/e05bfbc4af4dee88e4682f5dade2b68639f1e716ddc9ded72441e11e7d31a5f2/merged major:0 minor:172 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/9a7d74d1305d3e30248202f425b8d9a0fd9ee9782751c6cdf6a5f35088723f53/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/18d74cb661a1fb3bab32ef9a46ca28ef7e28a7af648e1e5b5a63d6df0e815841/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/b3a8ddd53d99a5adef5f728ebe79e3f79bc1aefdb4ff99ae842444992e2ce42f/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/e3b6ef8fd0260c985d98fc981f16d02e37a07482800d9488611b53ffee3d2c79/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-208:{mountpoint:/var/lib/containers/storage/overlay/cab7672ce3197a30f77e6be921209aff86ad32d298d09f03607b56b1c58faad2/merged major:0 minor:208 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/3bbd4a5a87e6e25ffcaf8e694d2d5f8859beb727b2d6b810588cbe5867a26879/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-221:{mountpoint:/var/lib/containers/storage/overlay/7301de7cf211e2b879bdce4fa1b2ad58bbff6e7e741abb2b9f220983529c33cb/merged major:0 minor:221 fsType:overlay blockSize:0} overlay_0-223:{mountpoint:/var/lib/containers/storage/overlay/6d074f24fe27bd9558dfec391ebae2a5275c7baa870bf182ade8109fb43df572/merged major:0 minor:223 fsType:overlay blockSize:0} overlay_0-229:{mountpoint:/var/lib/containers/storage/overlay/62f18ed5d8738c033c635124acf37d8402a0d6c38e9bff9393852b1927abf3c9/merged major:0 minor:229 fsType:overlay blockSize:0} overlay_0-231:{mountpoint:/var/lib/containers/storage/overlay/fb153f7b3d62b2d9ca3c7a51fdc21d6ac1f172070a4e4e87923e6e422c3a7adf/merged major:0 minor:231 fsType:overlay blockSize:0} overlay_0-233:{mountpoint:/var/lib/containers/storage/overlay/e5631e2db61ffd7a47579f5336798ee072dc7833959ee46cfc9c4a791958857b/merged major:0 minor:233 fsType:overlay blockSize:0} overlay_0-235:{mountpoint:/var/lib/containers/storage/overlay/10a99ab87e9df5da155931d232837f2d6b97795cd46174c3cc521d82a2daeadd/merged major:0 minor:235 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/904f8280c1f968f69439a4029b9152f22d851f09af87bc2017d2cc0a58866886/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-247:{mountpoint:/var/lib/containers/storage/overlay/e39ea1b75a352c5168d323d5a4b3aff368e5c7be515b38fd4975cae72a68db50/merged major:0 minor:247 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/109a8b2c23475ad2384664e533345cca1b7c800a0c5c7ba63bfe1776b1991a7e/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-259:{mountpoint:/var/lib/containers/storage/overlay/7a58471f283c1d86f09240e7e865b17efde5ab69f9921fdbd500ceb0e0135a2d/merged major:0 minor:259 fsType:overlay blockSize:0} overlay_0-62:{mountpoint:/var/lib/containers/storage/overlay/dbabec1e7f8fe0a4c5a84f8a554acf7978bc6acdc3c1617257c9ee3157bdd6f1/merged major:0 minor:62 fsType:overlay blockSize:0} overlay_0-66:{mountpoint:/var/lib/containers/storage/overlay/007a7c1a4217d5715fbb5063b659eff13321acd7c2422ac840f7261e3a911755/merged major:0 minor:66 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/d5c8e85d40f75c5ee34d5e8c8c7047b5cae6cde0625049160e070266cbe3279d/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-75:{mountpoint:/var/lib/containers/storage/overlay/86ac25ebc1574968c2a0d149b51ed23e398df9c496e617664c82693c17b48bc0/merged major:0 minor:75 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/8f39636514a4d8a7030bd940b2f218b76696d2f89124acfb175730490c046069/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/fa5aba145e32cb77b9833b576743bbf95047ffc66805fa3e82d996fdb3444ea1/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-87:{mountpoint:/var/lib/containers/storage/overlay/369249517f0d96aceb07cbab9c256d4cfcbf76f126f3d09c11d71a1e6643898f/merged major:0 minor:87 fsType:overlay blockSize:0} overlay_0-89:{mountpoint:/var/lib/containers/storage/overlay/e6064236dd668a737875874e46e9921c298bbda2ed9ad770cc3dbf0fdd1d2948/merged major:0 minor:89 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/578fc43b0af90ac7410974037a4cad1c2e4a542e8ee64eaba23eaa47211d800d/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/85533e5ed01a95dc7def1c05c75bdc6c422fb42bd1f04e86f61afd4f17c6b649/merged major:0 minor:96 fsType:overlay blockSize:0}]
Nov 04 02:16:06.462702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.461265    4548 manager.go:217] Machine: {Timestamp:2026-11-04 02:16:06.460761341 +0000 UTC m=+0.065774329 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3138326 MemoryCapacity:32812015616 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25ce143c5843654258376515129b17 SystemUUID:ec25ce14-3c58-4365-4258-376515129b17 BootID:c00ddae0-cf3d-420c-833c-04f2560dd9da Filesystems:[{Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/d3b93c5f-3df3-49d6-af5a-3d330ecc5318/volumes/kubernetes.io~projected/kube-api-access-96wdc DeviceMajor:0 DeviceMinor:201 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f030ce167352a9f7a335fe578f34426ee747ba66efa8cd5fc5ff6cdb5f16b1cf/userdata/shm DeviceMajor:0 DeviceMinor:212 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16406007808 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/aabdd754b83e0e6b30e10f6ca64430f5bed1bbed13530c0a5d6aa2e88cd915cf/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/2d13a81d96656dba5daf933efa305814c877a843604250d4f5093e91ea838694/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/4f046171-a465-4614-b723-dd243a083530/volumes/kubernetes.io~projected/kube-api-access-fjl9k DeviceMajor:0 DeviceMinor:226 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ffa5f598651b47d776ee78e53f09d7bb129dd19dd347b9b0e4e5ccb6a789c326/userdata/shm DeviceMajor:0 DeviceMinor:64 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-235 DeviceMajor:0 DeviceMinor:235 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cf87debc-dfe4-4dce-85f0-0ecab689c59d/volumes/kubernetes.io~projected/kube-api-access-nrx2h DeviceMajor:0 DeviceMinor:56 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2d0d738a-4b36-416e-bf3b-3411b084ee41/volumes/kubernetes.io~projected/kube-api-access-mmq8d DeviceMajor:0 DeviceMinor:57 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5/volumes/kubernetes.io~projected/kube-api-access-s6qzt DeviceMajor:0 DeviceMinor:218 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/4f046171-a465-4614-b723-dd243a083530/volumes/kubernetes.io~secret/signing-key DeviceMajor:0 DeviceMinor:225 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16406007808 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/50068ac4-0a6a-48ca-84dd-611fc3a87b65/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:47 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/2d0d738a-4b36-416e-bf3b-3411b084ee41/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:49 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-75 DeviceMajor:0 DeviceMinor:75 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/bda92b0002df125ba344b3a6e05bfa2bef67825807ef59bbb91312db54cc4840/userdata/shm DeviceMajor:0 DeviceMinor:214 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-247 DeviceMajor:0 DeviceMinor:247 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/0ee725add4802cd03fac36d508302a41012caa57a9abb3349c9950fc636c7153/userdata/shm DeviceMajor:0 DeviceMinor:85 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-114 DeviceMajor:0 DeviceMinor:114 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-147 DeviceMajor:0 DeviceMinor:147 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-172 DeviceMajor:0 DeviceMinor:172 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/13b8bca5-57ac-42c5-a5fe-a87a2a0ff775/volumes/kubernetes.io~projected/kube-api-access-tp6gp DeviceMajor:0 DeviceMinor:197 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/c36eb6b7-750c-49f0-a11d-5a168f75eb29/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:211 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/ae0be1c5-e730-4d02-84d7-f66a9666af87/volumes/kubernetes.io~projected/kube-api-access-dzl2p DeviceMajor:0 DeviceMinor:210 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/50068ac4-0a6a-48ca-84dd-611fc3a87b65/volumes/kubernetes.io~projected/kube-api-access-rg2cw DeviceMajor:0 DeviceMinor:59 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/13b8bca5-57ac-42c5-a5fe-a87a2a0ff775/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:45 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95/volumes/kubernetes.io~projected/kube-api-access-fl4lf DeviceMajor:0 DeviceMinor:58 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-138 DeviceMajor:0 DeviceMinor:138 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/545569f5-aa5b-4b5b-bd9b-bf886ac96bd7/volumes/kubernetes.io~projected/kube-api-access-mhz2q DeviceMajor:0 DeviceMinor:204 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/aefa3736ae5c3f8459ab885f57984b1a8e272ab49d18f66ef383aa1cf0e6eb1d/userdata/shm DeviceMajor:0 DeviceMinor:227 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-229 DeviceMajor:0 DeviceMinor:229 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/2d0d738a-4b36-416e-bf3b-3411b084ee41/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:48 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/9813e2dc-dbcb-4166-bd17-62eb60ced426/volumes/kubernetes.io~projected/kube-api-access-j8hsx DeviceMajor:0 DeviceMinor:51 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-167 DeviceMajor:0 DeviceMinor:167 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/fa9c7d67-d4ef-4900-873e-046523ea039e/volumes/kubernetes.io~projected/kube-api-access-m7z88 DeviceMajor:0 DeviceMinor:53 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/1e86306b-74a7-4f2f-84fa-0e297b78c7aa/volumes/kubernetes.io~projected/kube-api-access-f6klz DeviceMajor:0 DeviceMinor:54 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d3af22634479af94b404ec25f707662f48024cbfb2fbe378a7b5fb637a6c6169/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/ff699ad09e7c5838ed8aa74b94e8d6dbebc360acd6aeb5fd71a84f93e88944e9/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/705b26ce00961ec61a7f17adbf7b003d3a0f3d163c372fc595f081a6824c6d49/userdata/shm DeviceMajor:0 DeviceMinor:98 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-221 DeviceMajor:0 DeviceMinor:221 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/11aa6181157b0231250680c37f0cf1a4c6c01e071842a682e7033051a287700f/userdata/shm DeviceMajor:0 DeviceMinor:60 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9827fde1cf67bd10d3cff68fac876a2d37a4617674f2322be57e670b23b2e517/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/95ff0c1982cbc2d853c60401c9a72afcc89905c6b2b095e61a9d9a47f550e443/userdata/shm DeviceMajor:0 DeviceMinor:202 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-208 DeviceMajor:0 DeviceMinor:208 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-223 DeviceMajor:0 DeviceMinor:223 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-89 DeviceMajor:0 DeviceMinor:89 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-108 DeviceMajor:0 DeviceMinor:108 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/50068ac4-0a6a-48ca-84dd-611fc3a87b65/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6562406400 Type:vfs Inodes:819200 HasInodes:true} {Device:/var/lib/kubelet/pods/fe7e4369-7004-46e9-9821-cf3e8628e4df/volumes/kubernetes.io~projected/kube-api-access-8lfmx DeviceMajor:0 DeviceMinor:52 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/var/lib/kubelet/pods/4bcbd86c-05d7-4132-8e50-c79c54ba683f/volumes/kubernetes.io~projected/kube-api-access-k7rqb DeviceMajor:0 DeviceMinor:55 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d4cc6683d698401b6c71c09b24ccec01c6756c6fc4fd92c851756075728d9d1d/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-135 DeviceMajor:0 DeviceMinor:135 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-231 DeviceMajor:0 DeviceMinor:231 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-259 DeviceMajor:0 DeviceMinor:259 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:overlay_0-62 DeviceMajor:0 DeviceMinor:62 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-129 DeviceMajor:0 DeviceMinor:129 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/db7921f7-4844-4111-9f43-6aa6eeccf9c6/volumes/kubernetes.io~projected/kube-api-access-kmb8q DeviceMajor:0 DeviceMinor:207 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:/run/containers/storage/overlay-containers/36408e7cec42b9a6291aec28700cf2e21c8c17077f0839cb322d0c002168a0b6/userdata/shm DeviceMajor:0 DeviceMinor:219 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-233 DeviceMajor:0 DeviceMinor:233 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7a5c331c-c911-474a-b893-f39e9285a677/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:50 Capacity:31633416192 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-66 DeviceMajor:0 DeviceMinor:66 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e04aa035b00b4597b08d301b9677eb7cb22fb1edc0608b668c7a2da15b900ddd/userdata/shm DeviceMajor:0 DeviceMinor:73 Capacity:67108864 Type:vfs Inodes:4005373 HasInodes:true} {Device:overlay_0-87 DeviceMajor:0 DeviceMinor:87 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:2d13a81d96656db MacAddress:f6:d3:fb:c5:aa:e9 Speed:10000 Mtu:8901} {Name:36408e7cec42b9a MacAddress:aa:91:6e:2e:fd:89 Speed:10000 Mtu:8901} {Name:95ff0c1982cbc2d MacAddress:56:76:60:e4:96:17 Speed:10000 Mtu:8901} {Name:aefa3736ae5c3f8 MacAddress:76:dd:5b:2f:ee:c9 Speed:10000 Mtu:8901} {Name:bda92b0002df125 MacAddress:b6:b4:99:04:da:74 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:06:ff:d0:84:b7:17 Speed:0 Mtu:9001} {Name:br-int MacAddress:a6:17:0f:a3:3b:1c Speed:0 Mtu:8901} {Name:ens5 MacAddress:06:ff:d0:84:b7:17 Speed:0 Mtu:9001} {Name:f030ce167352a9f MacAddress:2a:20:a4:4c:67:7f Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:5e:3f:b6:d1:77:9e Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:85:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:5e:70:ad:27:69:5f Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812015616 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Nov 04 02:16:06.462702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.461574    4548 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Nov 04 02:16:06.462702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.461624    4548 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Nov 04 02:16:06.462702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.461964    4548 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Nov 04 02:16:06.462702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.461989    4548 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-155.us-west-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Nov 04 02:16:06.462702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.462143    4548 topology_manager.go:143] "Creating topology manager with none policy"
Nov 04 02:16:06.462702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.462151    4548 container_manager_linux.go:311] "Creating device plugin manager"
Nov 04 02:16:06.462702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.462162    4548 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 02:16:06.462702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.462198    4548 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Nov 04 02:16:06.462702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.462310    4548 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Nov 04 02:16:06.462702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.462510    4548 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Nov 04 02:16:06.462702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.462651    4548 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Nov 04 02:16:06.462702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.462696    4548 kubelet.go:493] "Attempting to sync node with API server"
Nov 04 02:16:06.463295 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.462711    4548 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Nov 04 02:16:06.463295 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.462724    4548 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Nov 04 02:16:06.463295 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.462734    4548 kubelet.go:405] "Adding apiserver pod source"
Nov 04 02:16:06.463295 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.462742    4548 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Nov 04 02:16:06.465712 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.464964    4548 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 04 02:16:06.465712 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.464999    4548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 02:16:06.466281 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.466241    4548 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Nov 04 02:16:06.468409 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.468392    4548 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Nov 04 02:16:06.468409 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.468409    4548 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Nov 04 02:16:06.468561 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.468550    4548 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Nov 04 02:16:06.468760 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.468749    4548 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Nov 04 02:16:06.468794 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.468778    4548 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Nov 04 02:16:06.468894 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.468884    4548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Nov 04 02:16:06.468944 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.468900    4548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Nov 04 02:16:06.468944 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.468906    4548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Nov 04 02:16:06.468944 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.468914    4548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Nov 04 02:16:06.468944 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.468923    4548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Nov 04 02:16:06.468944 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.468929    4548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Nov 04 02:16:06.468944 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.468935    4548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Nov 04 02:16:06.468944 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.468941    4548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Nov 04 02:16:06.468944 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.468948    4548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Nov 04 02:16:06.469276 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.468954    4548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Nov 04 02:16:06.469276 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.468963    4548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Nov 04 02:16:06.469276 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.468974    4548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Nov 04 02:16:06.469276 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.468999    4548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Nov 04 02:16:06.469276 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.469005    4548 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Nov 04 02:16:06.472609 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.472594    4548 server.go:1263] "Started kubelet"
Nov 04 02:16:06.472716 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.472681    4548 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Nov 04 02:16:06.472766 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.472698    4548 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Nov 04 02:16:06.472822 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.472787    4548 server_v1.go:49] "podresources" method="list" useActivePods=true
Nov 04 02:16:06.473196 ip-10-0-130-155 systemd[1]: Started Kubernetes Kubelet.
Nov 04 02:16:06.473408 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.473250    4548 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Nov 04 02:16:06.474142 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.474121    4548 server.go:317] "Adding debug handlers to kubelet server"
Nov 04 02:16:06.479206 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.478919    4548 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.479379    4548 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.479473    4548 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-11-03 02:10:27 +0000 UTC" deadline="2028-07-12 01:11:37.40859012 +0000 UTC"
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.479554    4548 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14782h55m30.929040973s"
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.479763    4548 volume_manager.go:309] "The desired_state_of_world populator starts"
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.479774    4548 volume_manager.go:311] "Starting Kubelet Volume Manager"
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.479872    4548 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:16:06.480605    4548 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-155.us-west-2.compute.internal\" not found"
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.480684    4548 factory.go:55] Registering systemd factory
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.480704    4548 factory.go:223] Registration of the systemd container factory successfully
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481262    4548 factory.go:153] Registering CRI-O factory
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481279    4548 factory.go:223] Registration of the crio container factory successfully
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481353    4548 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481377    4548 factory.go:103] Registering Raw factory
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481393    4548 manager.go:1199] Started watching for new ooms in manager
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481784    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4daf9bec-b4b4-44b5-8582-7f4c95f9ec95" volumeName="kubernetes.io/empty-dir/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95-tmp-dir" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481821    4548 manager.go:319] Starting recovery of all containers
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481823    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f046171-a465-4614-b723-dd243a083530" volumeName="kubernetes.io/projected/4f046171-a465-4614-b723-dd243a083530-kube-api-access-fjl9k" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481843    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="50068ac4-0a6a-48ca-84dd-611fc3a87b65" volumeName="kubernetes.io/configmap/50068ac4-0a6a-48ca-84dd-611fc3a87b65-ovnkube-script-lib" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481857    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ae0be1c5-e730-4d02-84d7-f66a9666af87" volumeName="kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-service-ca-bundle" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481871    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5" volumeName="kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481884    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d3b93c5f-3df3-49d6-af5a-3d330ecc5318" volumeName="kubernetes.io/empty-dir/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-tmp-dir" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481897    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d3b93c5f-3df3-49d6-af5a-3d330ecc5318" volumeName="kubernetes.io/projected/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-kube-api-access-96wdc" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481910    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="50068ac4-0a6a-48ca-84dd-611fc3a87b65" volumeName="kubernetes.io/configmap/50068ac4-0a6a-48ca-84dd-611fc3a87b65-env-overrides" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481927    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db7921f7-4844-4111-9f43-6aa6eeccf9c6" volumeName="kubernetes.io/configmap/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-rbac-proxy-cm" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481940    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fa9c7d67-d4ef-4900-873e-046523ea039e" volumeName="kubernetes.io/projected/fa9c7d67-d4ef-4900-873e-046523ea039e-kube-api-access-m7z88" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481954    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1e86306b-74a7-4f2f-84fa-0e297b78c7aa" volumeName="kubernetes.io/projected/1e86306b-74a7-4f2f-84fa-0e297b78c7aa-kube-api-access-f6klz" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481967    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d0d738a-4b36-416e-bf3b-3411b084ee41" volumeName="kubernetes.io/empty-dir/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-tuned" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481978    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f046171-a465-4614-b723-dd243a083530" volumeName="kubernetes.io/secret/4f046171-a465-4614-b723-dd243a083530-signing-key" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.481990    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ae0be1c5-e730-4d02-84d7-f66a9666af87" volumeName="kubernetes.io/empty-dir/ae0be1c5-e730-4d02-84d7-f66a9666af87-archives-path" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482005    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db7921f7-4844-4111-9f43-6aa6eeccf9c6" volumeName="kubernetes.io/empty-dir/db7921f7-4844-4111-9f43-6aa6eeccf9c6-data-volume" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482017    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d0d738a-4b36-416e-bf3b-3411b084ee41" volumeName="kubernetes.io/empty-dir/2d0d738a-4b36-416e-bf3b-3411b084ee41-tmp" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482028    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4bcbd86c-05d7-4132-8e50-c79c54ba683f" volumeName="kubernetes.io/projected/4bcbd86c-05d7-4132-8e50-c79c54ba683f-kube-api-access-k7rqb" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482039    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4daf9bec-b4b4-44b5-8582-7f4c95f9ec95" volumeName="kubernetes.io/projected/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95-kube-api-access-fl4lf" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482053    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="50068ac4-0a6a-48ca-84dd-611fc3a87b65" volumeName="kubernetes.io/projected/50068ac4-0a6a-48ca-84dd-611fc3a87b65-kube-api-access-rg2cw" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482081    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ae0be1c5-e730-4d02-84d7-f66a9666af87" volumeName="kubernetes.io/projected/ae0be1c5-e730-4d02-84d7-f66a9666af87-kube-api-access-dzl2p" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482094    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fa9c7d67-d4ef-4900-873e-046523ea039e" volumeName="kubernetes.io/configmap/fa9c7d67-d4ef-4900-873e-046523ea039e-cni-binary-copy" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482106    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="13b8bca5-57ac-42c5-a5fe-a87a2a0ff775" volumeName="kubernetes.io/projected/13b8bca5-57ac-42c5-a5fe-a87a2a0ff775-kube-api-access-tp6gp" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482118    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1e86306b-74a7-4f2f-84fa-0e297b78c7aa" volumeName="kubernetes.io/configmap/1e86306b-74a7-4f2f-84fa-0e297b78c7aa-iptables-alerter-script" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482129    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="4f046171-a465-4614-b723-dd243a083530" volumeName="kubernetes.io/configmap/4f046171-a465-4614-b723-dd243a083530-signing-cabundle" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482141    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf87debc-dfe4-4dce-85f0-0ecab689c59d" volumeName="kubernetes.io/projected/cf87debc-dfe4-4dce-85f0-0ecab689c59d-kube-api-access-nrx2h" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482152    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="2d0d738a-4b36-416e-bf3b-3411b084ee41" volumeName="kubernetes.io/projected/2d0d738a-4b36-416e-bf3b-3411b084ee41-kube-api-access-mmq8d" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482203    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="50068ac4-0a6a-48ca-84dd-611fc3a87b65" volumeName="kubernetes.io/configmap/50068ac4-0a6a-48ca-84dd-611fc3a87b65-ovnkube-config" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482219    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="545569f5-aa5b-4b5b-bd9b-bf886ac96bd7" volumeName="kubernetes.io/projected/545569f5-aa5b-4b5b-bd9b-bf886ac96bd7-kube-api-access-mhz2q" seLinuxMountContext=""
Nov 04 02:16:06.482203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482237    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a5c331c-c911-474a-b893-f39e9285a677" volumeName="kubernetes.io/configmap/7a5c331c-c911-474a-b893-f39e9285a677-konnectivity-ca" seLinuxMountContext=""
Nov 04 02:16:06.484192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482247    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a5c331c-c911-474a-b893-f39e9285a677" volumeName="kubernetes.io/secret/7a5c331c-c911-474a-b893-f39e9285a677-agent-certs" seLinuxMountContext=""
Nov 04 02:16:06.484192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482258    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c36eb6b7-750c-49f0-a11d-5a168f75eb29" volumeName="kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret" seLinuxMountContext=""
Nov 04 02:16:06.484192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482269    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fe7e4369-7004-46e9-9821-cf3e8628e4df" volumeName="kubernetes.io/projected/fe7e4369-7004-46e9-9821-cf3e8628e4df-kube-api-access-8lfmx" seLinuxMountContext=""
Nov 04 02:16:06.484192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482282    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="50068ac4-0a6a-48ca-84dd-611fc3a87b65" volumeName="kubernetes.io/secret/50068ac4-0a6a-48ca-84dd-611fc3a87b65-ovn-node-metrics-cert" seLinuxMountContext=""
Nov 04 02:16:06.484192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482293    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9813e2dc-dbcb-4166-bd17-62eb60ced426" volumeName="kubernetes.io/configmap/9813e2dc-dbcb-4166-bd17-62eb60ced426-cni-sysctl-allowlist" seLinuxMountContext=""
Nov 04 02:16:06.484192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482306    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="d3b93c5f-3df3-49d6-af5a-3d330ecc5318" volumeName="kubernetes.io/configmap/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-config-volume" seLinuxMountContext=""
Nov 04 02:16:06.484192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482318    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="db7921f7-4844-4111-9f43-6aa6eeccf9c6" volumeName="kubernetes.io/projected/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-api-access-kmb8q" seLinuxMountContext=""
Nov 04 02:16:06.484192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482329    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="13b8bca5-57ac-42c5-a5fe-a87a2a0ff775" volumeName="kubernetes.io/secret/13b8bca5-57ac-42c5-a5fe-a87a2a0ff775-cert" seLinuxMountContext=""
Nov 04 02:16:06.484192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482340    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9813e2dc-dbcb-4166-bd17-62eb60ced426" volumeName="kubernetes.io/configmap/9813e2dc-dbcb-4166-bd17-62eb60ced426-whereabouts-flatfile-configmap" seLinuxMountContext=""
Nov 04 02:16:06.484192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482352    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9813e2dc-dbcb-4166-bd17-62eb60ced426" volumeName="kubernetes.io/configmap/9813e2dc-dbcb-4166-bd17-62eb60ced426-cni-binary-copy" seLinuxMountContext=""
Nov 04 02:16:06.484192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482365    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="9813e2dc-dbcb-4166-bd17-62eb60ced426" volumeName="kubernetes.io/projected/9813e2dc-dbcb-4166-bd17-62eb60ced426-kube-api-access-j8hsx" seLinuxMountContext=""
Nov 04 02:16:06.484192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482377    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="ae0be1c5-e730-4d02-84d7-f66a9666af87" volumeName="kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-trusted-ca-bundle" seLinuxMountContext=""
Nov 04 02:16:06.484192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482388    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cf87debc-dfe4-4dce-85f0-0ecab689c59d" volumeName="kubernetes.io/configmap/cf87debc-dfe4-4dce-85f0-0ecab689c59d-serviceca" seLinuxMountContext=""
Nov 04 02:16:06.484192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482399    4548 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="fa9c7d67-d4ef-4900-873e-046523ea039e" volumeName="kubernetes.io/configmap/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-daemon-config" seLinuxMountContext=""
Nov 04 02:16:06.484192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482410    4548 reconstruct.go:97] "Volume reconstruction finished"
Nov 04 02:16:06.484192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.482420    4548 reconciler.go:29] "Reconciler: start to sync state"
Nov 04 02:16:06.503719 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.503689    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:16:06.504983 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.504963    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:16:06.514452 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.514399    4548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Nov 04 02:16:06.516060 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.516033    4548 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Nov 04 02:16:06.516060 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.516065    4548 status_manager.go:249] "Starting to sync pod status with apiserver"
Nov 04 02:16:06.516263 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.516089    4548 kubelet.go:2521] "Starting kubelet main sync loop"
Nov 04 02:16:06.516263 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:16:06.516128    4548 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Nov 04 02:16:06.525428 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.525387    4548 generic.go:356] "Generic (PLEG): container finished" podID="88378d56a64bde54980a55721812b463" containerID="0fb586e7544756f2eeea593c430a8e24197899b1c28d59335338a8fb77ecb6ed" exitCode=0
Nov 04 02:16:06.537072 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.537029    4548 generic.go:356] "Generic (PLEG): container finished" podID="9813e2dc-dbcb-4166-bd17-62eb60ced426" containerID="b4d90cce257552be54028ba930b5d1adeac82e5c8e0cf990f45ba6b353ead78c" exitCode=0
Nov 04 02:16:06.537072 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.537068    4548 generic.go:356] "Generic (PLEG): container finished" podID="9813e2dc-dbcb-4166-bd17-62eb60ced426" containerID="b1190d67d6d3e2db20571d33803d3ffc78401d826c6c2e72ab0d8abe66d735df" exitCode=0
Nov 04 02:16:06.537072 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.537078    4548 generic.go:356] "Generic (PLEG): container finished" podID="9813e2dc-dbcb-4166-bd17-62eb60ced426" containerID="09372ada5209782a5c9224cc751db03d1464bdd9d28829a217aeb7efe79739e5" exitCode=0
Nov 04 02:16:06.537353 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.537085    4548 generic.go:356] "Generic (PLEG): container finished" podID="9813e2dc-dbcb-4166-bd17-62eb60ced426" containerID="c4b4f8ba76bf6da42624b2edea3be7add45d0f6af41c6aeb5df83199380ca7b3" exitCode=0
Nov 04 02:16:06.537353 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.537093    4548 generic.go:356] "Generic (PLEG): container finished" podID="9813e2dc-dbcb-4166-bd17-62eb60ced426" containerID="5855bb26c9b0154b0dfcee92186bf13300231a3e6520b3b903a103892e97d5cc" exitCode=0
Nov 04 02:16:06.537353 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.537101    4548 generic.go:356] "Generic (PLEG): container finished" podID="9813e2dc-dbcb-4166-bd17-62eb60ced426" containerID="1af78038e9eb8f8f92c73351b708e50f127be621b86929d969c3f8a0fc6b8076" exitCode=0
Nov 04 02:16:06.541372 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.541341    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:16:06.541716 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.541685    4548 generic.go:356] "Generic (PLEG): container finished" podID="50068ac4-0a6a-48ca-84dd-611fc3a87b65" containerID="a0259bf010b2942b942f7d3f3034c4565f49a2cbf78929acd0133b99f8c99738" exitCode=1
Nov 04 02:16:06.558042 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.558010    4548 manager.go:324] Recovery completed
Nov 04 02:16:06.573560 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.573486    4548 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:16:06.574784 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.574758    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:16:06.574889 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.574793    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:16:06.574889 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.574809    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:16:06.576592 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.576571    4548 cpu_manager.go:226] "Starting" policy="none"
Nov 04 02:16:06.576592 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.576587    4548 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Nov 04 02:16:06.576592 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.576594    4548 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:16:06.576803 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.576605    4548 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Nov 04 02:16:06.576803 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.576737    4548 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Nov 04 02:16:06.576803 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.576749    4548 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Nov 04 02:16:06.576803 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.576767    4548 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Nov 04 02:16:06.576803 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.576772    4548 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Nov 04 02:16:06.576803 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.576777    4548 policy_none.go:50] "Start"
Nov 04 02:16:06.576803 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.576786    4548 memory_manager.go:187] "Starting memorymanager" policy="None"
Nov 04 02:16:06.577122 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.576815    4548 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Nov 04 02:16:06.577122 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.576944    4548 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Nov 04 02:16:06.577122 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.576954    4548 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Nov 04 02:16:06.577122 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.576962    4548 policy_none.go:44] "Start"
Nov 04 02:16:06.577550 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.577531    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:16:06.577634 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.577567    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:16:06.577634 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.577581    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:16:06.581140 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:16:06.581118    4548 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-130-155.us-west-2.compute.internal\" not found"
Nov 04 02:16:06.581688 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.581648    4548 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Nov 04 02:16:06.587046 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.587027    4548 manager.go:341] "Starting Device Plugin manager"
Nov 04 02:16:06.587196 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:16:06.587057    4548 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Nov 04 02:16:06.587196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.587066    4548 server.go:87] "Starting device plugin registration server"
Nov 04 02:16:06.587432 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.587418    4548 eviction_manager.go:194] "Eviction manager: starting control loop"
Nov 04 02:16:06.587519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.587433    4548 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Nov 04 02:16:06.587651 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.587639    4548 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Nov 04 02:16:06.587735 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.587711    4548 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Nov 04 02:16:06.587783 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.587742    4548 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Nov 04 02:16:06.587783 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.587747    4548 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Nov 04 02:16:06.587937 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.587801    4548 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-11-04T02:16:06.587734417Z","UUID":"7752c5e0-4106-416d-bcc3-884484a140b5","Handler":null,"Name":"","Endpoint":""}
Nov 04 02:16:06.589152 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:16:06.589129    4548 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Nov 04 02:16:06.589254 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:16:06.589202    4548 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-155.us-west-2.compute.internal\" not found"
Nov 04 02:16:06.589535 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.589518    4548 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Nov 04 02:16:06.589597 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.589545    4548 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Nov 04 02:16:06.617360 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.616808    4548 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal"]
Nov 04 02:16:06.617542 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.617452    4548 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:16:06.618527 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.618511    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:16:06.618596 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.618542    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:16:06.618596 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.618553    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:16:06.618800 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.618789    4548 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:16:06.618986 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.618972    4548 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:16:06.619631 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.619614    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:16:06.619697 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.619618    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:16:06.619697 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.619648    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:16:06.619697 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.619659    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:16:06.619697 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.619667    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:16:06.619697 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.619681    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:16:06.619904 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:16:06.619828    4548 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-155.us-west-2.compute.internal\" not found" node="ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:06.619904 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.619852    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal" event={"ID":"9e236c28d3c011f48f26e1ef488876d0","Type":"ContainerStarted","Data":"dd174140bbdb7a2bf40fb36123baaba3b1c5e6216f264d940ac13129d4c305fd"}
Nov 04 02:16:06.619904 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.619886    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal" event={"ID":"9e236c28d3c011f48f26e1ef488876d0","Type":"ContainerStarted","Data":"ffa5f598651b47d776ee78e53f09d7bb129dd19dd347b9b0e4e5ccb6a789c326"}
Nov 04 02:16:06.619904 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.619899    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal" event={"ID":"88378d56a64bde54980a55721812b463","Type":"ContainerStarted","Data":"f923b521eda07db50bee5bc071518cc127ce243f9cffbe2d1558f06ae600febb"}
Nov 04 02:16:06.620086 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.619916    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal" event={"ID":"88378d56a64bde54980a55721812b463","Type":"ContainerDied","Data":"0fb586e7544756f2eeea593c430a8e24197899b1c28d59335338a8fb77ecb6ed"}
Nov 04 02:16:06.620086 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.619930    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal" event={"ID":"88378d56a64bde54980a55721812b463","Type":"ContainerStarted","Data":"11aa6181157b0231250680c37f0cf1a4c6c01e071842a682e7033051a287700f"}
Nov 04 02:16:06.620086 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.619970    4548 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:16:06.622977 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.622948    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:16:06.623084 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.622998    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:16:06.623084 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.623027    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:16:06.623222 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:16:06.623207    4548 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-155.us-west-2.compute.internal\" not found" node="ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:06.684268 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.684227    4548 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:16:06.684268 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.684271    4548 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:16:06.687820 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.687800    4548 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Nov 04 02:16:06.688892 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.688871    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientMemory"
Nov 04 02:16:06.689010 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.688904    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasNoDiskPressure"
Nov 04 02:16:06.689010 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.688918    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeHasSufficientPID"
Nov 04 02:16:06.689010 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.688947    4548 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:06.691367 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.691344    4548 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:16:06.691497 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.691479    4548 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Nov 04 02:16:06.735179 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.735133    4548 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Nov 04 02:16:06.780804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.780767    4548 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:06.793792 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.793754    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e236c28d3c011f48f26e1ef488876d0-config\") pod \"kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal\" (UID: \"9e236c28d3c011f48f26e1ef488876d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:06.793957 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.793848    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88378d56a64bde54980a55721812b463-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal\" (UID: \"88378d56a64bde54980a55721812b463\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:06.793957 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.793871    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88378d56a64bde54980a55721812b463-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal\" (UID: \"88378d56a64bde54980a55721812b463\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:06.800025 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.799999    4548 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:06.800184 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.800075    4548 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:06.800709 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.800693    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeNotReady"
Nov 04 02:16:06.800774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.800725    4548 setters.go:546] "Node became not ready" node="ip-10-0-130-155.us-west-2.compute.internal" condition={"type":"Ready","status":"False","lastHeartbeatTime":"2026-11-04T02:16:06Z","lastTransitionTime":"2026-11-04T02:16:06Z","reason":"KubeletNotReady","message":"CSINode is not yet initialized"}
Nov 04 02:16:06.844844 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.844757    4548 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 02:16:06.844844 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:16:06.844815    4548 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:06.844844 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.844833    4548 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:06.867095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.867048    4548 nodeinfomanager.go:471] existing CSINode "ip-10-0-130-155.us-west-2.compute.internal" is owned by different node (oldNodeID="e2dedd7c-cab5-40ae-8b71-baaf544dd4ba", newNodeID=""), cleaning up...
Nov 04 02:16:06.894788 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.894745    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e236c28d3c011f48f26e1ef488876d0-config\") pod \"kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal\" (UID: \"9e236c28d3c011f48f26e1ef488876d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:06.894788 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.894779    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9e236c28d3c011f48f26e1ef488876d0-config\") pod \"kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal\" (UID: \"9e236c28d3c011f48f26e1ef488876d0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:06.895040 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.894822    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88378d56a64bde54980a55721812b463-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal\" (UID: \"88378d56a64bde54980a55721812b463\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:06.895040 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.894858    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88378d56a64bde54980a55721812b463-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal\" (UID: \"88378d56a64bde54980a55721812b463\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:06.895040 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.894871    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/88378d56a64bde54980a55721812b463-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal\" (UID: \"88378d56a64bde54980a55721812b463\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:06.895040 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.894886    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/88378d56a64bde54980a55721812b463-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal\" (UID: \"88378d56a64bde54980a55721812b463\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:06.941273 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:06.941239    4548 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 02:16:06.941444 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:16:06.941293    4548 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:07.464038 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.463993    4548 apiserver.go:52] "Watching apiserver"
Nov 04 02:16:07.560000 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.559964    4548 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:07.568115 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.568085    4548 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Nov 04 02:16:07.568713 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.568685    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-hkzpl","openshift-insights/periodic-gathering-lrnr2-ck96b","openshift-multus/multus-additional-cni-plugins-p7425","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl","openshift-dns/dns-default-fj84x","openshift-image-registry/node-ca-465v4","openshift-ovn-kubernetes/ovnkube-node-g86jv","kube-system/kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal","openshift-ingress-canary/ingress-canary-qcfqf","openshift-multus/network-metrics-daemon-ff4lm","openshift-kube-storage-version-migrator/migrator-66df5d496b-b92z2","openshift-network-operator/iptables-alerter-z558g","kube-system/konnectivity-agent-g4rp8","kube-system/global-pull-secret-syncer-bfrx9","openshift-dns/node-resolver-tprts","openshift-cluster-node-tuning-operator/tuned-k46hl","openshift-service-ca/service-ca-5fffc97bdf-s7dqc","openshift-network-diagnostics/network-check-target-5pvtj","openshift-insights/insights-runtime-extractor-xctgd"]
Nov 04 02:16:07.569204 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.569165    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:16:07.577193 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.577145    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fj84x"
Nov 04 02:16:07.577707 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.577682    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:16:07.581704 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.581682    4548 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Nov 04 02:16:07.599236 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599206    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9813e2dc-dbcb-4166-bd17-62eb60ced426-system-cni-dir\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:16:07.599355 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599244    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-run-k8s-cni-cncf-io\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.599355 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599264    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-sys-fs\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.599355 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599282    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-lib-modules\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.599355 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599297    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-kubelet\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.599355 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599311    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-slash\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.599529 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599388    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-run-netns\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.599529 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599439    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-cnibin\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.599529 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599472    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-run-netns\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.599625 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599548    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7z88\" (UniqueName: \"kubernetes.io/projected/fa9c7d67-d4ef-4900-873e-046523ea039e-kube-api-access-m7z88\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.599625 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599573    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/db7921f7-4844-4111-9f43-6aa6eeccf9c6-crio-socket\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:16:07.599625 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599601    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9813e2dc-dbcb-4166-bd17-62eb60ced426-cnibin\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:16:07.599742 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599632    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d0d738a-4b36-416e-bf3b-3411b084ee41-tmp\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.599742 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599691    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-log-socket\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.599742 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599720    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e86306b-74a7-4f2f-84fa-0e297b78c7aa-host-slash\") pod \"iptables-alerter-z558g\" (UID: \"1e86306b-74a7-4f2f-84fa-0e297b78c7aa\") " pod="openshift-network-operator/iptables-alerter-z558g"
Nov 04 02:16:07.599850 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599742    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-system-cni-dir\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.599850 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599746    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d0d738a-4b36-416e-bf3b-3411b084ee41-tmp\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.599850 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599779    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a5c331c-c911-474a-b893-f39e9285a677-konnectivity-ca\") pod \"konnectivity-agent-g4rp8\" (UID: \"7a5c331c-c911-474a-b893-f39e9285a677\") " pod="kube-system/konnectivity-agent-g4rp8"
Nov 04 02:16:07.599850 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599813    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9813e2dc-dbcb-4166-bd17-62eb60ced426-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:16:07.600002 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599866    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-kubernetes\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.600002 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599900    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/50068ac4-0a6a-48ca-84dd-611fc3a87b65-env-overrides\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.600002 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.599923    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-conf-dir\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.600141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600004    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-run-multus-certs\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.600141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600038    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7rqb\" (UniqueName: \"kubernetes.io/projected/4bcbd86c-05d7-4132-8e50-c79c54ba683f-kube-api-access-k7rqb\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.600141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600068    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9813e2dc-dbcb-4166-bd17-62eb60ced426-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:16:07.600141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600100    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9813e2dc-dbcb-4166-bd17-62eb60ced426-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:16:07.600141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600125    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-cni-netd\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.600403 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600150    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-hostroot\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.600403 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600230    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4f046171-a465-4614-b723-dd243a083530-signing-key\") pod \"service-ca-5fffc97bdf-s7dqc\" (UID: \"4f046171-a465-4614-b723-dd243a083530\") " pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc"
Nov 04 02:16:07.600403 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600263    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c36eb6b7-750c-49f0-a11d-5a168f75eb29-dbus\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:16:07.600403 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600284    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzl2p\" (UniqueName: \"kubernetes.io/projected/ae0be1c5-e730-4d02-84d7-f66a9666af87-kube-api-access-dzl2p\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:16:07.600403 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600300    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-socket-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.600403 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600317    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-tuned\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.600403 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600332    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/50068ac4-0a6a-48ca-84dd-611fc3a87b65-ovnkube-config\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.600403 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600348    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/50068ac4-0a6a-48ca-84dd-611fc3a87b65-ovnkube-script-lib\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.600403 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600380    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95-tmp-dir\") pod \"node-resolver-tprts\" (UID: \"4daf9bec-b4b4-44b5-8582-7f4c95f9ec95\") " pod="openshift-dns/node-resolver-tprts"
Nov 04 02:16:07.600403 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600403    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-tuned\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600404    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6klz\" (UniqueName: \"kubernetes.io/projected/1e86306b-74a7-4f2f-84fa-0e297b78c7aa-kube-api-access-f6klz\") pod \"iptables-alerter-z558g\" (UID: \"1e86306b-74a7-4f2f-84fa-0e297b78c7aa\") " pod="openshift-network-operator/iptables-alerter-z558g"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600445    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-registration-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600463    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-device-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600471    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95-tmp-dir\") pod \"node-resolver-tprts\" (UID: \"4daf9bec-b4b4-44b5-8582-7f4c95f9ec95\") " pod="openshift-dns/node-resolver-tprts"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600481    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mhz2q\" (UniqueName: \"kubernetes.io/projected/545569f5-aa5b-4b5b-bd9b-bf886ac96bd7-kube-api-access-mhz2q\") pod \"migrator-66df5d496b-b92z2\" (UID: \"545569f5-aa5b-4b5b-bd9b-bf886ac96bd7\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-b92z2"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600514    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-systemd\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600546    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-var-lib-openvswitch\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600594    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-cni-bin\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600619    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-cni-dir\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600647    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4f046171-a465-4614-b723-dd243a083530-signing-cabundle\") pod \"service-ca-5fffc97bdf-s7dqc\" (UID: \"4f046171-a465-4614-b723-dd243a083530\") " pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600676    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a5c331c-c911-474a-b893-f39e9285a677-agent-certs\") pod \"konnectivity-agent-g4rp8\" (UID: \"7a5c331c-c911-474a-b893-f39e9285a677\") " pod="kube-system/konnectivity-agent-g4rp8"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600701    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/ae0be1c5-e730-4d02-84d7-f66a9666af87-archives-path\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600726    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-trusted-ca-bundle\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600760    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmq8d\" (UniqueName: \"kubernetes.io/projected/2d0d738a-4b36-416e-bf3b-3411b084ee41-kube-api-access-mmq8d\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600782    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/ae0be1c5-e730-4d02-84d7-f66a9666af87-archives-path\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600798    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600826    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/50068ac4-0a6a-48ca-84dd-611fc3a87b65-ovn-node-metrics-cert\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600852    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rg2cw\" (UniqueName: \"kubernetes.io/projected/50068ac4-0a6a-48ca-84dd-611fc3a87b65-kube-api-access-rg2cw\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.600915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600896    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-var-lib-cni-bin\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600946    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjl9k\" (UniqueName: \"kubernetes.io/projected/4f046171-a465-4614-b723-dd243a083530-kube-api-access-fjl9k\") pod \"service-ca-5fffc97bdf-s7dqc\" (UID: \"4f046171-a465-4614-b723-dd243a083530\") " pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.600974    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs\") pod \"network-metrics-daemon-ff4lm\" (UID: \"fe7e4369-7004-46e9-9821-cf3e8628e4df\") " pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601006    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-modprobe-d\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601029    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-etc-openvswitch\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601047    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e86306b-74a7-4f2f-84fa-0e297b78c7aa-iptables-alerter-script\") pod \"iptables-alerter-z558g\" (UID: \"1e86306b-74a7-4f2f-84fa-0e297b78c7aa\") " pod="openshift-network-operator/iptables-alerter-z558g"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601064    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa9c7d67-d4ef-4900-873e-046523ea039e-cni-binary-copy\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601084    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-var-lib-cni-multus\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601129    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lfmx\" (UniqueName: \"kubernetes.io/projected/fe7e4369-7004-46e9-9821-cf3e8628e4df-kube-api-access-8lfmx\") pod \"network-metrics-daemon-ff4lm\" (UID: \"fe7e4369-7004-46e9-9821-cf3e8628e4df\") " pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601262    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c36eb6b7-750c-49f0-a11d-5a168f75eb29-kubelet-config\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601289    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-tmp-dir\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601313    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-run\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601327    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-run-ovn\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601347    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp6gp\" (UniqueName: \"kubernetes.io/projected/13b8bca5-57ac-42c5-a5fe-a87a2a0ff775-kube-api-access-tp6gp\") pod \"ingress-canary-qcfqf\" (UID: \"13b8bca5-57ac-42c5-a5fe-a87a2a0ff775\") " pod="openshift-ingress-canary/ingress-canary-qcfqf"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601361    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-config-volume\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601392    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-tmp-dir\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601401    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96wdc\" (UniqueName: \"kubernetes.io/projected/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-kube-api-access-96wdc\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601434    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/db7921f7-4844-4111-9f43-6aa6eeccf9c6-data-volume\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601461    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmb8q\" (UniqueName: \"kubernetes.io/projected/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-api-access-kmb8q\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601490    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf87debc-dfe4-4dce-85f0-0ecab689c59d-host\") pod \"node-ca-465v4\" (UID: \"cf87debc-dfe4-4dce-85f0-0ecab689c59d\") " pod="openshift-image-registry/node-ca-465v4"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601536    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/db7921f7-4844-4111-9f43-6aa6eeccf9c6-data-volume\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601595    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-var-lib-kubelet\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601617    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6qzt\" (UniqueName: \"kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt\") pod \"network-check-target-5pvtj\" (UID: \"aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5\") " pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:16:07.601696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601649    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-socket-dir-parent\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601760    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-daemon-config\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601789    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601817    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601869    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601892    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-service-ca-bundle\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601921    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-sys\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601941    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13b8bca5-57ac-42c5-a5fe-a87a2a0ff775-cert\") pod \"ingress-canary-qcfqf\" (UID: \"13b8bca5-57ac-42c5-a5fe-a87a2a0ff775\") " pod="openshift-ingress-canary/ingress-canary-qcfqf"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601957    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-sysctl-d\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601971    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-run-systemd\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.601995    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-node-log\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.602021    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.602045    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf87debc-dfe4-4dce-85f0-0ecab689c59d-serviceca\") pod \"node-ca-465v4\" (UID: \"cf87debc-dfe4-4dce-85f0-0ecab689c59d\") " pod="openshift-image-registry/node-ca-465v4"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.602062    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrx2h\" (UniqueName: \"kubernetes.io/projected/cf87debc-dfe4-4dce-85f0-0ecab689c59d-kube-api-access-nrx2h\") pod \"node-ca-465v4\" (UID: \"cf87debc-dfe4-4dce-85f0-0ecab689c59d\") " pod="openshift-image-registry/node-ca-465v4"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.602114    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9813e2dc-dbcb-4166-bd17-62eb60ced426-cni-binary-copy\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.602133    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-sysctl-conf\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.602150    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-systemd-units\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.602193    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-run-ovn-kubernetes\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.602215    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95-hosts-file\") pod \"node-resolver-tprts\" (UID: \"4daf9bec-b4b4-44b5-8582-7f4c95f9ec95\") " pod="openshift-dns/node-resolver-tprts"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.602261    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fl4lf\" (UniqueName: \"kubernetes.io/projected/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95-kube-api-access-fl4lf\") pod \"node-resolver-tprts\" (UID: \"4daf9bec-b4b4-44b5-8582-7f4c95f9ec95\") " pod="openshift-dns/node-resolver-tprts"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.602377    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-var-lib-kubelet\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.602431    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-etc-kubernetes\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.602482    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-sysconfig\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.602540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.602530    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-run-openvswitch\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.603160 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.602563    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:16:07.603160 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.602591    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-etc-selinux\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.603160 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.602656    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8hsx\" (UniqueName: \"kubernetes.io/projected/9813e2dc-dbcb-4166-bd17-62eb60ced426-kube-api-access-j8hsx\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:16:07.603160 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.602752    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-host\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.633362 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.633327    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Nov 04 02:16:07.633510 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.633437    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Nov 04 02:16:07.633585 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.633569    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Nov 04 02:16:07.633868 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.633849    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Nov 04 02:16:07.633898 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.633855    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Nov 04 02:16:07.634043 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.634029    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Nov 04 02:16:07.634072 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.634065    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:16:07.634966 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.634942    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Nov 04 02:16:07.634966 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.634962    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Nov 04 02:16:07.635095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.635013    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Nov 04 02:16:07.635095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.635021    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Nov 04 02:16:07.635095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.635029    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Nov 04 02:16:07.635095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.635048    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Nov 04 02:16:07.635095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.635056    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Nov 04 02:16:07.635095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.635022    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Nov 04 02:16:07.635095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.635059    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Nov 04 02:16:07.635095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.635017    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Nov 04 02:16:07.635095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.635100    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Nov 04 02:16:07.635547 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.635129    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Nov 04 02:16:07.635547 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.635145    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Nov 04 02:16:07.635645 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.635630    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Nov 04 02:16:07.635687 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.635642    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Nov 04 02:16:07.640962 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.640932    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/50068ac4-0a6a-48ca-84dd-611fc3a87b65-ovnkube-config\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.641112 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.640938    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9813e2dc-dbcb-4166-bd17-62eb60ced426-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:16:07.641112 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.640939    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9813e2dc-dbcb-4166-bd17-62eb60ced426-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:16:07.641112 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.640939    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/50068ac4-0a6a-48ca-84dd-611fc3a87b65-ovnkube-script-lib\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.641112 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.640945    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a5c331c-c911-474a-b893-f39e9285a677-konnectivity-ca\") pod \"konnectivity-agent-g4rp8\" (UID: \"7a5c331c-c911-474a-b893-f39e9285a677\") " pod="kube-system/konnectivity-agent-g4rp8"
Nov 04 02:16:07.641112 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.640947    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/50068ac4-0a6a-48ca-84dd-611fc3a87b65-env-overrides\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.642366 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.642351    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fa9c7d67-d4ef-4900-873e-046523ea039e-cni-binary-copy\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.642405 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.642373    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9813e2dc-dbcb-4166-bd17-62eb60ced426-cni-binary-copy\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:16:07.642702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.642684    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cf87debc-dfe4-4dce-85f0-0ecab689c59d-serviceca\") pod \"node-ca-465v4\" (UID: \"cf87debc-dfe4-4dce-85f0-0ecab689c59d\") " pod="openshift-image-registry/node-ca-465v4"
Nov 04 02:16:07.650436 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.650405    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Nov 04 02:16:07.650702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.650410    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Nov 04 02:16:07.650702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.650660    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zjj5c\""
Nov 04 02:16:07.650702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.650680    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-n8x9d\""
Nov 04 02:16:07.650702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.650695    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-k925t\""
Nov 04 02:16:07.650933 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.650705    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6q9ld\""
Nov 04 02:16:07.650933 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.650685    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Nov 04 02:16:07.650933 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.650711    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-wpmk6\""
Nov 04 02:16:07.650933 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.650682    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zrn9f\""
Nov 04 02:16:07.650933 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.650728    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-px2wd\""
Nov 04 02:16:07.650933 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.650747    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-m589d\""
Nov 04 02:16:07.650933 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.650779    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-gsgrb\""
Nov 04 02:16:07.650933 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.650825    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Nov 04 02:16:07.651161 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.650962    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a5c331c-c911-474a-b893-f39e9285a677-agent-certs\") pod \"konnectivity-agent-g4rp8\" (UID: \"7a5c331c-c911-474a-b893-f39e9285a677\") " pod="kube-system/konnectivity-agent-g4rp8"
Nov 04 02:16:07.651161 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.651087    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/50068ac4-0a6a-48ca-84dd-611fc3a87b65-ovn-node-metrics-cert\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.670631 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.670606    4548 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Nov 04 02:16:07.670753 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:16:07.670670    4548 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-155.us-west-2.compute.internal"
Nov 04 02:16:07.681827 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.681799    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Nov 04 02:16:07.682129 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.682111    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Nov 04 02:16:07.682233 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.682110    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Nov 04 02:16:07.682233 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.682208    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:16:07.682328 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.682312    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Nov 04 02:16:07.682357 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.682334    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Nov 04 02:16:07.682402 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.682371    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Nov 04 02:16:07.682620 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.682594    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Nov 04 02:16:07.682620 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.682605    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Nov 04 02:16:07.682710 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.682617    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Nov 04 02:16:07.682710 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.682637    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Nov 04 02:16:07.682710 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.682637    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Nov 04 02:16:07.682710 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.682662    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Nov 04 02:16:07.683002 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.682795    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:16:07.683002 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.682880    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Nov 04 02:16:07.683002 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.682904    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Nov 04 02:16:07.683417 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.683366    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Nov 04 02:16:07.688363 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.685720    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Nov 04 02:16:07.691677 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.691647    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/4f046171-a465-4614-b723-dd243a083530-signing-cabundle\") pod \"service-ca-5fffc97bdf-s7dqc\" (UID: \"4f046171-a465-4614-b723-dd243a083530\") " pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc"
Nov 04 02:16:07.691781 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.691695    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-config-volume\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:16:07.691781 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.691724    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-trusted-ca-bundle\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:16:07.691781 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.691752    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1e86306b-74a7-4f2f-84fa-0e297b78c7aa-iptables-alerter-script\") pod \"iptables-alerter-z558g\" (UID: \"1e86306b-74a7-4f2f-84fa-0e297b78c7aa\") " pod="openshift-network-operator/iptables-alerter-z558g"
Nov 04 02:16:07.692796 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.692777    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-service-ca-bundle\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:16:07.692859 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.692808    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-daemon-config\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.698988 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.698960    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7z88\" (UniqueName: \"kubernetes.io/projected/fa9c7d67-d4ef-4900-873e-046523ea039e-kube-api-access-m7z88\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.699689 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.699665    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmb8q\" (UniqueName: \"kubernetes.io/projected/db7921f7-4844-4111-9f43-6aa6eeccf9c6-kube-api-access-kmb8q\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:16:07.699839 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.699814    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96wdc\" (UniqueName: \"kubernetes.io/projected/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-kube-api-access-96wdc\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:16:07.699957 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.699942    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7rqb\" (UniqueName: \"kubernetes.io/projected/4bcbd86c-05d7-4132-8e50-c79c54ba683f-kube-api-access-k7rqb\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.703987 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.703966    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-socket-dir-parent\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.704062 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.703995    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:16:07.704062 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704015    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:16:07.704062 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704033    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-sys\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.704062 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704050    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-sysctl-d\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.704259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704067    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-run-systemd\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.704259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704078    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-socket-dir-parent\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.704259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704089    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-node-log\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.704259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704127    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.704259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704134    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-node-log\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.704259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704138    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-sys\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.704259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704155    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-run-systemd\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.704259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704162    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-sysctl-conf\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.704259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704198    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.704259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704212    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-systemd-units\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.704259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704231    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-run-ovn-kubernetes\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.704259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704246    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95-hosts-file\") pod \"node-resolver-tprts\" (UID: \"4daf9bec-b4b4-44b5-8582-7f4c95f9ec95\") " pod="openshift-dns/node-resolver-tprts"
Nov 04 02:16:07.704259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704250    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-sysctl-d\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.704259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704263    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-var-lib-kubelet\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.704259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704269    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-sysctl-conf\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704293    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-etc-kubernetes\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704307    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95-hosts-file\") pod \"node-resolver-tprts\" (UID: \"4daf9bec-b4b4-44b5-8582-7f4c95f9ec95\") " pod="openshift-dns/node-resolver-tprts"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704311    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-systemd-units\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704318    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-sysconfig\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704334    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-run-ovn-kubernetes\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704318    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-var-lib-kubelet\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704355    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-run-openvswitch\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704356    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-etc-kubernetes\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704367    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-sysconfig\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704383    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-run-openvswitch\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704390    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-etc-selinux\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704417    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-host\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704421    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-etc-selinux\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704442    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9813e2dc-dbcb-4166-bd17-62eb60ced426-system-cni-dir\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704471    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-run-k8s-cni-cncf-io\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704478    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9813e2dc-dbcb-4166-bd17-62eb60ced426-system-cni-dir\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704448    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-host\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704496    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-sys-fs\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704520    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-lib-modules\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704534    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-run-k8s-cni-cncf-io\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704548    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-sys-fs\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704555    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-kubelet\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704580    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-slash\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704590    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-lib-modules\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704596    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-run-netns\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704581    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-kubelet\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704610    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-slash\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704619    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-cnibin\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704645    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-run-netns\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704656    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-run-netns\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704661    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-cnibin\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704687    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-run-netns\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704692    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/db7921f7-4844-4111-9f43-6aa6eeccf9c6-crio-socket\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704713    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/db7921f7-4844-4111-9f43-6aa6eeccf9c6-crio-socket\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704732    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9813e2dc-dbcb-4166-bd17-62eb60ced426-cnibin\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704754    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-log-socket\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704769    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e86306b-74a7-4f2f-84fa-0e297b78c7aa-host-slash\") pod \"iptables-alerter-z558g\" (UID: \"1e86306b-74a7-4f2f-84fa-0e297b78c7aa\") " pod="openshift-network-operator/iptables-alerter-z558g"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704775    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9813e2dc-dbcb-4166-bd17-62eb60ced426-cnibin\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:16:07.704774 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704784    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-system-cni-dir\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704801    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-log-socket\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704801    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-kubernetes\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704835    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-system-cni-dir\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704830    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1e86306b-74a7-4f2f-84fa-0e297b78c7aa-host-slash\") pod \"iptables-alerter-z558g\" (UID: \"1e86306b-74a7-4f2f-84fa-0e297b78c7aa\") " pod="openshift-network-operator/iptables-alerter-z558g"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704859    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-kubernetes\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704869    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-conf-dir\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704889    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-conf-dir\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704891    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-run-multus-certs\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704912    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9813e2dc-dbcb-4166-bd17-62eb60ced426-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704935    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-cni-netd\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704946    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-run-multus-certs\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704949    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-hostroot\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704969    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-hostroot\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704970    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c36eb6b7-750c-49f0-a11d-5a168f75eb29-dbus\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704987    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-socket-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.704999    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9813e2dc-dbcb-4166-bd17-62eb60ced426-tuning-conf-dir\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705007    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-registration-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705024    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-cni-netd\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705030    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-device-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705042    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c36eb6b7-750c-49f0-a11d-5a168f75eb29-dbus\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705052    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-socket-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705062    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-device-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705061    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-systemd\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705090    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-var-lib-openvswitch\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705104    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-systemd\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705108    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-cni-bin\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705089    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4bcbd86c-05d7-4132-8e50-c79c54ba683f-registration-dir\") pod \"aws-ebs-csi-driver-node-lk8nl\" (UID: \"4bcbd86c-05d7-4132-8e50-c79c54ba683f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-lk8nl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705155    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-var-lib-openvswitch\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705157    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-cni-bin\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705125    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-cni-dir\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705205    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705224    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-var-lib-cni-bin\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705225    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-multus-cni-dir\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705239    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs\") pod \"network-metrics-daemon-ff4lm\" (UID: \"fe7e4369-7004-46e9-9821-cf3e8628e4df\") " pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705247    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705261    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-var-lib-cni-bin\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705255    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-modprobe-d\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705290    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-etc-openvswitch\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705317    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-var-lib-cni-multus\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:16:07.705330    4548 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705341    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c36eb6b7-750c-49f0-a11d-5a168f75eb29-kubelet-config\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705364    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-run\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705372    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-etc-openvswitch\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705387    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-run-ovn\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705397    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-etc-modprobe-d\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:16:07.705407    4548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs podName:fe7e4369-7004-46e9-9821-cf3e8628e4df nodeName:}" failed. No retries permitted until 2026-11-04 02:16:08.20538374 +0000 UTC m=+1.810396749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs") pod "network-metrics-daemon-ff4lm" (UID: "fe7e4369-7004-46e9-9821-cf3e8628e4df") : secret "metrics-daemon-secret" not found
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705397    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fa9c7d67-d4ef-4900-873e-046523ea039e-host-var-lib-cni-multus\") pod \"multus-hkzpl\" (UID: \"fa9c7d67-d4ef-4900-873e-046523ea039e\") " pod="openshift-multus/multus-hkzpl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705420    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c36eb6b7-750c-49f0-a11d-5a168f75eb29-kubelet-config\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705424    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/50068ac4-0a6a-48ca-84dd-611fc3a87b65-run-ovn\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705438    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-run\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705455    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf87debc-dfe4-4dce-85f0-0ecab689c59d-host\") pod \"node-ca-465v4\" (UID: \"cf87debc-dfe4-4dce-85f0-0ecab689c59d\") " pod="openshift-image-registry/node-ca-465v4"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705477    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-var-lib-kubelet\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705479    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cf87debc-dfe4-4dce-85f0-0ecab689c59d-host\") pod \"node-ca-465v4\" (UID: \"cf87debc-dfe4-4dce-85f0-0ecab689c59d\") " pod="openshift-image-registry/node-ca-465v4"
Nov 04 02:16:07.705998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.705511    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d0d738a-4b36-416e-bf3b-3411b084ee41-var-lib-kubelet\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.711426 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.711395    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrx2h\" (UniqueName: \"kubernetes.io/projected/cf87debc-dfe4-4dce-85f0-0ecab689c59d-kube-api-access-nrx2h\") pod \"node-ca-465v4\" (UID: \"cf87debc-dfe4-4dce-85f0-0ecab689c59d\") " pod="openshift-image-registry/node-ca-465v4"
Nov 04 02:16:07.711531 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.711403    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6qzt\" (UniqueName: \"kubernetes.io/projected/aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5-kube-api-access-s6qzt\") pod \"network-check-target-5pvtj\" (UID: \"aff26f5a-c5b8-4373-ad5d-05d8ccbed0e5\") " pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:16:07.711531 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.711458    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6klz\" (UniqueName: \"kubernetes.io/projected/1e86306b-74a7-4f2f-84fa-0e297b78c7aa-kube-api-access-f6klz\") pod \"iptables-alerter-z558g\" (UID: \"1e86306b-74a7-4f2f-84fa-0e297b78c7aa\") " pod="openshift-network-operator/iptables-alerter-z558g"
Nov 04 02:16:07.711531 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.711470    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mhz2q\" (UniqueName: \"kubernetes.io/projected/545569f5-aa5b-4b5b-bd9b-bf886ac96bd7-kube-api-access-mhz2q\") pod \"migrator-66df5d496b-b92z2\" (UID: \"545569f5-aa5b-4b5b-bd9b-bf886ac96bd7\") " pod="openshift-kube-storage-version-migrator/migrator-66df5d496b-b92z2"
Nov 04 02:16:07.712701 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.712679    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rg2cw\" (UniqueName: \"kubernetes.io/projected/50068ac4-0a6a-48ca-84dd-611fc3a87b65-kube-api-access-rg2cw\") pod \"ovnkube-node-g86jv\" (UID: \"50068ac4-0a6a-48ca-84dd-611fc3a87b65\") " pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:07.714668 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.714626    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp6gp\" (UniqueName: \"kubernetes.io/projected/13b8bca5-57ac-42c5-a5fe-a87a2a0ff775-kube-api-access-tp6gp\") pod \"ingress-canary-qcfqf\" (UID: \"13b8bca5-57ac-42c5-a5fe-a87a2a0ff775\") " pod="openshift-ingress-canary/ingress-canary-qcfqf"
Nov 04 02:16:07.714738 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.714710    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzl2p\" (UniqueName: \"kubernetes.io/projected/ae0be1c5-e730-4d02-84d7-f66a9666af87-kube-api-access-dzl2p\") pod \"periodic-gathering-lrnr2-ck96b\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") " pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:16:07.715157 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.715141    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjl9k\" (UniqueName: \"kubernetes.io/projected/4f046171-a465-4614-b723-dd243a083530-kube-api-access-fjl9k\") pod \"service-ca-5fffc97bdf-s7dqc\" (UID: \"4f046171-a465-4614-b723-dd243a083530\") " pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc"
Nov 04 02:16:07.716478 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.716462    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lfmx\" (UniqueName: \"kubernetes.io/projected/fe7e4369-7004-46e9-9821-cf3e8628e4df-kube-api-access-8lfmx\") pod \"network-metrics-daemon-ff4lm\" (UID: \"fe7e4369-7004-46e9-9821-cf3e8628e4df\") " pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:16:07.716528 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.716514    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmq8d\" (UniqueName: \"kubernetes.io/projected/2d0d738a-4b36-416e-bf3b-3411b084ee41-kube-api-access-mmq8d\") pod \"tuned-k46hl\" (UID: \"2d0d738a-4b36-416e-bf3b-3411b084ee41\") " pod="openshift-cluster-node-tuning-operator/tuned-k46hl"
Nov 04 02:16:07.720561 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.720542    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8hsx\" (UniqueName: \"kubernetes.io/projected/9813e2dc-dbcb-4166-bd17-62eb60ced426-kube-api-access-j8hsx\") pod \"multus-additional-cni-plugins-p7425\" (UID: \"9813e2dc-dbcb-4166-bd17-62eb60ced426\") " pod="openshift-multus/multus-additional-cni-plugins-p7425"
Nov 04 02:16:07.724870 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.724848    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fl4lf\" (UniqueName: \"kubernetes.io/projected/4daf9bec-b4b4-44b5-8582-7f4c95f9ec95-kube-api-access-fl4lf\") pod \"node-resolver-tprts\" (UID: \"4daf9bec-b4b4-44b5-8582-7f4c95f9ec95\") " pod="openshift-dns/node-resolver-tprts"
Nov 04 02:16:07.735786 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.735736    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Nov 04 02:16:07.735929 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.735804    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Nov 04 02:16:07.735929 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.735812    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-v7b9k\""
Nov 04 02:16:07.735929 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.735812    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h2f9b\""
Nov 04 02:16:07.736212 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.736187    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pszzf\""
Nov 04 02:16:07.736212 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.736204    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-nw2cx\""
Nov 04 02:16:07.736518 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.736503    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Nov 04 02:16:07.736572 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.736521    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n2j4c\""
Nov 04 02:16:07.736572 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.736525    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-275xk\""
Nov 04 02:16:07.736637 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.736614    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wdjsv\""
Nov 04 02:16:07.736674 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.736635    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Nov 04 02:16:07.736729 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.736692    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-5gtz2\""
Nov 04 02:16:07.736771 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.736764    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-b2fnf\""
Nov 04 02:16:07.736802 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.736766    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Nov 04 02:16:07.741160 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.741141    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/4f046171-a465-4614-b723-dd243a083530-signing-key\") pod \"service-ca-5fffc97bdf-s7dqc\" (UID: \"4f046171-a465-4614-b723-dd243a083530\") " pod="openshift-service-ca/service-ca-5fffc97bdf-s7dqc"
Nov 04 02:16:07.742283 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.742267    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/13b8bca5-57ac-42c5-a5fe-a87a2a0ff775-cert\") pod \"ingress-canary-qcfqf\" (UID: \"13b8bca5-57ac-42c5-a5fe-a87a2a0ff775\") " pod="openshift-ingress-canary/ingress-canary-qcfqf"
Nov 04 02:16:07.743410 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.743394    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c36eb6b7-750c-49f0-a11d-5a168f75eb29-original-pull-secret\") pod \"global-pull-secret-syncer-bfrx9\" (UID: \"c36eb6b7-750c-49f0-a11d-5a168f75eb29\") " pod="kube-system/global-pull-secret-syncer-bfrx9"
Nov 04 02:16:07.744659 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.744633    4548 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Nov 04 02:16:07.747023 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.746998    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/db7921f7-4844-4111-9f43-6aa6eeccf9c6-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xctgd\" (UID: \"db7921f7-4844-4111-9f43-6aa6eeccf9c6\") " pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:16:07.747128 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.747072    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/d3b93c5f-3df3-49d6-af5a-3d330ecc5318-metrics-tls\") pod \"dns-default-fj84x\" (UID: \"d3b93c5f-3df3-49d6-af5a-3d330ecc5318\") " pod="openshift-dns/dns-default-fj84x"
Nov 04 02:16:07.877552 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.877521    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fj84x"
Nov 04 02:16:07.878811 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:07.878789    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xctgd"
Nov 04 02:16:08.210286 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:08.210247    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs\") pod \"network-metrics-daemon-ff4lm\" (UID: \"fe7e4369-7004-46e9-9821-cf3e8628e4df\") " pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:16:08.212929 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:08.212896    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe7e4369-7004-46e9-9821-cf3e8628e4df-metrics-certs\") pod \"network-metrics-daemon-ff4lm\" (UID: \"fe7e4369-7004-46e9-9821-cf3e8628e4df\") " pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:16:08.366673 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:08.366637    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fj84x"]
Nov 04 02:16:08.369807 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:08.369783    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xctgd"]
Nov 04 02:16:08.370530 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:08.370498    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3b93c5f_3df3_49d6_af5a_3d330ecc5318.slice/crio-f006ed2a509e1ddb3590ee7c1db95fb0a3ac8a703ef4b46d939eaa0a321c0158 WatchSource:0}: Error finding container f006ed2a509e1ddb3590ee7c1db95fb0a3ac8a703ef4b46d939eaa0a321c0158: Status 404 returned error can't find the container with id f006ed2a509e1ddb3590ee7c1db95fb0a3ac8a703ef4b46d939eaa0a321c0158
Nov 04 02:16:08.373025 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:08.373004    4548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 02:16:08.421500 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:08.421467    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb7921f7_4844_4111_9f43_6aa6eeccf9c6.slice/crio-1c85d95fc34a93680c12facc3d2e8e53072422ed53b7922c2dd2895d90072d21 WatchSource:0}: Error finding container 1c85d95fc34a93680c12facc3d2e8e53072422ed53b7922c2dd2895d90072d21: Status 404 returned error can't find the container with id 1c85d95fc34a93680c12facc3d2e8e53072422ed53b7922c2dd2895d90072d21
Nov 04 02:16:08.471825 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:08.471730    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ff4lm"
Nov 04 02:16:08.574351 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:08.574310    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xctgd" event={"ID":"db7921f7-4844-4111-9f43-6aa6eeccf9c6","Type":"ContainerStarted","Data":"3782c791d0ab4a9afe15c4898561de8153d97d73feaa502f8e09fb3ef9efebcc"}
Nov 04 02:16:08.574531 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:08.574481    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xctgd" event={"ID":"db7921f7-4844-4111-9f43-6aa6eeccf9c6","Type":"ContainerStarted","Data":"1c85d95fc34a93680c12facc3d2e8e53072422ed53b7922c2dd2895d90072d21"}
Nov 04 02:16:08.576781 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:08.576748    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fj84x" event={"ID":"d3b93c5f-3df3-49d6-af5a-3d330ecc5318","Type":"ContainerStarted","Data":"f006ed2a509e1ddb3590ee7c1db95fb0a3ac8a703ef4b46d939eaa0a321c0158"}
Nov 04 02:16:08.777146 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:08.777120    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-tprts_4daf9bec-b4b4-44b5-8582-7f4c95f9ec95/dns-node-resolver/0.log"
Nov 04 02:16:08.865632 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:08.865592    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ff4lm"]
Nov 04 02:16:08.870283 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:08.870248    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe7e4369_7004_46e9_9821_cf3e8628e4df.slice/crio-d1dc63c62dfbcaaad78913cd03c87a901f216aad46f92bb0ca7b5d9069532d76 WatchSource:0}: Error finding container d1dc63c62dfbcaaad78913cd03c87a901f216aad46f92bb0ca7b5d9069532d76: Status 404 returned error can't find the container with id d1dc63c62dfbcaaad78913cd03c87a901f216aad46f92bb0ca7b5d9069532d76
Nov 04 02:16:09.493263 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:09.493226    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-465v4_cf87debc-dfe4-4dce-85f0-0ecab689c59d/node-ca/0.log"
Nov 04 02:16:09.581223 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:09.581159    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ff4lm" event={"ID":"fe7e4369-7004-46e9-9821-cf3e8628e4df","Type":"ContainerStarted","Data":"d1dc63c62dfbcaaad78913cd03c87a901f216aad46f92bb0ca7b5d9069532d76"}
Nov 04 02:16:09.901561 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:09.901526    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:16:10.294513 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:10.294482    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qcfqf_13b8bca5-57ac-42c5-a5fe-a87a2a0ff775/serve-healthcheck-canary/0.log"
Nov 04 02:16:10.494535 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:10.494398    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-66df5d496b-b92z2_545569f5-aa5b-4b5b-bd9b-bf886ac96bd7/migrator/0.log"
Nov 04 02:16:10.590519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:10.590485    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xctgd" event={"ID":"db7921f7-4844-4111-9f43-6aa6eeccf9c6","Type":"ContainerStarted","Data":"d1a177b443196757a65e8639eb2593de8717886e3fc422b9b0e7da9fe2a86929"}
Nov 04 02:16:10.815204 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:10.815130    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-g4rp8"
Nov 04 02:16:11.596827 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:11.596779    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fj84x" event={"ID":"d3b93c5f-3df3-49d6-af5a-3d330ecc5318","Type":"ContainerStarted","Data":"b6081f7e1b30cdd2d1e05fd99f134e5dc4909e26895b3e859ab331b2475aee87"}
Nov 04 02:16:11.597258 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:11.596902    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fj84x" event={"ID":"d3b93c5f-3df3-49d6-af5a-3d330ecc5318","Type":"ContainerStarted","Data":"1905077ca54a6119f7b161d69d724c8c379a46caa6916fbf0d6882500dec601b"}
Nov 04 02:16:11.597258 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:11.597146    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fj84x"
Nov 04 02:16:11.599220 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:11.599187    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ff4lm" event={"ID":"fe7e4369-7004-46e9-9821-cf3e8628e4df","Type":"ContainerStarted","Data":"b00e4620012ac51529fc97ad6cb04ea2dfa960dc4df053742af60c5ef2611a1e"}
Nov 04 02:16:11.599353 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:11.599247    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ff4lm" event={"ID":"fe7e4369-7004-46e9-9821-cf3e8628e4df","Type":"ContainerStarted","Data":"0501224989e11af1a14cb538e026b57dc1f73b83626fb6904278517cc9fb6cd3"}
Nov 04 02:16:11.757159 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:11.757125    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:12.608264 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:12.608220    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xctgd" event={"ID":"db7921f7-4844-4111-9f43-6aa6eeccf9c6","Type":"ContainerStarted","Data":"bc6cb753e06dd99bda0c2244ac00ea5517901cd8fdd21f5747fe52c07a26bc12"}
Nov 04 02:16:16.030856 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:16.030821    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:16.031265 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:16.031016    4548 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Nov 04 02:16:17.089269 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:17.089235    4548 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-130-155.us-west-2.compute.internal" event="NodeReady"
Nov 04 02:16:20.449017 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.448980    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5468665ff7-gbwzk"]
Nov 04 02:16:20.452455 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.452437    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.489371 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.489338    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ba922d2-b579-46b3-bf15-c93a78090de7-registry-tls\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.489371 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.489374    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ba922d2-b579-46b3-bf15-c93a78090de7-ca-trust-extracted\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.489606 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.489391    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ba922d2-b579-46b3-bf15-c93a78090de7-installation-pull-secrets\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.489606 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.489422    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ba922d2-b579-46b3-bf15-c93a78090de7-trusted-ca\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.489606 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.489491    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ba922d2-b579-46b3-bf15-c93a78090de7-bound-sa-token\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.489709 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.489660    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ba922d2-b579-46b3-bf15-c93a78090de7-image-registry-private-configuration\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.489709 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.489681    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ba922d2-b579-46b3-bf15-c93a78090de7-registry-certificates\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.489782 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.489705    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8x2z\" (UniqueName: \"kubernetes.io/projected/7ba922d2-b579-46b3-bf15-c93a78090de7-kube-api-access-h8x2z\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.544605 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.544559    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Nov 04 02:16:20.544605 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.544587    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-rhnhd\""
Nov 04 02:16:20.590218 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.590152    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ba922d2-b579-46b3-bf15-c93a78090de7-trusted-ca\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.590218 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.590212    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ba922d2-b579-46b3-bf15-c93a78090de7-bound-sa-token\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.590462 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.590258    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ba922d2-b579-46b3-bf15-c93a78090de7-image-registry-private-configuration\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.590462 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.590274    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ba922d2-b579-46b3-bf15-c93a78090de7-registry-certificates\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.590462 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.590312    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8x2z\" (UniqueName: \"kubernetes.io/projected/7ba922d2-b579-46b3-bf15-c93a78090de7-kube-api-access-h8x2z\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.590462 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.590334    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ba922d2-b579-46b3-bf15-c93a78090de7-registry-tls\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.590462 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.590350    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ba922d2-b579-46b3-bf15-c93a78090de7-ca-trust-extracted\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.590462 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.590364    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ba922d2-b579-46b3-bf15-c93a78090de7-installation-pull-secrets\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.590891 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.590860    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/7ba922d2-b579-46b3-bf15-c93a78090de7-ca-trust-extracted\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.591163 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.591143    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/7ba922d2-b579-46b3-bf15-c93a78090de7-registry-certificates\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.593039 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.593010    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/7ba922d2-b579-46b3-bf15-c93a78090de7-installation-pull-secrets\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.656917 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.656881    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Nov 04 02:16:20.657188 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.656923    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Nov 04 02:16:20.657319 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.656956    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Nov 04 02:16:20.657786 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.657763    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5468665ff7-gbwzk"]
Nov 04 02:16:20.659563 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.659533    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/7ba922d2-b579-46b3-bf15-c93a78090de7-bound-sa-token\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.659656 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.659637    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8x2z\" (UniqueName: \"kubernetes.io/projected/7ba922d2-b579-46b3-bf15-c93a78090de7-kube-api-access-h8x2z\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.661112 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.661080    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7ba922d2-b579-46b3-bf15-c93a78090de7-trusted-ca\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.662552 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.662525    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/7ba922d2-b579-46b3-bf15-c93a78090de7-image-registry-private-configuration\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.662835 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.662815    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/7ba922d2-b579-46b3-bf15-c93a78090de7-registry-tls\") pod \"image-registry-5468665ff7-gbwzk\" (UID: \"7ba922d2-b579-46b3-bf15-c93a78090de7\") " pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:20.762612 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:20.762516    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:21.239497 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:21.239457    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5468665ff7-gbwzk"]
Nov 04 02:16:21.243081 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:21.243052    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ba922d2_b579_46b3_bf15_c93a78090de7.slice/crio-e2b8caf318151ba19d5e54b4c6dd66e385933c2e0a0bbeda45fd19c315a80387 WatchSource:0}: Error finding container e2b8caf318151ba19d5e54b4c6dd66e385933c2e0a0bbeda45fd19c315a80387: Status 404 returned error can't find the container with id e2b8caf318151ba19d5e54b4c6dd66e385933c2e0a0bbeda45fd19c315a80387
Nov 04 02:16:21.610631 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:21.610602    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fj84x"
Nov 04 02:16:21.641739 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:21.641701    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5468665ff7-gbwzk" event={"ID":"7ba922d2-b579-46b3-bf15-c93a78090de7","Type":"ContainerStarted","Data":"e76b0ce2313f6cc605a0e3f1e7400d6a4c5666393db039cd4acc3db0982e2312"}
Nov 04 02:16:21.641915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:21.641764    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5468665ff7-gbwzk" event={"ID":"7ba922d2-b579-46b3-bf15-c93a78090de7","Type":"ContainerStarted","Data":"e2b8caf318151ba19d5e54b4c6dd66e385933c2e0a0bbeda45fd19c315a80387"}
Nov 04 02:16:21.641915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:21.641790    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:21.852944 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:21.852886    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5468665ff7-gbwzk" podStartSLOduration=1.852871291 podStartE2EDuration="1.852871291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:16:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:21.851964313 +0000 UTC m=+15.456977311" watchObservedRunningTime="2026-11-04 02:16:21.852871291 +0000 UTC m=+15.457884267"
Nov 04 02:16:28.811444 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:28.811414    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g86jv"
Nov 04 02:16:39.364850 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.364811    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fbjpj"]
Nov 04 02:16:39.403164 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.403134    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.458314 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.458282    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-qzhl8\""
Nov 04 02:16:39.458314 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.458296    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Nov 04 02:16:39.509839 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.509799    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Nov 04 02:16:39.509839 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.509799    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Nov 04 02:16:39.509839 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.509837    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Nov 04 02:16:39.510101 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.509898    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Nov 04 02:16:39.510101 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.509917    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Nov 04 02:16:39.519317 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.519283    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d947c81-33f3-4b2c-88f2-cc9a842d240d-sys\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.519317 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.519318    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d947c81-33f3-4b2c-88f2-cc9a842d240d-node-exporter-tls\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.519515 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.519337    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk6h6\" (UniqueName: \"kubernetes.io/projected/6d947c81-33f3-4b2c-88f2-cc9a842d240d-kube-api-access-wk6h6\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.519515 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.519401    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d947c81-33f3-4b2c-88f2-cc9a842d240d-metrics-client-ca\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.519515 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.519483    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d947c81-33f3-4b2c-88f2-cc9a842d240d-root\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.519606 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.519515    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d947c81-33f3-4b2c-88f2-cc9a842d240d-node-exporter-wtmp\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.519606 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.519586    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d947c81-33f3-4b2c-88f2-cc9a842d240d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.519660 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.519626    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d947c81-33f3-4b2c-88f2-cc9a842d240d-node-exporter-accelerators-collector-config\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.519660 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.519650    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d947c81-33f3-4b2c-88f2-cc9a842d240d-node-exporter-textfile\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.621111 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.620951    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d947c81-33f3-4b2c-88f2-cc9a842d240d-node-exporter-accelerators-collector-config\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.621111 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.621080    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d947c81-33f3-4b2c-88f2-cc9a842d240d-node-exporter-textfile\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.621408 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.621145    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d947c81-33f3-4b2c-88f2-cc9a842d240d-sys\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.621408 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.621192    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d947c81-33f3-4b2c-88f2-cc9a842d240d-node-exporter-tls\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.621408 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.621218    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk6h6\" (UniqueName: \"kubernetes.io/projected/6d947c81-33f3-4b2c-88f2-cc9a842d240d-kube-api-access-wk6h6\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.621408 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.621242    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d947c81-33f3-4b2c-88f2-cc9a842d240d-metrics-client-ca\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.621408 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.621266    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d947c81-33f3-4b2c-88f2-cc9a842d240d-root\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.621408 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.621286    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d947c81-33f3-4b2c-88f2-cc9a842d240d-node-exporter-wtmp\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.621408 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.621286    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6d947c81-33f3-4b2c-88f2-cc9a842d240d-sys\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.621408 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.621318    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d947c81-33f3-4b2c-88f2-cc9a842d240d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.621775 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.621531    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/6d947c81-33f3-4b2c-88f2-cc9a842d240d-node-exporter-textfile\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.621775 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.621666    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/6d947c81-33f3-4b2c-88f2-cc9a842d240d-node-exporter-accelerators-collector-config\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.621889 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.621782    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/6d947c81-33f3-4b2c-88f2-cc9a842d240d-root\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.621889 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.621827    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d947c81-33f3-4b2c-88f2-cc9a842d240d-metrics-client-ca\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.621979 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.621907    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/6d947c81-33f3-4b2c-88f2-cc9a842d240d-node-exporter-wtmp\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.624288 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.624257    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6d947c81-33f3-4b2c-88f2-cc9a842d240d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.624484 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.624462    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/6d947c81-33f3-4b2c-88f2-cc9a842d240d-node-exporter-tls\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.683366 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.683333    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk6h6\" (UniqueName: \"kubernetes.io/projected/6d947c81-33f3-4b2c-88f2-cc9a842d240d-kube-api-access-wk6h6\") pod \"node-exporter-fbjpj\" (UID: \"6d947c81-33f3-4b2c-88f2-cc9a842d240d\") " pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.752410 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.752365    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fbjpj"
Nov 04 02:16:39.790919 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:39.790878    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d947c81_33f3_4b2c_88f2_cc9a842d240d.slice/crio-e3c8cfb8034ec3f31cb78d27cc4e4b8132efaf817a1d5dd2b2bf53a189bd716e WatchSource:0}: Error finding container e3c8cfb8034ec3f31cb78d27cc4e4b8132efaf817a1d5dd2b2bf53a189bd716e: Status 404 returned error can't find the container with id e3c8cfb8034ec3f31cb78d27cc4e4b8132efaf817a1d5dd2b2bf53a189bd716e
Nov 04 02:16:39.904632 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:39.904537    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5pvtj"
Nov 04 02:16:40.611754 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:16:40.611706    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:16:40.710282 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:40.710239    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fbjpj" event={"ID":"6d947c81-33f3-4b2c-88f2-cc9a842d240d","Type":"ContainerStarted","Data":"e3c8cfb8034ec3f31cb78d27cc4e4b8132efaf817a1d5dd2b2bf53a189bd716e"}
Nov 04 02:16:42.060243 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.057948    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5b8865689d-rmzbk"]
Nov 04 02:16:42.079483 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.079441    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b8865689d-rmzbk"]
Nov 04 02:16:42.079642 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.079556    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.144009 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.143966    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f256b50-7193-4e27-9edd-340c99f0384e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.144009 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.144012    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8f256b50-7193-4e27-9edd-340c99f0384e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.144350 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.144037    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f256b50-7193-4e27-9edd-340c99f0384e-tmp\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.144350 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.144124    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8f256b50-7193-4e27-9edd-340c99f0384e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.144350 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.144213    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjr7b\" (UniqueName: \"kubernetes.io/projected/8f256b50-7193-4e27-9edd-340c99f0384e-kube-api-access-vjr7b\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.144350 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.144275    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f256b50-7193-4e27-9edd-340c99f0384e-secret-grpc-tls\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.144350 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.144316    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8f256b50-7193-4e27-9edd-340c99f0384e-secret-thanos-querier-tls\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.144519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.144355    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f256b50-7193-4e27-9edd-340c99f0384e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.144519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.144446    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f256b50-7193-4e27-9edd-340c99f0384e-metrics-client-ca\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.178469 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.178425    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Nov 04 02:16:42.178651 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.178510    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Nov 04 02:16:42.182684 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.182654    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-epurh19dmrsf3\""
Nov 04 02:16:42.182824 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.182707    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Nov 04 02:16:42.182824 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.182730    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Nov 04 02:16:42.182824 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.182730    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Nov 04 02:16:42.182824 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.182774    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qc4sf\""
Nov 04 02:16:42.244855 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.244822    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f256b50-7193-4e27-9edd-340c99f0384e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.245047 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.244863    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8f256b50-7193-4e27-9edd-340c99f0384e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.245047 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.245010    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f256b50-7193-4e27-9edd-340c99f0384e-tmp\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.245183 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.245068    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8f256b50-7193-4e27-9edd-340c99f0384e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.245183 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.245103    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjr7b\" (UniqueName: \"kubernetes.io/projected/8f256b50-7193-4e27-9edd-340c99f0384e-kube-api-access-vjr7b\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.245183 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.245134    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f256b50-7193-4e27-9edd-340c99f0384e-secret-grpc-tls\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.245344 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.245197    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8f256b50-7193-4e27-9edd-340c99f0384e-secret-thanos-querier-tls\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.245485 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.245463    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f256b50-7193-4e27-9edd-340c99f0384e-tmp\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.245554 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.245507    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f256b50-7193-4e27-9edd-340c99f0384e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.245917 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.245820    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f256b50-7193-4e27-9edd-340c99f0384e-metrics-client-ca\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.246530 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.246504    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8f256b50-7193-4e27-9edd-340c99f0384e-metrics-client-ca\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.247997 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.247965    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8f256b50-7193-4e27-9edd-340c99f0384e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.248095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.247971    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8f256b50-7193-4e27-9edd-340c99f0384e-secret-grpc-tls\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.248159 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.248135    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8f256b50-7193-4e27-9edd-340c99f0384e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.248463 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.248443    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8f256b50-7193-4e27-9edd-340c99f0384e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.248526 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.248504    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8f256b50-7193-4e27-9edd-340c99f0384e-secret-thanos-querier-tls\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.249002 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.248983    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8f256b50-7193-4e27-9edd-340c99f0384e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.306998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.306964    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjr7b\" (UniqueName: \"kubernetes.io/projected/8f256b50-7193-4e27-9edd-340c99f0384e-kube-api-access-vjr7b\") pod \"thanos-querier-5b8865689d-rmzbk\" (UID: \"8f256b50-7193-4e27-9edd-340c99f0384e\") " pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.492464 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.492404    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:42.649463 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.649382    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5468665ff7-gbwzk"
Nov 04 02:16:42.718482 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.718452    4548 generic.go:356] "Generic (PLEG): container finished" podID="6d947c81-33f3-4b2c-88f2-cc9a842d240d" containerID="09ebfc98da21cf58b7276ba825f40269b83a0dee93a6df11e0b34ae2864aabcc" exitCode=0
Nov 04 02:16:42.718663 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.718532    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fbjpj" event={"ID":"6d947c81-33f3-4b2c-88f2-cc9a842d240d","Type":"ContainerDied","Data":"09ebfc98da21cf58b7276ba825f40269b83a0dee93a6df11e0b34ae2864aabcc"}
Nov 04 02:16:42.968015 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:42.967982    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5b8865689d-rmzbk"]
Nov 04 02:16:42.971269 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:42.971230    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f256b50_7193_4e27_9edd_340c99f0384e.slice/crio-62a83331c09c1af426fd087ec7aad4ffec358b5c8602081519d9e3ba2eb71c9d WatchSource:0}: Error finding container 62a83331c09c1af426fd087ec7aad4ffec358b5c8602081519d9e3ba2eb71c9d: Status 404 returned error can't find the container with id 62a83331c09c1af426fd087ec7aad4ffec358b5c8602081519d9e3ba2eb71c9d
Nov 04 02:16:43.724722 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:43.724688    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fbjpj" event={"ID":"6d947c81-33f3-4b2c-88f2-cc9a842d240d","Type":"ContainerStarted","Data":"17bf5343ee6126941fa02437069a3a0086dd59ef8111547094fc36c28c968a28"}
Nov 04 02:16:43.725247 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:43.724748    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fbjpj" event={"ID":"6d947c81-33f3-4b2c-88f2-cc9a842d240d","Type":"ContainerStarted","Data":"3fa7a24a212a860e59517b6e465d1863d0597efd9a92e09b3d14477af8694cec"}
Nov 04 02:16:43.726037 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:43.726004    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk" event={"ID":"8f256b50-7193-4e27-9edd-340c99f0384e","Type":"ContainerStarted","Data":"62a83331c09c1af426fd087ec7aad4ffec358b5c8602081519d9e3ba2eb71c9d"}
Nov 04 02:16:43.853442 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:43.853365    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fbjpj" podStartSLOduration=2.197692119 podStartE2EDuration="4.853337995s" totalImagesPullingTime="2.552304399s" totalInitContainerRuntime="103.341477ms" isStatefulPod=true podCreationTimestamp="2026-11-04 02:16:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:43.852785764 +0000 UTC m=+37.457798762" watchObservedRunningTime="2026-11-04 02:16:43.853337995 +0000 UTC m=+37.458350993"
Nov 04 02:16:47.741137 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:47.741045    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk" event={"ID":"8f256b50-7193-4e27-9edd-340c99f0384e","Type":"ContainerStarted","Data":"c5bf37a3b5f1af0514e5baf581a6c66cecbe4700366678110a1e250eeffdd2cd"}
Nov 04 02:16:47.741137 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:47.741114    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk" event={"ID":"8f256b50-7193-4e27-9edd-340c99f0384e","Type":"ContainerStarted","Data":"f7e5857ffcc4940420e2e1ea043ff9978e719cf19ca2270c379732804a9ec0e8"}
Nov 04 02:16:47.741137 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:47.741139    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk" event={"ID":"8f256b50-7193-4e27-9edd-340c99f0384e","Type":"ContainerStarted","Data":"a023c2d2af0ba964a0e57a136553bbd9c8681655036650fca30ecbbf2d326aac"}
Nov 04 02:16:49.751053 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:49.751014    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk" event={"ID":"8f256b50-7193-4e27-9edd-340c99f0384e","Type":"ContainerStarted","Data":"a0e479801afd7ca7f2a1296e274594b1872f1caba73f4d14e4079eae812e9f88"}
Nov 04 02:16:49.751504 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:49.751082    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk" event={"ID":"8f256b50-7193-4e27-9edd-340c99f0384e","Type":"ContainerStarted","Data":"15132a519c344cfc36f56eb109d8400af9656c0306ebeb18563057ec46d5ef54"}
Nov 04 02:16:49.751504 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:49.751108    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk" event={"ID":"8f256b50-7193-4e27-9edd-340c99f0384e","Type":"ContainerStarted","Data":"37fa20b23d197fb7678cf23e1320e904648d6db4dbd19be20bf4040abd61bd97"}
Nov 04 02:16:49.751504 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:49.751226    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:49.982573 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:49.982514    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk" podStartSLOduration=3.023481044 podStartE2EDuration="8.982500469s" totalImagesPullingTime="5.959019425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:16:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:49.932135173 +0000 UTC m=+43.537148170" watchObservedRunningTime="2026-11-04 02:16:49.982500469 +0000 UTC m=+43.587513467"
Nov 04 02:16:53.033801 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.033761    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c98cc7659-k76qn"]
Nov 04 02:16:53.036234 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.036210    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.091275 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.091246    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Nov 04 02:16:53.133629 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.133589    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-service-ca\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.133629 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.133627    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-oauth-serving-cert\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.133867 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.133652    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-trusted-ca-bundle\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.133867 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.133770    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7048aa2-432c-4b45-917f-ea60f8012d2d-tmp\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.133867 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.133806    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cfch\" (UniqueName: \"kubernetes.io/projected/c7048aa2-432c-4b45-917f-ea60f8012d2d-kube-api-access-6cfch\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.133867 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.133828    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-config\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.134008 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.133884    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-serving-cert\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.134008 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.133982    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-oauth-config\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.139034 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.139014    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Nov 04 02:16:53.139143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.139014    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Nov 04 02:16:53.139143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.139014    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Nov 04 02:16:53.139143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.139061    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Nov 04 02:16:53.139143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.139071    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Nov 04 02:16:53.139143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.139143    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l84rh\""
Nov 04 02:16:53.142199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.142145    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c98cc7659-k76qn"]
Nov 04 02:16:53.190113 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.190079    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Nov 04 02:16:53.191273 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.191254    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-lrnr2-ck96b"]
Nov 04 02:16:53.191732 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.191684    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-insights/periodic-gathering-lrnr2-ck96b" podUID="ae0be1c5-e730-4d02-84d7-f66a9666af87" containerName="insights-gathering" containerID="cri-o://22bd27bb9add946fc54be217f3b9f8874cc7c58f4a61ff5835f250227b006c6e" gracePeriod=30
Nov 04 02:16:53.234685 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.234648    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7048aa2-432c-4b45-917f-ea60f8012d2d-tmp\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.234873 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.234692    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cfch\" (UniqueName: \"kubernetes.io/projected/c7048aa2-432c-4b45-917f-ea60f8012d2d-kube-api-access-6cfch\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.234873 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.234713    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-config\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.234873 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.234745    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-serving-cert\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.234873 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.234775    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-oauth-config\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.234873 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.234811    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-service-ca\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.234873 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.234834    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-oauth-serving-cert\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.235191 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.234975    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-trusted-ca-bundle\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.235259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.235196    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7048aa2-432c-4b45-917f-ea60f8012d2d-tmp\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.235701 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.235633    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-oauth-serving-cert\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.235701 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.235671    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-service-ca\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.235701 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.235694    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-config\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.237461 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.237435    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-oauth-config\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.237461 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.237452    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-serving-cert\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.252858 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.252828    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Nov 04 02:16:53.256697 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.256671    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-trusted-ca-bundle\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.297214 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.297129    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cfch\" (UniqueName: \"kubernetes.io/projected/c7048aa2-432c-4b45-917f-ea60f8012d2d-kube-api-access-6cfch\") pod \"console-5c98cc7659-k76qn\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") " pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.346888 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.346851    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:16:53.451594 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.451564    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:16:53.537021 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.536980    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-service-ca-bundle\") pod \"ae0be1c5-e730-4d02-84d7-f66a9666af87\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") "
Nov 04 02:16:53.537021 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.537019    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-trusted-ca-bundle\") pod \"ae0be1c5-e730-4d02-84d7-f66a9666af87\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") "
Nov 04 02:16:53.537302 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.537078    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ae0be1c5-e730-4d02-84d7-f66a9666af87-kube-api-access-dzl2p\" (UniqueName: \"kubernetes.io/projected/ae0be1c5-e730-4d02-84d7-f66a9666af87-kube-api-access-dzl2p\") pod \"ae0be1c5-e730-4d02-84d7-f66a9666af87\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") "
Nov 04 02:16:53.537302 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.537110    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ae0be1c5-e730-4d02-84d7-f66a9666af87-archives-path\" (UniqueName: \"kubernetes.io/empty-dir/ae0be1c5-e730-4d02-84d7-f66a9666af87-archives-path\") pod \"ae0be1c5-e730-4d02-84d7-f66a9666af87\" (UID: \"ae0be1c5-e730-4d02-84d7-f66a9666af87\") "
Nov 04 02:16:53.537482 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.537458    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae0be1c5-e730-4d02-84d7-f66a9666af87-archives-path" pod "ae0be1c5-e730-4d02-84d7-f66a9666af87" (UID: "ae0be1c5-e730-4d02-84d7-f66a9666af87"). InnerVolumeSpecName "archives-path". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:16:53.537538 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.537474    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-service-ca-bundle" pod "ae0be1c5-e730-4d02-84d7-f66a9666af87" (UID: "ae0be1c5-e730-4d02-84d7-f66a9666af87"). InnerVolumeSpecName "service-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:16:53.537538 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.537488    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-trusted-ca-bundle" pod "ae0be1c5-e730-4d02-84d7-f66a9666af87" (UID: "ae0be1c5-e730-4d02-84d7-f66a9666af87"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:16:53.539520 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.539503    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae0be1c5-e730-4d02-84d7-f66a9666af87-kube-api-access-dzl2p" pod "ae0be1c5-e730-4d02-84d7-f66a9666af87" (UID: "ae0be1c5-e730-4d02-84d7-f66a9666af87"). InnerVolumeSpecName "kube-api-access-dzl2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:16:53.638553 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.638465    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzl2p\" (UniqueName: \"kubernetes.io/projected/ae0be1c5-e730-4d02-84d7-f66a9666af87-kube-api-access-dzl2p\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:16:53.638553 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.638498    4548 reconciler_common.go:299] "Volume detached for volume \"archives-path\" (UniqueName: \"kubernetes.io/empty-dir/ae0be1c5-e730-4d02-84d7-f66a9666af87-archives-path\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:16:53.638553 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.638508    4548 reconciler_common.go:299] "Volume detached for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-service-ca-bundle\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:16:53.638553 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.638518    4548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ae0be1c5-e730-4d02-84d7-f66a9666af87-trusted-ca-bundle\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:16:53.765843 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.765805    4548 generic.go:356] "Generic (PLEG): container finished" podID="ae0be1c5-e730-4d02-84d7-f66a9666af87" containerID="22bd27bb9add946fc54be217f3b9f8874cc7c58f4a61ff5835f250227b006c6e" exitCode=2
Nov 04 02:16:53.766021 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.765856    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-insights/periodic-gathering-lrnr2-ck96b"
Nov 04 02:16:53.766021 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.765852    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-lrnr2-ck96b" event={"ID":"ae0be1c5-e730-4d02-84d7-f66a9666af87","Type":"ContainerDied","Data":"22bd27bb9add946fc54be217f3b9f8874cc7c58f4a61ff5835f250227b006c6e"}
Nov 04 02:16:53.766021 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.765911    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/periodic-gathering-lrnr2-ck96b" event={"ID":"ae0be1c5-e730-4d02-84d7-f66a9666af87","Type":"ContainerDied","Data":"bda92b0002df125ba344b3a6e05bfa2bef67825807ef59bbb91312db54cc4840"}
Nov 04 02:16:53.766021 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.765932    4548 scope.go:122] "RemoveContainer" containerID="22bd27bb9add946fc54be217f3b9f8874cc7c58f4a61ff5835f250227b006c6e"
Nov 04 02:16:53.775517 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.775487    4548 scope.go:122] "RemoveContainer" containerID="22bd27bb9add946fc54be217f3b9f8874cc7c58f4a61ff5835f250227b006c6e"
Nov 04 02:16:53.775898 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:16:53.775877    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22bd27bb9add946fc54be217f3b9f8874cc7c58f4a61ff5835f250227b006c6e\": container with ID starting with 22bd27bb9add946fc54be217f3b9f8874cc7c58f4a61ff5835f250227b006c6e not found: ID does not exist" containerID="22bd27bb9add946fc54be217f3b9f8874cc7c58f4a61ff5835f250227b006c6e"
Nov 04 02:16:53.775990 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.775912    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22bd27bb9add946fc54be217f3b9f8874cc7c58f4a61ff5835f250227b006c6e"} err="failed to get container status \"22bd27bb9add946fc54be217f3b9f8874cc7c58f4a61ff5835f250227b006c6e\": rpc error: code = NotFound desc = could not find container \"22bd27bb9add946fc54be217f3b9f8874cc7c58f4a61ff5835f250227b006c6e\": container with ID starting with 22bd27bb9add946fc54be217f3b9f8874cc7c58f4a61ff5835f250227b006c6e not found: ID does not exist"
Nov 04 02:16:53.775990 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.775960    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c98cc7659-k76qn"]
Nov 04 02:16:53.778875 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:16:53.778850    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7048aa2_432c_4b45_917f_ea60f8012d2d.slice/crio-c69f6dc36a80fbfc17b866d2f0d6680ef3c16e24347261bc869ae68b2bb65e6d WatchSource:0}: Error finding container c69f6dc36a80fbfc17b866d2f0d6680ef3c16e24347261bc869ae68b2bb65e6d: Status 404 returned error can't find the container with id c69f6dc36a80fbfc17b866d2f0d6680ef3c16e24347261bc869ae68b2bb65e6d
Nov 04 02:16:53.932002 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.931910    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-insights/periodic-gathering-lrnr2-ck96b"]
Nov 04 02:16:53.952095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:53.952053    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-insights/periodic-gathering-lrnr2-ck96b"]
Nov 04 02:16:54.521290 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:54.521264    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ae0be1c5-e730-4d02-84d7-f66a9666af87" path="/var/lib/kubelet/pods/ae0be1c5-e730-4d02-84d7-f66a9666af87/volumes"
Nov 04 02:16:54.772025 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:54.771935    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c98cc7659-k76qn" event={"ID":"c7048aa2-432c-4b45-917f-ea60f8012d2d","Type":"ContainerStarted","Data":"c69f6dc36a80fbfc17b866d2f0d6680ef3c16e24347261bc869ae68b2bb65e6d"}
Nov 04 02:16:55.764285 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:55.764258    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5b8865689d-rmzbk"
Nov 04 02:16:59.792043 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:59.792000    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c98cc7659-k76qn" event={"ID":"c7048aa2-432c-4b45-917f-ea60f8012d2d","Type":"ContainerStarted","Data":"f45a360218c5023d978e47af5b025b2dedf96df85ae70262fc66f2dd04c5878a"}
Nov 04 02:16:59.961917 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:16:59.961844    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-5c98cc7659-k76qn" podStartSLOduration=2.8471995740000002 podStartE2EDuration="7.961830325s" totalImagesPullingTime="5.114630751s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:16:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:16:59.911275034 +0000 UTC m=+53.516288033" watchObservedRunningTime="2026-11-04 02:16:59.961830325 +0000 UTC m=+53.566843322"
Nov 04 02:17:03.347657 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:17:03.347615    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:17:03.348058 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:17:03.347903    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:17:03.352854 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:17:03.352829    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:17:03.810348 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:17:03.810318    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:17:10.610689 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:17:10.610646    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:17:40.610541 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:17:40.610495    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:18:02.041649 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.041607    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-746dc8c4b-9pwzz"]
Nov 04 02:18:02.042056 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.042037    4548 cpu_manager.go:414] "containerMap: removing container" podUID="ae0be1c5-e730-4d02-84d7-f66a9666af87" containerName="insights-gathering"
Nov 04 02:18:02.042097 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.042062    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ae0be1c5-e730-4d02-84d7-f66a9666af87" containerName="insights-gathering"
Nov 04 02:18:02.042187 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.042155    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="ae0be1c5-e730-4d02-84d7-f66a9666af87" containerName="insights-gathering"
Nov 04 02:18:02.045104 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.045088    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.103357 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.103318    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-746dc8c4b-9pwzz"]
Nov 04 02:18:02.154214 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.154146    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr5w8\" (UniqueName: \"kubernetes.io/projected/b484ac30-c62e-4555-b3cf-9640b83601ac-kube-api-access-lr5w8\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.154397 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.154226    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b484ac30-c62e-4555-b3cf-9640b83601ac-console-serving-cert\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.154397 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.154264    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b484ac30-c62e-4555-b3cf-9640b83601ac-oauth-serving-cert\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.154397 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.154351    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b484ac30-c62e-4555-b3cf-9640b83601ac-console-config\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.154397 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.154373    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b484ac30-c62e-4555-b3cf-9640b83601ac-tmp\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.154529 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.154399    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b484ac30-c62e-4555-b3cf-9640b83601ac-trusted-ca-bundle\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.154529 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.154420    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b484ac30-c62e-4555-b3cf-9640b83601ac-service-ca\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.154529 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.154518    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b484ac30-c62e-4555-b3cf-9640b83601ac-console-oauth-config\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.255923 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.255876    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b484ac30-c62e-4555-b3cf-9640b83601ac-tmp\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.255923 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.255926    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b484ac30-c62e-4555-b3cf-9640b83601ac-trusted-ca-bundle\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.256164 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.255953    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b484ac30-c62e-4555-b3cf-9640b83601ac-service-ca\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.256164 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.255992    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b484ac30-c62e-4555-b3cf-9640b83601ac-console-oauth-config\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.256164 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.256035    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr5w8\" (UniqueName: \"kubernetes.io/projected/b484ac30-c62e-4555-b3cf-9640b83601ac-kube-api-access-lr5w8\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.256164 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.256070    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b484ac30-c62e-4555-b3cf-9640b83601ac-console-serving-cert\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.256164 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.256096    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b484ac30-c62e-4555-b3cf-9640b83601ac-oauth-serving-cert\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.256164 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.256129    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b484ac30-c62e-4555-b3cf-9640b83601ac-console-config\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.256502 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.256479    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b484ac30-c62e-4555-b3cf-9640b83601ac-tmp\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.256764 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.256739    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b484ac30-c62e-4555-b3cf-9640b83601ac-service-ca\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.256927 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.256905    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b484ac30-c62e-4555-b3cf-9640b83601ac-console-config\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.256927 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.256905    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b484ac30-c62e-4555-b3cf-9640b83601ac-trusted-ca-bundle\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.257013 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.256954    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b484ac30-c62e-4555-b3cf-9640b83601ac-oauth-serving-cert\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.259233 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.259214    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b484ac30-c62e-4555-b3cf-9640b83601ac-console-serving-cert\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.259349 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.259325    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b484ac30-c62e-4555-b3cf-9640b83601ac-console-oauth-config\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.317664 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.317594    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr5w8\" (UniqueName: \"kubernetes.io/projected/b484ac30-c62e-4555-b3cf-9640b83601ac-kube-api-access-lr5w8\") pod \"console-746dc8c4b-9pwzz\" (UID: \"b484ac30-c62e-4555-b3cf-9640b83601ac\") " pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.356474 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.356426    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:02.780220 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:02.780186    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-746dc8c4b-9pwzz"]
Nov 04 02:18:02.783493 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:18:02.783463    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb484ac30_c62e_4555_b3cf_9640b83601ac.slice/crio-90adc8f0b0f343d4f34a77fcc50ac988c3c8f3d7ee1b237580d617bc4ee75817 WatchSource:0}: Error finding container 90adc8f0b0f343d4f34a77fcc50ac988c3c8f3d7ee1b237580d617bc4ee75817: Status 404 returned error can't find the container with id 90adc8f0b0f343d4f34a77fcc50ac988c3c8f3d7ee1b237580d617bc4ee75817
Nov 04 02:18:03.001758 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:03.001718    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746dc8c4b-9pwzz" event={"ID":"b484ac30-c62e-4555-b3cf-9640b83601ac","Type":"ContainerStarted","Data":"4b850061b8ef457fe3761d8f643417252f532bfb9f0a980bcf79badf6bf85b75"}
Nov 04 02:18:03.001758 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:03.001769    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-746dc8c4b-9pwzz" event={"ID":"b484ac30-c62e-4555-b3cf-9640b83601ac","Type":"ContainerStarted","Data":"90adc8f0b0f343d4f34a77fcc50ac988c3c8f3d7ee1b237580d617bc4ee75817"}
Nov 04 02:18:03.121444 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:03.121335    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-746dc8c4b-9pwzz" podStartSLOduration=2.121320137 podStartE2EDuration="2.121320137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:18:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:18:03.121310503 +0000 UTC m=+116.726323501" watchObservedRunningTime="2026-11-04 02:18:03.121320137 +0000 UTC m=+116.726333131"
Nov 04 02:18:10.610586 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:18:10.610535    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:18:12.357434 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:12.357395    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:12.358006 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:12.357463    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:12.362378 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:12.362354    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:13.044034 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:13.044006    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-746dc8c4b-9pwzz"
Nov 04 02:18:13.214611 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:13.214576    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c98cc7659-k76qn"]
Nov 04 02:18:38.234937 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.234840    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-5c98cc7659-k76qn" podUID="c7048aa2-432c-4b45-917f-ea60f8012d2d" containerName="console" containerID="cri-o://f45a360218c5023d978e47af5b025b2dedf96df85ae70262fc66f2dd04c5878a" gracePeriod=15
Nov 04 02:18:38.480001 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.479974    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:18:38.543374 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.543339    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-oauth-serving-cert\") pod \"c7048aa2-432c-4b45-917f-ea60f8012d2d\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") "
Nov 04 02:18:38.543558 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.543385    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-oauth-config\") pod \"c7048aa2-432c-4b45-917f-ea60f8012d2d\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") "
Nov 04 02:18:38.543558 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.543425    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-serving-cert\") pod \"c7048aa2-432c-4b45-917f-ea60f8012d2d\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") "
Nov 04 02:18:38.543558 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.543460    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c7048aa2-432c-4b45-917f-ea60f8012d2d-tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7048aa2-432c-4b45-917f-ea60f8012d2d-tmp\") pod \"c7048aa2-432c-4b45-917f-ea60f8012d2d\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") "
Nov 04 02:18:38.543558 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.543503    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-service-ca\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-service-ca\") pod \"c7048aa2-432c-4b45-917f-ea60f8012d2d\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") "
Nov 04 02:18:38.543558 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.543528    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-config\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-config\") pod \"c7048aa2-432c-4b45-917f-ea60f8012d2d\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") "
Nov 04 02:18:38.543776 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.543576    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c7048aa2-432c-4b45-917f-ea60f8012d2d-kube-api-access-6cfch\" (UniqueName: \"kubernetes.io/projected/c7048aa2-432c-4b45-917f-ea60f8012d2d-kube-api-access-6cfch\") pod \"c7048aa2-432c-4b45-917f-ea60f8012d2d\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") "
Nov 04 02:18:38.543776 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.543620    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-trusted-ca-bundle\") pod \"c7048aa2-432c-4b45-917f-ea60f8012d2d\" (UID: \"c7048aa2-432c-4b45-917f-ea60f8012d2d\") "
Nov 04 02:18:38.543876 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.543787    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7048aa2-432c-4b45-917f-ea60f8012d2d-tmp" pod "c7048aa2-432c-4b45-917f-ea60f8012d2d" (UID: "c7048aa2-432c-4b45-917f-ea60f8012d2d"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:18:38.543935 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.543880    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-oauth-serving-cert" pod "c7048aa2-432c-4b45-917f-ea60f8012d2d" (UID: "c7048aa2-432c-4b45-917f-ea60f8012d2d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:18:38.544493 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.544040    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-service-ca" pod "c7048aa2-432c-4b45-917f-ea60f8012d2d" (UID: "c7048aa2-432c-4b45-917f-ea60f8012d2d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:18:38.544493 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.544050    4548 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-oauth-serving-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:38.544493 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.544096    4548 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c7048aa2-432c-4b45-917f-ea60f8012d2d-tmp\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:38.544493 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.544251    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-config" pod "c7048aa2-432c-4b45-917f-ea60f8012d2d" (UID: "c7048aa2-432c-4b45-917f-ea60f8012d2d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:18:38.544493 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.544343    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-trusted-ca-bundle" pod "c7048aa2-432c-4b45-917f-ea60f8012d2d" (UID: "c7048aa2-432c-4b45-917f-ea60f8012d2d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:18:38.546086 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.546057    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-oauth-config" pod "c7048aa2-432c-4b45-917f-ea60f8012d2d" (UID: "c7048aa2-432c-4b45-917f-ea60f8012d2d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:18:38.546277 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.546092    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-serving-cert" pod "c7048aa2-432c-4b45-917f-ea60f8012d2d" (UID: "c7048aa2-432c-4b45-917f-ea60f8012d2d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:18:38.546277 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.546182    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7048aa2-432c-4b45-917f-ea60f8012d2d-kube-api-access-6cfch" pod "c7048aa2-432c-4b45-917f-ea60f8012d2d" (UID: "c7048aa2-432c-4b45-917f-ea60f8012d2d"). InnerVolumeSpecName "kube-api-access-6cfch". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:18:38.644793 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.644752    4548 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-service-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:38.644793 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.644785    4548 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-config\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:38.644793 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.644797    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cfch\" (UniqueName: \"kubernetes.io/projected/c7048aa2-432c-4b45-917f-ea60f8012d2d-kube-api-access-6cfch\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:38.645036 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.644808    4548 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c7048aa2-432c-4b45-917f-ea60f8012d2d-trusted-ca-bundle\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:38.645036 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.644818    4548 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-oauth-config\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:38.645036 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:38.644827    4548 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c7048aa2-432c-4b45-917f-ea60f8012d2d-console-serving-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:18:39.127254 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:39.127211    4548 generic.go:356] "Generic (PLEG): container finished" podID="c7048aa2-432c-4b45-917f-ea60f8012d2d" containerID="f45a360218c5023d978e47af5b025b2dedf96df85ae70262fc66f2dd04c5878a" exitCode=0
Nov 04 02:18:39.127440 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:39.127267    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c98cc7659-k76qn"
Nov 04 02:18:39.127440 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:39.127304    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c98cc7659-k76qn" event={"ID":"c7048aa2-432c-4b45-917f-ea60f8012d2d","Type":"ContainerDied","Data":"f45a360218c5023d978e47af5b025b2dedf96df85ae70262fc66f2dd04c5878a"}
Nov 04 02:18:39.127440 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:39.127362    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c98cc7659-k76qn" event={"ID":"c7048aa2-432c-4b45-917f-ea60f8012d2d","Type":"ContainerDied","Data":"c69f6dc36a80fbfc17b866d2f0d6680ef3c16e24347261bc869ae68b2bb65e6d"}
Nov 04 02:18:39.127440 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:39.127388    4548 scope.go:122] "RemoveContainer" containerID="f45a360218c5023d978e47af5b025b2dedf96df85ae70262fc66f2dd04c5878a"
Nov 04 02:18:39.136424 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:39.136406    4548 scope.go:122] "RemoveContainer" containerID="f45a360218c5023d978e47af5b025b2dedf96df85ae70262fc66f2dd04c5878a"
Nov 04 02:18:39.136768 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:18:39.136746    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f45a360218c5023d978e47af5b025b2dedf96df85ae70262fc66f2dd04c5878a\": container with ID starting with f45a360218c5023d978e47af5b025b2dedf96df85ae70262fc66f2dd04c5878a not found: ID does not exist" containerID="f45a360218c5023d978e47af5b025b2dedf96df85ae70262fc66f2dd04c5878a"
Nov 04 02:18:39.136866 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:39.136774    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f45a360218c5023d978e47af5b025b2dedf96df85ae70262fc66f2dd04c5878a"} err="failed to get container status \"f45a360218c5023d978e47af5b025b2dedf96df85ae70262fc66f2dd04c5878a\": rpc error: code = NotFound desc = could not find container \"f45a360218c5023d978e47af5b025b2dedf96df85ae70262fc66f2dd04c5878a\": container with ID starting with f45a360218c5023d978e47af5b025b2dedf96df85ae70262fc66f2dd04c5878a not found: ID does not exist"
Nov 04 02:18:39.293899 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:39.293862    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5c98cc7659-k76qn"]
Nov 04 02:18:39.344216 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:39.344164    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5c98cc7659-k76qn"]
Nov 04 02:18:40.521617 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:18:40.521582    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c7048aa2-432c-4b45-917f-ea60f8012d2d" path="/var/lib/kubelet/pods/c7048aa2-432c-4b45-917f-ea60f8012d2d/volumes"
Nov 04 02:18:40.611250 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:18:40.611215    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:19:10.609848 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:19:10.609808    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:19:40.610663 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:19:40.610625    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:19:42.948808 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:42.948772    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9"]
Nov 04 02:19:42.949240 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:42.949032    4548 cpu_manager.go:414] "containerMap: removing container" podUID="c7048aa2-432c-4b45-917f-ea60f8012d2d" containerName="console"
Nov 04 02:19:42.949240 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:42.949042    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c7048aa2-432c-4b45-917f-ea60f8012d2d" containerName="console"
Nov 04 02:19:42.949240 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:42.949099    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="c7048aa2-432c-4b45-917f-ea60f8012d2d" containerName="console"
Nov 04 02:19:42.952085 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:42.952062    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9"
Nov 04 02:19:43.042566 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:43.042532    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xjhh\" (UniqueName: \"kubernetes.io/projected/f649e927-25bf-4f4c-8237-e61aaf7c2a85-kube-api-access-2xjhh\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9\" (UID: \"f649e927-25bf-4f4c-8237-e61aaf7c2a85\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9"
Nov 04 02:19:43.042566 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:43.042571    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f649e927-25bf-4f4c-8237-e61aaf7c2a85-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9\" (UID: \"f649e927-25bf-4f4c-8237-e61aaf7c2a85\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9"
Nov 04 02:19:43.042782 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:43.042590    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f649e927-25bf-4f4c-8237-e61aaf7c2a85-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9\" (UID: \"f649e927-25bf-4f4c-8237-e61aaf7c2a85\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9"
Nov 04 02:19:43.057604 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:43.057570    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Nov 04 02:19:43.057796 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:43.057633    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Nov 04 02:19:43.057796 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:43.057708    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c7537007944577f64df34960ace3c69136c416-139ec370-dockercfg-tkjz4\""
Nov 04 02:19:43.058453 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:43.058430    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9"]
Nov 04 02:19:43.143279 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:43.143231    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xjhh\" (UniqueName: \"kubernetes.io/projected/f649e927-25bf-4f4c-8237-e61aaf7c2a85-kube-api-access-2xjhh\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9\" (UID: \"f649e927-25bf-4f4c-8237-e61aaf7c2a85\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9"
Nov 04 02:19:43.143279 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:43.143280    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f649e927-25bf-4f4c-8237-e61aaf7c2a85-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9\" (UID: \"f649e927-25bf-4f4c-8237-e61aaf7c2a85\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9"
Nov 04 02:19:43.143503 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:43.143298    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f649e927-25bf-4f4c-8237-e61aaf7c2a85-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9\" (UID: \"f649e927-25bf-4f4c-8237-e61aaf7c2a85\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9"
Nov 04 02:19:43.143676 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:43.143658    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f649e927-25bf-4f4c-8237-e61aaf7c2a85-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9\" (UID: \"f649e927-25bf-4f4c-8237-e61aaf7c2a85\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9"
Nov 04 02:19:43.143734 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:43.143719    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f649e927-25bf-4f4c-8237-e61aaf7c2a85-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9\" (UID: \"f649e927-25bf-4f4c-8237-e61aaf7c2a85\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9"
Nov 04 02:19:43.206333 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:43.206253    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xjhh\" (UniqueName: \"kubernetes.io/projected/f649e927-25bf-4f4c-8237-e61aaf7c2a85-kube-api-access-2xjhh\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9\" (UID: \"f649e927-25bf-4f4c-8237-e61aaf7c2a85\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9"
Nov 04 02:19:43.267302 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:43.267264    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9"
Nov 04 02:19:43.640218 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:43.640160    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9"]
Nov 04 02:19:43.643527 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:19:43.643488    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf649e927_25bf_4f4c_8237_e61aaf7c2a85.slice/crio-c65e4f9074d703839547ce6ce56dab9d1acc83d7eef35e79bfe5cd9e92629492 WatchSource:0}: Error finding container c65e4f9074d703839547ce6ce56dab9d1acc83d7eef35e79bfe5cd9e92629492: Status 404 returned error can't find the container with id c65e4f9074d703839547ce6ce56dab9d1acc83d7eef35e79bfe5cd9e92629492
Nov 04 02:19:44.171871 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.171837    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8"]
Nov 04 02:19:44.176360 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.176340    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8"
Nov 04 02:19:44.231061 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.231011    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"c4959aeb960c8e20c88ac2de924a35b8221494-145dcd5a-dockercfg-4pczr\""
Nov 04 02:19:44.231788 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.231763    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8"]
Nov 04 02:19:44.250149 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.250113    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9317ace-8bc7-4042-8032-68ef8f9f192b-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8\" (UID: \"d9317ace-8bc7-4042-8032-68ef8f9f192b\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8"
Nov 04 02:19:44.250149 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.250157    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dpg4l\" (UniqueName: \"kubernetes.io/projected/d9317ace-8bc7-4042-8032-68ef8f9f192b-kube-api-access-dpg4l\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8\" (UID: \"d9317ace-8bc7-4042-8032-68ef8f9f192b\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8"
Nov 04 02:19:44.250384 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.250202    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9317ace-8bc7-4042-8032-68ef8f9f192b-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8\" (UID: \"d9317ace-8bc7-4042-8032-68ef8f9f192b\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8"
Nov 04 02:19:44.345190 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.345129    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9" event={"ID":"f649e927-25bf-4f4c-8237-e61aaf7c2a85","Type":"ContainerStarted","Data":"c65e4f9074d703839547ce6ce56dab9d1acc83d7eef35e79bfe5cd9e92629492"}
Nov 04 02:19:44.351523 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.351493    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9317ace-8bc7-4042-8032-68ef8f9f192b-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8\" (UID: \"d9317ace-8bc7-4042-8032-68ef8f9f192b\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8"
Nov 04 02:19:44.351640 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.351537    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dpg4l\" (UniqueName: \"kubernetes.io/projected/d9317ace-8bc7-4042-8032-68ef8f9f192b-kube-api-access-dpg4l\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8\" (UID: \"d9317ace-8bc7-4042-8032-68ef8f9f192b\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8"
Nov 04 02:19:44.351640 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.351558    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9317ace-8bc7-4042-8032-68ef8f9f192b-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8\" (UID: \"d9317ace-8bc7-4042-8032-68ef8f9f192b\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8"
Nov 04 02:19:44.351939 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.351921    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9317ace-8bc7-4042-8032-68ef8f9f192b-util\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8\" (UID: \"d9317ace-8bc7-4042-8032-68ef8f9f192b\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8"
Nov 04 02:19:44.351939 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.351931    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9317ace-8bc7-4042-8032-68ef8f9f192b-bundle\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8\" (UID: \"d9317ace-8bc7-4042-8032-68ef8f9f192b\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8"
Nov 04 02:19:44.413368 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.413338    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dpg4l\" (UniqueName: \"kubernetes.io/projected/d9317ace-8bc7-4042-8032-68ef8f9f192b-kube-api-access-dpg4l\") pod \"c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8\" (UID: \"d9317ace-8bc7-4042-8032-68ef8f9f192b\") " pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8"
Nov 04 02:19:44.492747 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.492653    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8"
Nov 04 02:19:44.612502 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.612458    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf"]
Nov 04 02:19:44.616046 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.616023    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf"
Nov 04 02:19:44.653139 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.653103    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5p77l\" (UniqueName: \"kubernetes.io/projected/6e659478-7758-4b59-bd70-27738e2cbca8-kube-api-access-5p77l\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf\" (UID: \"6e659478-7758-4b59-bd70-27738e2cbca8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf"
Nov 04 02:19:44.653139 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.653145    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e659478-7758-4b59-bd70-27738e2cbca8-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf\" (UID: \"6e659478-7758-4b59-bd70-27738e2cbca8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf"
Nov 04 02:19:44.653393 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.653188    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e659478-7758-4b59-bd70-27738e2cbca8-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf\" (UID: \"6e659478-7758-4b59-bd70-27738e2cbca8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf"
Nov 04 02:19:44.672193 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.672149    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf"]
Nov 04 02:19:44.674140 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.674114    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"6541d93aaee335d6227a8778ab4e840bbe7f52-f98fbcf8-dockercfg-s5cf7\""
Nov 04 02:19:44.713351 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.713319    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk"]
Nov 04 02:19:44.716707 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.716684    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk"
Nov 04 02:19:44.753937 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.753861    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e659478-7758-4b59-bd70-27738e2cbca8-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf\" (UID: \"6e659478-7758-4b59-bd70-27738e2cbca8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf"
Nov 04 02:19:44.753937 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.753898    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e659478-7758-4b59-bd70-27738e2cbca8-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf\" (UID: \"6e659478-7758-4b59-bd70-27738e2cbca8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf"
Nov 04 02:19:44.753937 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.753927    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz7h2\" (UniqueName: \"kubernetes.io/projected/386f800a-9968-4225-b9db-e643d416be01-kube-api-access-mz7h2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk\" (UID: \"386f800a-9968-4225-b9db-e643d416be01\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk"
Nov 04 02:19:44.754156 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.753971    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/386f800a-9968-4225-b9db-e643d416be01-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk\" (UID: \"386f800a-9968-4225-b9db-e643d416be01\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk"
Nov 04 02:19:44.754156 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.754022    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/386f800a-9968-4225-b9db-e643d416be01-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk\" (UID: \"386f800a-9968-4225-b9db-e643d416be01\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk"
Nov 04 02:19:44.754156 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.754108    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5p77l\" (UniqueName: \"kubernetes.io/projected/6e659478-7758-4b59-bd70-27738e2cbca8-kube-api-access-5p77l\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf\" (UID: \"6e659478-7758-4b59-bd70-27738e2cbca8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf"
Nov 04 02:19:44.754311 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.754244    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e659478-7758-4b59-bd70-27738e2cbca8-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf\" (UID: \"6e659478-7758-4b59-bd70-27738e2cbca8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf"
Nov 04 02:19:44.754345 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.754329    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e659478-7758-4b59-bd70-27738e2cbca8-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf\" (UID: \"6e659478-7758-4b59-bd70-27738e2cbca8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf"
Nov 04 02:19:44.774155 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.774123    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3-b83c8cba-dockercfg-ff9xj\""
Nov 04 02:19:44.779445 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.779409    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk"]
Nov 04 02:19:44.812362 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.812330    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd"]
Nov 04 02:19:44.815659 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.815637    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd"
Nov 04 02:19:44.818677 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.818651    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5p77l\" (UniqueName: \"kubernetes.io/projected/6e659478-7758-4b59-bd70-27738e2cbca8-kube-api-access-5p77l\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf\" (UID: \"6e659478-7758-4b59-bd70-27738e2cbca8\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf"
Nov 04 02:19:44.854624 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.854591    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/386f800a-9968-4225-b9db-e643d416be01-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk\" (UID: \"386f800a-9968-4225-b9db-e643d416be01\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk"
Nov 04 02:19:44.854844 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.854632    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2488a78-d7af-4346-a841-0deda0b64591-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd\" (UID: \"c2488a78-d7af-4346-a841-0deda0b64591\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd"
Nov 04 02:19:44.854844 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.854773    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz7h2\" (UniqueName: \"kubernetes.io/projected/386f800a-9968-4225-b9db-e643d416be01-kube-api-access-mz7h2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk\" (UID: \"386f800a-9968-4225-b9db-e643d416be01\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk"
Nov 04 02:19:44.854844 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.854831    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/386f800a-9968-4225-b9db-e643d416be01-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk\" (UID: \"386f800a-9968-4225-b9db-e643d416be01\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk"
Nov 04 02:19:44.855012 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.854866    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87n7n\" (UniqueName: \"kubernetes.io/projected/c2488a78-d7af-4346-a841-0deda0b64591-kube-api-access-87n7n\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd\" (UID: \"c2488a78-d7af-4346-a841-0deda0b64591\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd"
Nov 04 02:19:44.855012 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.854889    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2488a78-d7af-4346-a841-0deda0b64591-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd\" (UID: \"c2488a78-d7af-4346-a841-0deda0b64591\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd"
Nov 04 02:19:44.855123 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.855025    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/386f800a-9968-4225-b9db-e643d416be01-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk\" (UID: \"386f800a-9968-4225-b9db-e643d416be01\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk"
Nov 04 02:19:44.855352 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.855320    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/386f800a-9968-4225-b9db-e643d416be01-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk\" (UID: \"386f800a-9968-4225-b9db-e643d416be01\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk"
Nov 04 02:19:44.873187 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.873137    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd"]
Nov 04 02:19:44.874248 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.874222    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"da112bd609bff87f7bacd2ba941225d7cff15c-bd73b2fc-dockercfg-rbwqj\""
Nov 04 02:19:44.916246 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.916211    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh"]
Nov 04 02:19:44.919402 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.919322    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz7h2\" (UniqueName: \"kubernetes.io/projected/386f800a-9968-4225-b9db-e643d416be01-kube-api-access-mz7h2\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk\" (UID: \"386f800a-9968-4225-b9db-e643d416be01\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk"
Nov 04 02:19:44.920006 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.919941    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8"]
Nov 04 02:19:44.920118 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.920097    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh"
Nov 04 02:19:44.922836 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:19:44.922805    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9317ace_8bc7_4042_8032_68ef8f9f192b.slice/crio-63c9516c03acad095a50ecce249117352e0b804bcabbc6fb0b30bd3f65881bf9 WatchSource:0}: Error finding container 63c9516c03acad095a50ecce249117352e0b804bcabbc6fb0b30bd3f65881bf9: Status 404 returned error can't find the container with id 63c9516c03acad095a50ecce249117352e0b804bcabbc6fb0b30bd3f65881bf9
Nov 04 02:19:44.932127 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.932104    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf"
Nov 04 02:19:44.955419 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.955382    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2488a78-d7af-4346-a841-0deda0b64591-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd\" (UID: \"c2488a78-d7af-4346-a841-0deda0b64591\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd"
Nov 04 02:19:44.955597 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.955450    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbh27\" (UniqueName: \"kubernetes.io/projected/a2f160b0-ca53-4e4d-9163-49d7079f9091-kube-api-access-lbh27\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh\" (UID: \"a2f160b0-ca53-4e4d-9163-49d7079f9091\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh"
Nov 04 02:19:44.955597 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.955485    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2f160b0-ca53-4e4d-9163-49d7079f9091-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh\" (UID: \"a2f160b0-ca53-4e4d-9163-49d7079f9091\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh"
Nov 04 02:19:44.955731 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.955647    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87n7n\" (UniqueName: \"kubernetes.io/projected/c2488a78-d7af-4346-a841-0deda0b64591-kube-api-access-87n7n\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd\" (UID: \"c2488a78-d7af-4346-a841-0deda0b64591\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd"
Nov 04 02:19:44.955731 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.955697    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2488a78-d7af-4346-a841-0deda0b64591-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd\" (UID: \"c2488a78-d7af-4346-a841-0deda0b64591\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd"
Nov 04 02:19:44.955807 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.955727    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2f160b0-ca53-4e4d-9163-49d7079f9091-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh\" (UID: \"a2f160b0-ca53-4e4d-9163-49d7079f9091\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh"
Nov 04 02:19:44.955932 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.955907    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2488a78-d7af-4346-a841-0deda0b64591-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd\" (UID: \"c2488a78-d7af-4346-a841-0deda0b64591\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd"
Nov 04 02:19:44.955997 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.955971    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2488a78-d7af-4346-a841-0deda0b64591-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd\" (UID: \"c2488a78-d7af-4346-a841-0deda0b64591\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd"
Nov 04 02:19:44.974615 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.974580    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e3d011e69d9573cabb8c359e5ac709eb5ac240-be78d160-dockercfg-69bgn\""
Nov 04 02:19:44.974920 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:44.974754    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh"]
Nov 04 02:19:45.022765 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.022638    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87n7n\" (UniqueName: \"kubernetes.io/projected/c2488a78-d7af-4346-a841-0deda0b64591-kube-api-access-87n7n\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd\" (UID: \"c2488a78-d7af-4346-a841-0deda0b64591\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd"
Nov 04 02:19:45.032773 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.032726    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk"
Nov 04 02:19:45.056300 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.056243    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2f160b0-ca53-4e4d-9163-49d7079f9091-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh\" (UID: \"a2f160b0-ca53-4e4d-9163-49d7079f9091\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh"
Nov 04 02:19:45.056485 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.056318    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2f160b0-ca53-4e4d-9163-49d7079f9091-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh\" (UID: \"a2f160b0-ca53-4e4d-9163-49d7079f9091\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh"
Nov 04 02:19:45.056485 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.056392    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbh27\" (UniqueName: \"kubernetes.io/projected/a2f160b0-ca53-4e4d-9163-49d7079f9091-kube-api-access-lbh27\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh\" (UID: \"a2f160b0-ca53-4e4d-9163-49d7079f9091\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh"
Nov 04 02:19:45.056754 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.056724    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2f160b0-ca53-4e4d-9163-49d7079f9091-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh\" (UID: \"a2f160b0-ca53-4e4d-9163-49d7079f9091\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh"
Nov 04 02:19:45.057036 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.057015    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2f160b0-ca53-4e4d-9163-49d7079f9091-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh\" (UID: \"a2f160b0-ca53-4e4d-9163-49d7079f9091\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh"
Nov 04 02:19:45.118822 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.118791    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbh27\" (UniqueName: \"kubernetes.io/projected/a2f160b0-ca53-4e4d-9163-49d7079f9091-kube-api-access-lbh27\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh\" (UID: \"a2f160b0-ca53-4e4d-9163-49d7079f9091\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh"
Nov 04 02:19:45.138607 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.138567    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd"
Nov 04 02:19:45.245093 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.245047    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh"
Nov 04 02:19:45.324223 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.324191    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf"]
Nov 04 02:19:45.326783 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:19:45.326759    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e659478_7758_4b59_bd70_27738e2cbca8.slice/crio-ee958661e77f7e4f02da200c0062e8370bf7ce80c64e6d6b3b9bbda1297b999b WatchSource:0}: Error finding container ee958661e77f7e4f02da200c0062e8370bf7ce80c64e6d6b3b9bbda1297b999b: Status 404 returned error can't find the container with id ee958661e77f7e4f02da200c0062e8370bf7ce80c64e6d6b3b9bbda1297b999b
Nov 04 02:19:45.351215 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.351151    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf" event={"ID":"6e659478-7758-4b59-bd70-27738e2cbca8","Type":"ContainerStarted","Data":"ee958661e77f7e4f02da200c0062e8370bf7ce80c64e6d6b3b9bbda1297b999b"}
Nov 04 02:19:45.352684 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.352603    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8" event={"ID":"d9317ace-8bc7-4042-8032-68ef8f9f192b","Type":"ContainerStarted","Data":"63c9516c03acad095a50ecce249117352e0b804bcabbc6fb0b30bd3f65881bf9"}
Nov 04 02:19:45.416786 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.416117    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk"]
Nov 04 02:19:45.420266 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:19:45.420225    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod386f800a_9968_4225_b9db_e643d416be01.slice/crio-f2cb7681cf1b23a451a9c78f47705c1cc9e2b8f530004ab30e0434875ea137cc WatchSource:0}: Error finding container f2cb7681cf1b23a451a9c78f47705c1cc9e2b8f530004ab30e0434875ea137cc: Status 404 returned error can't find the container with id f2cb7681cf1b23a451a9c78f47705c1cc9e2b8f530004ab30e0434875ea137cc
Nov 04 02:19:45.523678 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.523645    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd"]
Nov 04 02:19:45.526619 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:19:45.526582    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2488a78_d7af_4346_a841_0deda0b64591.slice/crio-4d4facb4e8cc847fea79f9c1f7fd2be970435eb313154ff028c9f4b0afebd7d7 WatchSource:0}: Error finding container 4d4facb4e8cc847fea79f9c1f7fd2be970435eb313154ff028c9f4b0afebd7d7: Status 404 returned error can't find the container with id 4d4facb4e8cc847fea79f9c1f7fd2be970435eb313154ff028c9f4b0afebd7d7
Nov 04 02:19:45.631519 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.631485    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh"]
Nov 04 02:19:45.635200 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:19:45.635127    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2f160b0_ca53_4e4d_9163_49d7079f9091.slice/crio-a4dc0ba87888946a0bb8e52c6781048b95d1366a8e6e0388717f6f2bcb649b65 WatchSource:0}: Error finding container a4dc0ba87888946a0bb8e52c6781048b95d1366a8e6e0388717f6f2bcb649b65: Status 404 returned error can't find the container with id a4dc0ba87888946a0bb8e52c6781048b95d1366a8e6e0388717f6f2bcb649b65
Nov 04 02:19:45.746572 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.746528    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn"]
Nov 04 02:19:45.752068 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.752034    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn"
Nov 04 02:19:45.761993 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.761966    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99d9e86c-92fc-488a-a371-1d66a26020ec-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn\" (UID: \"99d9e86c-92fc-488a-a371-1d66a26020ec\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn"
Nov 04 02:19:45.762128 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.762021    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7tcr\" (UniqueName: \"kubernetes.io/projected/99d9e86c-92fc-488a-a371-1d66a26020ec-kube-api-access-c7tcr\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn\" (UID: \"99d9e86c-92fc-488a-a371-1d66a26020ec\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn"
Nov 04 02:19:45.762128 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.762066    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99d9e86c-92fc-488a-a371-1d66a26020ec-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn\" (UID: \"99d9e86c-92fc-488a-a371-1d66a26020ec\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn"
Nov 04 02:19:45.808573 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.808483    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn"]
Nov 04 02:19:45.808758 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.808614    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"e644421527c169d876fdb59235c927986d6bd2-9d2815fc-dockercfg-rdjjk\""
Nov 04 02:19:45.862812 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.862774    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7tcr\" (UniqueName: \"kubernetes.io/projected/99d9e86c-92fc-488a-a371-1d66a26020ec-kube-api-access-c7tcr\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn\" (UID: \"99d9e86c-92fc-488a-a371-1d66a26020ec\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn"
Nov 04 02:19:45.863046 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.862828    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99d9e86c-92fc-488a-a371-1d66a26020ec-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn\" (UID: \"99d9e86c-92fc-488a-a371-1d66a26020ec\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn"
Nov 04 02:19:45.863046 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.862867    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99d9e86c-92fc-488a-a371-1d66a26020ec-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn\" (UID: \"99d9e86c-92fc-488a-a371-1d66a26020ec\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn"
Nov 04 02:19:45.863328 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.863306    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99d9e86c-92fc-488a-a371-1d66a26020ec-util\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn\" (UID: \"99d9e86c-92fc-488a-a371-1d66a26020ec\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn"
Nov 04 02:19:45.863377 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.863334    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99d9e86c-92fc-488a-a371-1d66a26020ec-bundle\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn\" (UID: \"99d9e86c-92fc-488a-a371-1d66a26020ec\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn"
Nov 04 02:19:45.925070 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:45.925030    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7tcr\" (UniqueName: \"kubernetes.io/projected/99d9e86c-92fc-488a-a371-1d66a26020ec-kube-api-access-c7tcr\") pod \"e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn\" (UID: \"99d9e86c-92fc-488a-a371-1d66a26020ec\") " pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn"
Nov 04 02:19:46.071601 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:46.071514    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn"
Nov 04 02:19:46.359770 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:46.359674    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk" event={"ID":"386f800a-9968-4225-b9db-e643d416be01","Type":"ContainerStarted","Data":"f2cb7681cf1b23a451a9c78f47705c1cc9e2b8f530004ab30e0434875ea137cc"}
Nov 04 02:19:46.361771 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:46.361735    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd" event={"ID":"c2488a78-d7af-4346-a841-0deda0b64591","Type":"ContainerStarted","Data":"4d4facb4e8cc847fea79f9c1f7fd2be970435eb313154ff028c9f4b0afebd7d7"}
Nov 04 02:19:46.363930 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:46.363893    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh" event={"ID":"a2f160b0-ca53-4e4d-9163-49d7079f9091","Type":"ContainerStarted","Data":"a4dc0ba87888946a0bb8e52c6781048b95d1366a8e6e0388717f6f2bcb649b65"}
Nov 04 02:19:46.456000 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:46.455909    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn"]
Nov 04 02:19:47.371580 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:47.371535    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn" event={"ID":"99d9e86c-92fc-488a-a371-1d66a26020ec","Type":"ContainerStarted","Data":"06154bdd5bdb85584f63f64cda8fc96c45543950fe49688c4bbfc6e3e8d9c530"}
Nov 04 02:19:48.584438 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:48.584369    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l"]
Nov 04 02:19:48.598807 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:48.598769    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l"
Nov 04 02:19:48.645325 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:48.645198    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l"]
Nov 04 02:19:48.690020 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:48.689752    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8l7j\" (UniqueName: \"kubernetes.io/projected/d3ec8475-b258-49b5-b1bd-46648102fd0e-kube-api-access-d8l7j\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l\" (UID: \"d3ec8475-b258-49b5-b1bd-46648102fd0e\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l"
Nov 04 02:19:48.690020 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:48.689813    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3ec8475-b258-49b5-b1bd-46648102fd0e-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l\" (UID: \"d3ec8475-b258-49b5-b1bd-46648102fd0e\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l"
Nov 04 02:19:48.690020 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:48.689901    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3ec8475-b258-49b5-b1bd-46648102fd0e-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l\" (UID: \"d3ec8475-b258-49b5-b1bd-46648102fd0e\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l"
Nov 04 02:19:48.792287 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:48.790924    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3ec8475-b258-49b5-b1bd-46648102fd0e-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l\" (UID: \"d3ec8475-b258-49b5-b1bd-46648102fd0e\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l"
Nov 04 02:19:48.792287 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:48.791023    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3ec8475-b258-49b5-b1bd-46648102fd0e-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l\" (UID: \"d3ec8475-b258-49b5-b1bd-46648102fd0e\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l"
Nov 04 02:19:48.792287 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:48.791115    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8l7j\" (UniqueName: \"kubernetes.io/projected/d3ec8475-b258-49b5-b1bd-46648102fd0e-kube-api-access-d8l7j\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l\" (UID: \"d3ec8475-b258-49b5-b1bd-46648102fd0e\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l"
Nov 04 02:19:48.792287 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:48.791921    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3ec8475-b258-49b5-b1bd-46648102fd0e-util\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l\" (UID: \"d3ec8475-b258-49b5-b1bd-46648102fd0e\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l"
Nov 04 02:19:48.792287 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:48.792206    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3ec8475-b258-49b5-b1bd-46648102fd0e-bundle\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l\" (UID: \"d3ec8475-b258-49b5-b1bd-46648102fd0e\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l"
Nov 04 02:19:48.859075 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:48.858922    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8l7j\" (UniqueName: \"kubernetes.io/projected/d3ec8475-b258-49b5-b1bd-46648102fd0e-kube-api-access-d8l7j\") pod \"c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l\" (UID: \"d3ec8475-b258-49b5-b1bd-46648102fd0e\") " pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l"
Nov 04 02:19:48.923529 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:48.923480    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l"
Nov 04 02:19:49.366962 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:49.366928    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l"]
Nov 04 02:19:49.404580 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:49.404479    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l" event={"ID":"d3ec8475-b258-49b5-b1bd-46648102fd0e","Type":"ContainerStarted","Data":"45da1597f377f3a2f1e0870a40ad427cc9bf816a541d932540f18ad5a6807d80"}
Nov 04 02:19:51.374245 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.372588    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"]
Nov 04 02:19:51.377485 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.376513    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.412726 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.412682    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.412920 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.412745    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.412920 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.412770    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.412920 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.412802    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.412920 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.412847    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.412920 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.412876    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9rds\" (UniqueName: \"kubernetes.io/projected/3753909e-9a2a-4f55-978a-1974bfdbbbd1-kube-api-access-f9rds\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.412920 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.412915    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.413247 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.412957    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.413247 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.412989    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.429841 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.429766    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-gflvh\""
Nov 04 02:19:51.453244 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.452973    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Nov 04 02:19:51.453244 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.453047    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Nov 04 02:19:51.453244 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.453121    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Nov 04 02:19:51.482321 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.482231    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"]
Nov 04 02:19:51.513834 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.513753    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.514047 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.513846    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.514047 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.513881    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.514047 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.513922    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.514047 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.513944    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.514047 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.513982    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.514047 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.514030    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.514355 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.514058    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9rds\" (UniqueName: \"kubernetes.io/projected/3753909e-9a2a-4f55-978a-1974bfdbbbd1-kube-api-access-f9rds\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.514355 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.514102    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.514811 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.514614    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.515674 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.515424    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.515798 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.515691    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.517681 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.516675    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.517681 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.517635    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.527694 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.527623    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.539373 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.539287    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.582856 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.582740    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9rds\" (UniqueName: \"kubernetes.io/projected/3753909e-9a2a-4f55-978a-1974bfdbbbd1-kube-api-access-f9rds\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.588700 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.588551    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-b8qff\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.699062 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.698972    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:19:51.705254 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.705224    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"]
Nov 04 02:19:51.711336 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.710329    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.715114 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.715078    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea254707-d181-4b6b-8982-afeabe972d09-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.715299 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.715119    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea254707-d181-4b6b-8982-afeabe972d09-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.715299 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.715148    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea254707-d181-4b6b-8982-afeabe972d09-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.715299 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.715196    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6j5r\" (UniqueName: \"kubernetes.io/projected/ea254707-d181-4b6b-8982-afeabe972d09-kube-api-access-r6j5r\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.715299 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.715234    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea254707-d181-4b6b-8982-afeabe972d09-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.715513 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.715279    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea254707-d181-4b6b-8982-afeabe972d09-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.715513 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.715373    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea254707-d181-4b6b-8982-afeabe972d09-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.715513 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.715430    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea254707-d181-4b6b-8982-afeabe972d09-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.715513 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.715466    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea254707-d181-4b6b-8982-afeabe972d09-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.769115 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.768859    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"]
Nov 04 02:19:51.769115 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.769046    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"openshift-ai-inference-openshift-ai-inference-dockercfg-cztc5\""
Nov 04 02:19:51.818642 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.816221    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea254707-d181-4b6b-8982-afeabe972d09-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.818642 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.816290    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea254707-d181-4b6b-8982-afeabe972d09-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.818642 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.816376    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea254707-d181-4b6b-8982-afeabe972d09-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.818642 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.816410    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea254707-d181-4b6b-8982-afeabe972d09-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.818642 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.816486    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea254707-d181-4b6b-8982-afeabe972d09-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.818642 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.816510    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea254707-d181-4b6b-8982-afeabe972d09-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.818642 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.816543    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea254707-d181-4b6b-8982-afeabe972d09-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.818642 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.816596    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6j5r\" (UniqueName: \"kubernetes.io/projected/ea254707-d181-4b6b-8982-afeabe972d09-kube-api-access-r6j5r\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.818642 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.816635    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea254707-d181-4b6b-8982-afeabe972d09-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.818642 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.817068    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea254707-d181-4b6b-8982-afeabe972d09-workload-socket\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.818642 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.817351    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ea254707-d181-4b6b-8982-afeabe972d09-istio-data\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.818642 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.817648    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ea254707-d181-4b6b-8982-afeabe972d09-credential-socket\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.818642 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.818323    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ea254707-d181-4b6b-8982-afeabe972d09-istiod-ca-cert\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.820775 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.820375    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ea254707-d181-4b6b-8982-afeabe972d09-workload-certs\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.829363 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.829189    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ea254707-d181-4b6b-8982-afeabe972d09-istio-envoy\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.836844 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.836730    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ea254707-d181-4b6b-8982-afeabe972d09-istio-podinfo\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.882779 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.882675    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ea254707-d181-4b6b-8982-afeabe972d09-istio-token\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:51.887796 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:51.887718    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6j5r\" (UniqueName: \"kubernetes.io/projected/ea254707-d181-4b6b-8982-afeabe972d09-kube-api-access-r6j5r\") pod \"openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w\" (UID: \"ea254707-d181-4b6b-8982-afeabe972d09\") " pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:52.040574 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.040234    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:19:52.185646 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.185564    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"]
Nov 04 02:19:52.434634 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.434552    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5"]
Nov 04 02:19:52.440247 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.440187    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5"
Nov 04 02:19:52.441923 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.441882    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff" event={"ID":"3753909e-9a2a-4f55-978a-1974bfdbbbd1","Type":"ContainerStarted","Data":"bd97d7b16b19ffdb66d31f30eeb450547dc4f935b4a4c91f81c3554c919b5c2b"}
Nov 04 02:19:52.483903 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.483840    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x"]
Nov 04 02:19:52.507336 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.506497    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"]
Nov 04 02:19:52.507336 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.506559    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5"]
Nov 04 02:19:52.507336 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.506672    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x"
Nov 04 02:19:52.507336 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.506940    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l"]
Nov 04 02:19:52.529344 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.528499    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l"
Nov 04 02:19:52.530228 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.529783    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9390a762-09f8-465b-8bea-1e7fb91d6b06-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x\" (UID: \"9390a762-09f8-465b-8bea-1e7fb91d6b06\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x"
Nov 04 02:19:52.530228 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.529824    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9390a762-09f8-465b-8bea-1e7fb91d6b06-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x\" (UID: \"9390a762-09f8-465b-8bea-1e7fb91d6b06\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x"
Nov 04 02:19:52.530228 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.529884    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghwlq\" (UniqueName: \"kubernetes.io/projected/65924a14-a1d1-4101-971e-aecede66fc85-kube-api-access-ghwlq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5\" (UID: \"65924a14-a1d1-4101-971e-aecede66fc85\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5"
Nov 04 02:19:52.530228 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.529914    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65924a14-a1d1-4101-971e-aecede66fc85-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5\" (UID: \"65924a14-a1d1-4101-971e-aecede66fc85\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5"
Nov 04 02:19:52.530228 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.530025    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65924a14-a1d1-4101-971e-aecede66fc85-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5\" (UID: \"65924a14-a1d1-4101-971e-aecede66fc85\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5"
Nov 04 02:19:52.530228 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.530054    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6vtj\" (UniqueName: \"kubernetes.io/projected/9390a762-09f8-465b-8bea-1e7fb91d6b06-kube-api-access-m6vtj\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x\" (UID: \"9390a762-09f8-465b-8bea-1e7fb91d6b06\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x"
Nov 04 02:19:52.537245 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.537210    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x"]
Nov 04 02:19:52.537412 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.537321    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466"]
Nov 04 02:19:52.542681 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.542626    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466"
Nov 04 02:19:52.571330 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.571289    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l"]
Nov 04 02:19:52.630855 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.630765    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85d2e37b-734e-4e99-8366-c19efb002440-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l\" (UID: \"85d2e37b-734e-4e99-8366-c19efb002440\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l"
Nov 04 02:19:52.630855 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.630815    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a933162b-e883-4beb-9f00-34b31c3c7e1a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466\" (UID: \"a933162b-e883-4beb-9f00-34b31c3c7e1a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466"
Nov 04 02:19:52.631092 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.630864    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfvv6\" (UniqueName: \"kubernetes.io/projected/a933162b-e883-4beb-9f00-34b31c3c7e1a-kube-api-access-mfvv6\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466\" (UID: \"a933162b-e883-4beb-9f00-34b31c3c7e1a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466"
Nov 04 02:19:52.631092 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.630902    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a933162b-e883-4beb-9f00-34b31c3c7e1a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466\" (UID: \"a933162b-e883-4beb-9f00-34b31c3c7e1a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466"
Nov 04 02:19:52.631092 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.630930    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkk67\" (UniqueName: \"kubernetes.io/projected/85d2e37b-734e-4e99-8366-c19efb002440-kube-api-access-fkk67\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l\" (UID: \"85d2e37b-734e-4e99-8366-c19efb002440\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l"
Nov 04 02:19:52.631092 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.630990    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65924a14-a1d1-4101-971e-aecede66fc85-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5\" (UID: \"65924a14-a1d1-4101-971e-aecede66fc85\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5"
Nov 04 02:19:52.631092 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.631070    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6vtj\" (UniqueName: \"kubernetes.io/projected/9390a762-09f8-465b-8bea-1e7fb91d6b06-kube-api-access-m6vtj\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x\" (UID: \"9390a762-09f8-465b-8bea-1e7fb91d6b06\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x"
Nov 04 02:19:52.632001 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.631107    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9390a762-09f8-465b-8bea-1e7fb91d6b06-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x\" (UID: \"9390a762-09f8-465b-8bea-1e7fb91d6b06\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x"
Nov 04 02:19:52.632001 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.631202    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9390a762-09f8-465b-8bea-1e7fb91d6b06-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x\" (UID: \"9390a762-09f8-465b-8bea-1e7fb91d6b06\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x"
Nov 04 02:19:52.632001 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.631256    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghwlq\" (UniqueName: \"kubernetes.io/projected/65924a14-a1d1-4101-971e-aecede66fc85-kube-api-access-ghwlq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5\" (UID: \"65924a14-a1d1-4101-971e-aecede66fc85\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5"
Nov 04 02:19:52.632001 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.631285    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65924a14-a1d1-4101-971e-aecede66fc85-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5\" (UID: \"65924a14-a1d1-4101-971e-aecede66fc85\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5"
Nov 04 02:19:52.632001 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.631312    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85d2e37b-734e-4e99-8366-c19efb002440-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l\" (UID: \"85d2e37b-734e-4e99-8366-c19efb002440\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l"
Nov 04 02:19:52.632001 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.631738    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65924a14-a1d1-4101-971e-aecede66fc85-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5\" (UID: \"65924a14-a1d1-4101-971e-aecede66fc85\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5"
Nov 04 02:19:52.632001 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.631750    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65924a14-a1d1-4101-971e-aecede66fc85-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5\" (UID: \"65924a14-a1d1-4101-971e-aecede66fc85\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5"
Nov 04 02:19:52.632001 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.631961    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9390a762-09f8-465b-8bea-1e7fb91d6b06-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x\" (UID: \"9390a762-09f8-465b-8bea-1e7fb91d6b06\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x"
Nov 04 02:19:52.632502 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.632007    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9390a762-09f8-465b-8bea-1e7fb91d6b06-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x\" (UID: \"9390a762-09f8-465b-8bea-1e7fb91d6b06\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x"
Nov 04 02:19:52.633076 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.632981    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466"]
Nov 04 02:19:52.714043 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.713958    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghwlq\" (UniqueName: \"kubernetes.io/projected/65924a14-a1d1-4101-971e-aecede66fc85-kube-api-access-ghwlq\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5\" (UID: \"65924a14-a1d1-4101-971e-aecede66fc85\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5"
Nov 04 02:19:52.718190 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.718141    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6vtj\" (UniqueName: \"kubernetes.io/projected/9390a762-09f8-465b-8bea-1e7fb91d6b06-kube-api-access-m6vtj\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x\" (UID: \"9390a762-09f8-465b-8bea-1e7fb91d6b06\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x"
Nov 04 02:19:52.732490 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.732426    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85d2e37b-734e-4e99-8366-c19efb002440-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l\" (UID: \"85d2e37b-734e-4e99-8366-c19efb002440\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l"
Nov 04 02:19:52.732678 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.732494    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85d2e37b-734e-4e99-8366-c19efb002440-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l\" (UID: \"85d2e37b-734e-4e99-8366-c19efb002440\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l"
Nov 04 02:19:52.732678 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.732524    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a933162b-e883-4beb-9f00-34b31c3c7e1a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466\" (UID: \"a933162b-e883-4beb-9f00-34b31c3c7e1a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466"
Nov 04 02:19:52.732678 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.732577    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfvv6\" (UniqueName: \"kubernetes.io/projected/a933162b-e883-4beb-9f00-34b31c3c7e1a-kube-api-access-mfvv6\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466\" (UID: \"a933162b-e883-4beb-9f00-34b31c3c7e1a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466"
Nov 04 02:19:52.732678 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.732616    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a933162b-e883-4beb-9f00-34b31c3c7e1a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466\" (UID: \"a933162b-e883-4beb-9f00-34b31c3c7e1a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466"
Nov 04 02:19:52.732678 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.732645    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkk67\" (UniqueName: \"kubernetes.io/projected/85d2e37b-734e-4e99-8366-c19efb002440-kube-api-access-fkk67\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l\" (UID: \"85d2e37b-734e-4e99-8366-c19efb002440\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l"
Nov 04 02:19:52.733455 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.733433    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85d2e37b-734e-4e99-8366-c19efb002440-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l\" (UID: \"85d2e37b-734e-4e99-8366-c19efb002440\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l"
Nov 04 02:19:52.733702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.733679    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85d2e37b-734e-4e99-8366-c19efb002440-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l\" (UID: \"85d2e37b-734e-4e99-8366-c19efb002440\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l"
Nov 04 02:19:52.734017 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.733984    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a933162b-e883-4beb-9f00-34b31c3c7e1a-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466\" (UID: \"a933162b-e883-4beb-9f00-34b31c3c7e1a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466"
Nov 04 02:19:52.734577 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.734543    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a933162b-e883-4beb-9f00-34b31c3c7e1a-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466\" (UID: \"a933162b-e883-4beb-9f00-34b31c3c7e1a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466"
Nov 04 02:19:52.777926 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.777887    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5"
Nov 04 02:19:52.796606 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.796436    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkk67\" (UniqueName: \"kubernetes.io/projected/85d2e37b-734e-4e99-8366-c19efb002440-kube-api-access-fkk67\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l\" (UID: \"85d2e37b-734e-4e99-8366-c19efb002440\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l"
Nov 04 02:19:52.804972 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.804943    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfvv6\" (UniqueName: \"kubernetes.io/projected/a933162b-e883-4beb-9f00-34b31c3c7e1a-kube-api-access-mfvv6\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466\" (UID: \"a933162b-e883-4beb-9f00-34b31c3c7e1a\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466"
Nov 04 02:19:52.829456 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.829420    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x"
Nov 04 02:19:52.876912 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.876854    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l"
Nov 04 02:19:52.890121 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:52.887700    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466"
Nov 04 02:19:53.235312 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:53.235073    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5"]
Nov 04 02:19:53.240809 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:19:53.240774    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65924a14_a1d1_4101_971e_aecede66fc85.slice/crio-986d0a8d2cde75ddb4477c185dc701f90c8b863fede22526b2747afceefee237 WatchSource:0}: Error finding container 986d0a8d2cde75ddb4477c185dc701f90c8b863fede22526b2747afceefee237: Status 404 returned error can't find the container with id 986d0a8d2cde75ddb4477c185dc701f90c8b863fede22526b2747afceefee237
Nov 04 02:19:53.299791 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:53.299742    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x"]
Nov 04 02:19:53.305232 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:19:53.305187    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9390a762_09f8_465b_8bea_1e7fb91d6b06.slice/crio-1c40af6c0c4490c7242fa53e7acc76501ceb1b47069d3e4f9c7588cbf22760bf WatchSource:0}: Error finding container 1c40af6c0c4490c7242fa53e7acc76501ceb1b47069d3e4f9c7588cbf22760bf: Status 404 returned error can't find the container with id 1c40af6c0c4490c7242fa53e7acc76501ceb1b47069d3e4f9c7588cbf22760bf
Nov 04 02:19:53.367791 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:53.367753    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l"]
Nov 04 02:19:53.373702 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:19:53.373660    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85d2e37b_734e_4e99_8366_c19efb002440.slice/crio-cceeeacd922f8ee27418d199bcea66c778c31436f7709f3a0bdacdfe885bc621 WatchSource:0}: Error finding container cceeeacd922f8ee27418d199bcea66c778c31436f7709f3a0bdacdfe885bc621: Status 404 returned error can't find the container with id cceeeacd922f8ee27418d199bcea66c778c31436f7709f3a0bdacdfe885bc621
Nov 04 02:19:53.384018 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:53.383983    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466"]
Nov 04 02:19:53.460705 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:53.460661    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w" event={"ID":"ea254707-d181-4b6b-8982-afeabe972d09","Type":"ContainerStarted","Data":"db13ffc1d553898fdc99754811e5029fba67baaefdf68b6fb12f470a2bee4c02"}
Nov 04 02:19:53.466066 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:53.466025    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l" event={"ID":"85d2e37b-734e-4e99-8366-c19efb002440","Type":"ContainerStarted","Data":"cceeeacd922f8ee27418d199bcea66c778c31436f7709f3a0bdacdfe885bc621"}
Nov 04 02:19:53.472060 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:53.471998    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x" event={"ID":"9390a762-09f8-465b-8bea-1e7fb91d6b06","Type":"ContainerStarted","Data":"1c40af6c0c4490c7242fa53e7acc76501ceb1b47069d3e4f9c7588cbf22760bf"}
Nov 04 02:19:53.476413 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:53.476314    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466" event={"ID":"a933162b-e883-4beb-9f00-34b31c3c7e1a","Type":"ContainerStarted","Data":"78ab134b71b1bcca14b6757f7f4575f0275752ae2e289106f4214636c555e564"}
Nov 04 02:19:53.481370 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:19:53.481320    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5" event={"ID":"65924a14-a1d1-4101-971e-aecede66fc85","Type":"ContainerStarted","Data":"986d0a8d2cde75ddb4477c185dc701f90c8b863fede22526b2747afceefee237"}
Nov 04 02:20:06.675026 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:06.674975    4548 generic.go:356] "Generic (PLEG): container finished" podID="f649e927-25bf-4f4c-8237-e61aaf7c2a85" containerID="46009f05d3d24f88f4539b6783ec44699b0167a911b56df99ad83b322d601501" exitCode=0
Nov 04 02:20:06.675665 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:06.675087    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9" event={"ID":"f649e927-25bf-4f4c-8237-e61aaf7c2a85","Type":"ContainerDied","Data":"46009f05d3d24f88f4539b6783ec44699b0167a911b56df99ad83b322d601501"}
Nov 04 02:20:07.102015 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:07.101970    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:20:07.102187 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:07.102070    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:20:07.102187 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:07.102113    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:20:07.702005 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:07.701960    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff" event={"ID":"3753909e-9a2a-4f55-978a-1974bfdbbbd1","Type":"ContainerStarted","Data":"46e98f05255e8e447e44341db26871348ce24229418d5442ec7e1be7446672c8"}
Nov 04 02:20:07.827683 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:07.825661    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff" podStartSLOduration=1.925597309 podStartE2EDuration="16.825638396s" totalImagesPullingTime="14.900041087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:19:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:20:07.824680755 +0000 UTC m=+241.429693759" watchObservedRunningTime="2026-11-04 02:20:07.825638396 +0000 UTC m=+241.430651396"
Nov 04 02:20:08.432917 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:08.432865    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:20:08.433091 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:08.432970    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:20:08.433091 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:08.433019    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:20:08.699588 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:08.699484    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:20:08.706781 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:08.706735    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:20:08.714191 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:08.714138    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:20:08.715158 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:08.715122    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:20:09.722837 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:09.722790    4548 generic.go:356] "Generic (PLEG): container finished" podID="6e659478-7758-4b59-bd70-27738e2cbca8" containerID="cdcd475e0e7058249c0c40130034bda030d4c56d61d3a8a21e3f60bd761a896b" exitCode=0
Nov 04 02:20:09.723377 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:09.722889    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf" event={"ID":"6e659478-7758-4b59-bd70-27738e2cbca8","Type":"ContainerDied","Data":"cdcd475e0e7058249c0c40130034bda030d4c56d61d3a8a21e3f60bd761a896b"}
Nov 04 02:20:09.725762 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:09.725731    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w" event={"ID":"ea254707-d181-4b6b-8982-afeabe972d09","Type":"ContainerStarted","Data":"c89503bb63bf72954c66a98096f13991f35969857e898c10385dca3e15c15394"}
Nov 04 02:20:09.728300 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:09.728269    4548 generic.go:356] "Generic (PLEG): container finished" podID="386f800a-9968-4225-b9db-e643d416be01" containerID="de83340cef6a7457817abf60b9e853af82536fe65829a6e60fdb480cce37b137" exitCode=0
Nov 04 02:20:09.728530 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:09.728466    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk" event={"ID":"386f800a-9968-4225-b9db-e643d416be01","Type":"ContainerDied","Data":"de83340cef6a7457817abf60b9e853af82536fe65829a6e60fdb480cce37b137"}
Nov 04 02:20:09.730793 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:09.730644    4548 generic.go:356] "Generic (PLEG): container finished" podID="9390a762-09f8-465b-8bea-1e7fb91d6b06" containerID="6c2168156ffd088463c504a1da34cacf0a97449f8c1dc4cb401ff781a122e39b" exitCode=0
Nov 04 02:20:09.730793 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:09.730737    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x" event={"ID":"9390a762-09f8-465b-8bea-1e7fb91d6b06","Type":"ContainerDied","Data":"6c2168156ffd088463c504a1da34cacf0a97449f8c1dc4cb401ff781a122e39b"}
Nov 04 02:20:09.733215 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:09.733186    4548 generic.go:356] "Generic (PLEG): container finished" podID="d9317ace-8bc7-4042-8032-68ef8f9f192b" containerID="c06b0ecf0449fd424cf0c895cba1e8b84987caaa06a2f394c89df9c814f111b9" exitCode=0
Nov 04 02:20:09.733805 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:09.733387    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8" event={"ID":"d9317ace-8bc7-4042-8032-68ef8f9f192b","Type":"ContainerDied","Data":"c06b0ecf0449fd424cf0c895cba1e8b84987caaa06a2f394c89df9c814f111b9"}
Nov 04 02:20:10.041685 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:10.041649    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:20:10.048246 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:10.048216    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:20:10.200351 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:10.200287    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w" podStartSLOduration=3.282567575 podStartE2EDuration="19.20026855s" totalImagesPullingTime="15.917700975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:19:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:20:10.198983007 +0000 UTC m=+243.803996004" watchObservedRunningTime="2026-11-04 02:20:10.20026855 +0000 UTC m=+243.805281547"
Nov 04 02:20:10.627250 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:20:10.627206    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:20:10.742798 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:10.742770    4548 generic.go:356] "Generic (PLEG): container finished" podID="a2f160b0-ca53-4e4d-9163-49d7079f9091" containerID="f308b9b2035eeaebc2843056ca70d62976c178110b7ef3b754293a84c11cf31a" exitCode=0
Nov 04 02:20:10.743316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:10.742855    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh" event={"ID":"a2f160b0-ca53-4e4d-9163-49d7079f9091","Type":"ContainerDied","Data":"f308b9b2035eeaebc2843056ca70d62976c178110b7ef3b754293a84c11cf31a"}
Nov 04 02:20:10.748143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:10.748108    4548 generic.go:356] "Generic (PLEG): container finished" podID="65924a14-a1d1-4101-971e-aecede66fc85" containerID="869b0d7d0f3e6e2bf62f71b93ded7fc1ac35ae51ed5bd11559de47fe0b957de6" exitCode=0
Nov 04 02:20:10.748311 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:10.748288    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5" event={"ID":"65924a14-a1d1-4101-971e-aecede66fc85","Type":"ContainerDied","Data":"869b0d7d0f3e6e2bf62f71b93ded7fc1ac35ae51ed5bd11559de47fe0b957de6"}
Nov 04 02:20:10.751900 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:10.751857    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l" event={"ID":"85d2e37b-734e-4e99-8366-c19efb002440","Type":"ContainerStarted","Data":"daed96888ebc903c9dd3e93a143a20e69e8477ffb35e4258301bc957ec404632"}
Nov 04 02:20:10.761458 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:10.761427    4548 generic.go:356] "Generic (PLEG): container finished" podID="c2488a78-d7af-4346-a841-0deda0b64591" containerID="c02ffc6e70062eb231008c83cc3a10974867d19ad262b1fd6b9ea33b785f1a4c" exitCode=0
Nov 04 02:20:10.761578 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:10.761552    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd" event={"ID":"c2488a78-d7af-4346-a841-0deda0b64591","Type":"ContainerDied","Data":"c02ffc6e70062eb231008c83cc3a10974867d19ad262b1fd6b9ea33b785f1a4c"}
Nov 04 02:20:10.770923 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:10.769205    4548 generic.go:356] "Generic (PLEG): container finished" podID="a933162b-e883-4beb-9f00-34b31c3c7e1a" containerID="0c6b7d6340fb2949d79780af66c8665d21f2dc596d3dd0a1848387f46530d268" exitCode=0
Nov 04 02:20:10.770923 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:10.770318    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466" event={"ID":"a933162b-e883-4beb-9f00-34b31c3c7e1a","Type":"ContainerDied","Data":"0c6b7d6340fb2949d79780af66c8665d21f2dc596d3dd0a1848387f46530d268"}
Nov 04 02:20:10.770923 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:10.770380    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:20:10.773300 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:10.773236    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w"
Nov 04 02:20:11.779892 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:11.779862    4548 generic.go:356] "Generic (PLEG): container finished" podID="f649e927-25bf-4f4c-8237-e61aaf7c2a85" containerID="d7363f2a0c70b572d2a7685e126046495541860ab1940817c8b52daeda5f4f3d" exitCode=0
Nov 04 02:20:11.780330 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:11.780020    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9" event={"ID":"f649e927-25bf-4f4c-8237-e61aaf7c2a85","Type":"ContainerDied","Data":"d7363f2a0c70b572d2a7685e126046495541860ab1940817c8b52daeda5f4f3d"}
Nov 04 02:20:11.782760 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:11.782730    4548 generic.go:356] "Generic (PLEG): container finished" podID="6e659478-7758-4b59-bd70-27738e2cbca8" containerID="0bcf2d2b08a2ab4a38b1a1ce858b530410f6fd623fc490d7e5ddee97f0d23235" exitCode=0
Nov 04 02:20:11.782879 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:11.782812    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf" event={"ID":"6e659478-7758-4b59-bd70-27738e2cbca8","Type":"ContainerDied","Data":"0bcf2d2b08a2ab4a38b1a1ce858b530410f6fd623fc490d7e5ddee97f0d23235"}
Nov 04 02:20:11.784699 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:11.784680    4548 generic.go:356] "Generic (PLEG): container finished" podID="d3ec8475-b258-49b5-b1bd-46648102fd0e" containerID="e2b0163c0c802a4e24c3139d71c925e23d93361fb5c4f01724988b3c46a573ac" exitCode=0
Nov 04 02:20:11.785530 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:11.784782    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l" event={"ID":"d3ec8475-b258-49b5-b1bd-46648102fd0e","Type":"ContainerDied","Data":"e2b0163c0c802a4e24c3139d71c925e23d93361fb5c4f01724988b3c46a573ac"}
Nov 04 02:20:11.788100 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:11.786789    4548 generic.go:356] "Generic (PLEG): container finished" podID="99d9e86c-92fc-488a-a371-1d66a26020ec" containerID="70239e1e16159a76976765e707e378fe00da49e82a877e541ce04d8e73e06728" exitCode=0
Nov 04 02:20:11.788100 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:11.787462    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn" event={"ID":"99d9e86c-92fc-488a-a371-1d66a26020ec","Type":"ContainerDied","Data":"70239e1e16159a76976765e707e378fe00da49e82a877e541ce04d8e73e06728"}
Nov 04 02:20:11.795199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:11.790008    4548 generic.go:356] "Generic (PLEG): container finished" podID="85d2e37b-734e-4e99-8366-c19efb002440" containerID="daed96888ebc903c9dd3e93a143a20e69e8477ffb35e4258301bc957ec404632" exitCode=0
Nov 04 02:20:11.795199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:11.790053    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l" event={"ID":"85d2e37b-734e-4e99-8366-c19efb002440","Type":"ContainerDied","Data":"daed96888ebc903c9dd3e93a143a20e69e8477ffb35e4258301bc957ec404632"}
Nov 04 02:20:12.800431 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:12.799354    4548 generic.go:356] "Generic (PLEG): container finished" podID="a933162b-e883-4beb-9f00-34b31c3c7e1a" containerID="bfffd99c6836c45fa2273cb612c5f23aa2ef2e019cebc9cad48cbfd5ebad03af" exitCode=0
Nov 04 02:20:12.800431 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:12.799487    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466" event={"ID":"a933162b-e883-4beb-9f00-34b31c3c7e1a","Type":"ContainerDied","Data":"bfffd99c6836c45fa2273cb612c5f23aa2ef2e019cebc9cad48cbfd5ebad03af"}
Nov 04 02:20:12.804542 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:12.804512    4548 generic.go:356] "Generic (PLEG): container finished" podID="a2f160b0-ca53-4e4d-9163-49d7079f9091" containerID="62c1338c3c6f12bf362855ffda6a6af922718bfe84867336b2253c9fd655f085" exitCode=0
Nov 04 02:20:12.805086 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:12.804811    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh" event={"ID":"a2f160b0-ca53-4e4d-9163-49d7079f9091","Type":"ContainerDied","Data":"62c1338c3c6f12bf362855ffda6a6af922718bfe84867336b2253c9fd655f085"}
Nov 04 02:20:12.806817 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:12.806773    4548 generic.go:356] "Generic (PLEG): container finished" podID="65924a14-a1d1-4101-971e-aecede66fc85" containerID="29df257994460eee16f4bd2eee93916031b81b0ec97e21cbe0360d50c24e826c" exitCode=0
Nov 04 02:20:12.806884 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:12.806861    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5" event={"ID":"65924a14-a1d1-4101-971e-aecede66fc85","Type":"ContainerDied","Data":"29df257994460eee16f4bd2eee93916031b81b0ec97e21cbe0360d50c24e826c"}
Nov 04 02:20:12.810895 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:12.810028    4548 generic.go:356] "Generic (PLEG): container finished" podID="d3ec8475-b258-49b5-b1bd-46648102fd0e" containerID="c73627e9e3fcdef05da301e05f9e954d1dde1a8d233c33ce4413a647f886a477" exitCode=0
Nov 04 02:20:12.810895 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:12.810153    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l" event={"ID":"d3ec8475-b258-49b5-b1bd-46648102fd0e","Type":"ContainerDied","Data":"c73627e9e3fcdef05da301e05f9e954d1dde1a8d233c33ce4413a647f886a477"}
Nov 04 02:20:12.814893 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:12.814866    4548 generic.go:356] "Generic (PLEG): container finished" podID="386f800a-9968-4225-b9db-e643d416be01" containerID="1796ed5d0ad8ded096b80cd8a81cd36cd9dc6a7a10cf3884084cb020ec72ee27" exitCode=0
Nov 04 02:20:12.815005 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:12.814947    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk" event={"ID":"386f800a-9968-4225-b9db-e643d416be01","Type":"ContainerDied","Data":"1796ed5d0ad8ded096b80cd8a81cd36cd9dc6a7a10cf3884084cb020ec72ee27"}
Nov 04 02:20:12.818358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:12.818331    4548 generic.go:356] "Generic (PLEG): container finished" podID="9390a762-09f8-465b-8bea-1e7fb91d6b06" containerID="68395fd6167b441d2b4a2d42f01b6825e34025d19fa9768c2036eff7f0ed13fc" exitCode=0
Nov 04 02:20:12.818463 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:12.818410    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x" event={"ID":"9390a762-09f8-465b-8bea-1e7fb91d6b06","Type":"ContainerDied","Data":"68395fd6167b441d2b4a2d42f01b6825e34025d19fa9768c2036eff7f0ed13fc"}
Nov 04 02:20:13.829755 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:13.829649    4548 generic.go:356] "Generic (PLEG): container finished" podID="d9317ace-8bc7-4042-8032-68ef8f9f192b" containerID="31bc355b964bba6c3f2e268e61057e0de007727acf9bf446164bdbabc0b6d792" exitCode=0
Nov 04 02:20:13.830276 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:13.829836    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8" event={"ID":"d9317ace-8bc7-4042-8032-68ef8f9f192b","Type":"ContainerDied","Data":"31bc355b964bba6c3f2e268e61057e0de007727acf9bf446164bdbabc0b6d792"}
Nov 04 02:20:13.833282 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:13.833198    4548 generic.go:356] "Generic (PLEG): container finished" podID="c2488a78-d7af-4346-a841-0deda0b64591" containerID="5ff3a4bf276d419a535a354c5aabd726f13b95be20b22106e83906231ca1438c" exitCode=0
Nov 04 02:20:13.833661 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:13.833634    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd" event={"ID":"c2488a78-d7af-4346-a841-0deda0b64591","Type":"ContainerDied","Data":"5ff3a4bf276d419a535a354c5aabd726f13b95be20b22106e83906231ca1438c"}
Nov 04 02:20:13.836156 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:13.836136    4548 generic.go:356] "Generic (PLEG): container finished" podID="99d9e86c-92fc-488a-a371-1d66a26020ec" containerID="1da88029f25a55c29a33c496124fbfbf1b97b63e91ba577ce3eea8a5840b912d" exitCode=0
Nov 04 02:20:13.836272 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:13.836211    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn" event={"ID":"99d9e86c-92fc-488a-a371-1d66a26020ec","Type":"ContainerDied","Data":"1da88029f25a55c29a33c496124fbfbf1b97b63e91ba577ce3eea8a5840b912d"}
Nov 04 02:20:13.839203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:13.839148    4548 generic.go:356] "Generic (PLEG): container finished" podID="85d2e37b-734e-4e99-8366-c19efb002440" containerID="e75d9c63148414878a857b9f9cada6af63aa24efd0674157d294779a35669382" exitCode=0
Nov 04 02:20:13.839278 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:13.839214    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l" event={"ID":"85d2e37b-734e-4e99-8366-c19efb002440","Type":"ContainerDied","Data":"e75d9c63148414878a857b9f9cada6af63aa24efd0674157d294779a35669382"}
Nov 04 02:20:37.241685 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:37.241047    4548 generic.go:356] "Generic (PLEG): container finished" podID="6e659478-7758-4b59-bd70-27738e2cbca8" containerID="e35ae2a3388bc89e6520ea1a93d0e2d32ef14c5cdf3231b06baf423cbb9f513d" exitCode=0
Nov 04 02:20:37.241685 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:37.241219    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf" event={"ID":"6e659478-7758-4b59-bd70-27738e2cbca8","Type":"ContainerDied","Data":"e35ae2a3388bc89e6520ea1a93d0e2d32ef14c5cdf3231b06baf423cbb9f513d"}
Nov 04 02:20:37.248527 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:37.248154    4548 generic.go:356] "Generic (PLEG): container finished" podID="f649e927-25bf-4f4c-8237-e61aaf7c2a85" containerID="272b341b40c50e9e061bd6c06e8de776bc9d2b5735f9e01a772f26cde6efdd14" exitCode=0
Nov 04 02:20:37.248527 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:37.248468    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9" event={"ID":"f649e927-25bf-4f4c-8237-e61aaf7c2a85","Type":"ContainerDied","Data":"272b341b40c50e9e061bd6c06e8de776bc9d2b5735f9e01a772f26cde6efdd14"}
Nov 04 02:20:38.565226 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.564919    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9"
Nov 04 02:20:38.579565 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.579429    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf"
Nov 04 02:20:38.690213 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.684090    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6e659478-7758-4b59-bd70-27738e2cbca8-kube-api-access-5p77l\" (UniqueName: \"kubernetes.io/projected/6e659478-7758-4b59-bd70-27738e2cbca8-kube-api-access-5p77l\") pod \"6e659478-7758-4b59-bd70-27738e2cbca8\" (UID: \"6e659478-7758-4b59-bd70-27738e2cbca8\") "
Nov 04 02:20:38.690213 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.684147    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e659478-7758-4b59-bd70-27738e2cbca8-bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e659478-7758-4b59-bd70-27738e2cbca8-bundle\") pod \"6e659478-7758-4b59-bd70-27738e2cbca8\" (UID: \"6e659478-7758-4b59-bd70-27738e2cbca8\") "
Nov 04 02:20:38.690213 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.684230    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f649e927-25bf-4f4c-8237-e61aaf7c2a85-bundle\" (UniqueName: \"kubernetes.io/empty-dir/f649e927-25bf-4f4c-8237-e61aaf7c2a85-bundle\") pod \"f649e927-25bf-4f4c-8237-e61aaf7c2a85\" (UID: \"f649e927-25bf-4f4c-8237-e61aaf7c2a85\") "
Nov 04 02:20:38.690213 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.684342    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/f649e927-25bf-4f4c-8237-e61aaf7c2a85-util\" (UniqueName: \"kubernetes.io/empty-dir/f649e927-25bf-4f4c-8237-e61aaf7c2a85-util\") pod \"f649e927-25bf-4f4c-8237-e61aaf7c2a85\" (UID: \"f649e927-25bf-4f4c-8237-e61aaf7c2a85\") "
Nov 04 02:20:38.690213 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.684410    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6e659478-7758-4b59-bd70-27738e2cbca8-util\" (UniqueName: \"kubernetes.io/empty-dir/6e659478-7758-4b59-bd70-27738e2cbca8-util\") pod \"6e659478-7758-4b59-bd70-27738e2cbca8\" (UID: \"6e659478-7758-4b59-bd70-27738e2cbca8\") "
Nov 04 02:20:38.690213 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.684486    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f649e927-25bf-4f4c-8237-e61aaf7c2a85-kube-api-access-2xjhh\" (UniqueName: \"kubernetes.io/projected/f649e927-25bf-4f4c-8237-e61aaf7c2a85-kube-api-access-2xjhh\") pod \"f649e927-25bf-4f4c-8237-e61aaf7c2a85\" (UID: \"f649e927-25bf-4f4c-8237-e61aaf7c2a85\") "
Nov 04 02:20:38.704163 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.692963    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f649e927-25bf-4f4c-8237-e61aaf7c2a85-bundle" pod "f649e927-25bf-4f4c-8237-e61aaf7c2a85" (UID: "f649e927-25bf-4f4c-8237-e61aaf7c2a85"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:38.704163 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.702734    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e659478-7758-4b59-bd70-27738e2cbca8-util" pod "6e659478-7758-4b59-bd70-27738e2cbca8" (UID: "6e659478-7758-4b59-bd70-27738e2cbca8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:38.705525 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.704723    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e659478-7758-4b59-bd70-27738e2cbca8-bundle" pod "6e659478-7758-4b59-bd70-27738e2cbca8" (UID: "6e659478-7758-4b59-bd70-27738e2cbca8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:38.721385 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.708592    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f649e927-25bf-4f4c-8237-e61aaf7c2a85-util" pod "f649e927-25bf-4f4c-8237-e61aaf7c2a85" (UID: "f649e927-25bf-4f4c-8237-e61aaf7c2a85"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:38.727786 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.727741    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f649e927-25bf-4f4c-8237-e61aaf7c2a85-kube-api-access-2xjhh" pod "f649e927-25bf-4f4c-8237-e61aaf7c2a85" (UID: "f649e927-25bf-4f4c-8237-e61aaf7c2a85"). InnerVolumeSpecName "kube-api-access-2xjhh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:20:38.741965 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.741757    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e659478-7758-4b59-bd70-27738e2cbca8-kube-api-access-5p77l" pod "6e659478-7758-4b59-bd70-27738e2cbca8" (UID: "6e659478-7758-4b59-bd70-27738e2cbca8"). InnerVolumeSpecName "kube-api-access-5p77l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:20:38.786651 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.786500    4548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f649e927-25bf-4f4c-8237-e61aaf7c2a85-util\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:38.786651 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.786532    4548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6e659478-7758-4b59-bd70-27738e2cbca8-util\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:38.786651 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.786547    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xjhh\" (UniqueName: \"kubernetes.io/projected/f649e927-25bf-4f4c-8237-e61aaf7c2a85-kube-api-access-2xjhh\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:38.786651 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.786563    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5p77l\" (UniqueName: \"kubernetes.io/projected/6e659478-7758-4b59-bd70-27738e2cbca8-kube-api-access-5p77l\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:38.786651 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.786578    4548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6e659478-7758-4b59-bd70-27738e2cbca8-bundle\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:38.786651 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:38.786592    4548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f649e927-25bf-4f4c-8237-e61aaf7c2a85-bundle\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:39.280293 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:39.277717    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf" event={"ID":"6e659478-7758-4b59-bd70-27738e2cbca8","Type":"ContainerDied","Data":"ee958661e77f7e4f02da200c0062e8370bf7ce80c64e6d6b3b9bbda1297b999b"}
Nov 04 02:20:39.280293 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:39.277814    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee958661e77f7e4f02da200c0062e8370bf7ce80c64e6d6b3b9bbda1297b999b"
Nov 04 02:20:39.280293 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:39.277904    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ah4vkf"
Nov 04 02:20:39.291106 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:39.290669    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5" event={"ID":"65924a14-a1d1-4101-971e-aecede66fc85","Type":"ContainerStarted","Data":"44539db7c2cc7e79bb95c67e269f61bb940735f52f6e8b8e690baca06bafb150"}
Nov 04 02:20:39.297357 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:39.297322    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9" event={"ID":"f649e927-25bf-4f4c-8237-e61aaf7c2a85","Type":"ContainerDied","Data":"c65e4f9074d703839547ce6ce56dab9d1acc83d7eef35e79bfe5cd9e92629492"}
Nov 04 02:20:39.297550 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:39.297374    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c65e4f9074d703839547ce6ce56dab9d1acc83d7eef35e79bfe5cd9e92629492"
Nov 04 02:20:39.297550 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:39.297460    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651ch4kt9"
Nov 04 02:20:40.305684 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.305650    4548 generic.go:356] "Generic (PLEG): container finished" podID="9390a762-09f8-465b-8bea-1e7fb91d6b06" containerID="fa8ca253f91a9064bf115dbc08bed64e1c5dc726094fcd850097e68803bde86f" exitCode=0
Nov 04 02:20:40.306133 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.305739    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x" event={"ID":"9390a762-09f8-465b-8bea-1e7fb91d6b06","Type":"ContainerDied","Data":"fa8ca253f91a9064bf115dbc08bed64e1c5dc726094fcd850097e68803bde86f"}
Nov 04 02:20:40.308824 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.308783    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8" event={"ID":"d9317ace-8bc7-4042-8032-68ef8f9f192b","Type":"ContainerStarted","Data":"c92d06375fe89ac6326d44a7885d70722c55cf07012807899132132a8d924204"}
Nov 04 02:20:40.311456 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.311429    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466" event={"ID":"a933162b-e883-4beb-9f00-34b31c3c7e1a","Type":"ContainerStarted","Data":"0f36dc282ec989f1e49a9dcf9f6cc6cf93260d5d59d5f3042929a4e00f6370f4"}
Nov 04 02:20:40.314603 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.314099    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh" event={"ID":"a2f160b0-ca53-4e4d-9163-49d7079f9091","Type":"ContainerStarted","Data":"3cfbea0f0b85c68f0ca890dcfb61165bf3c4a4eb8878cd8078ae84d2c201f53d"}
Nov 04 02:20:40.316247 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.316219    4548 generic.go:356] "Generic (PLEG): container finished" podID="65924a14-a1d1-4101-971e-aecede66fc85" containerID="44539db7c2cc7e79bb95c67e269f61bb940735f52f6e8b8e690baca06bafb150" exitCode=0
Nov 04 02:20:40.316600 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.316576    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5" event={"ID":"65924a14-a1d1-4101-971e-aecede66fc85","Type":"ContainerDied","Data":"44539db7c2cc7e79bb95c67e269f61bb940735f52f6e8b8e690baca06bafb150"}
Nov 04 02:20:40.321105 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.321069    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l" event={"ID":"d3ec8475-b258-49b5-b1bd-46648102fd0e","Type":"ContainerStarted","Data":"7fc2bc71e5706bb6ee0e95f7df13938bdf6485cf85b46e4da0e2e4f6bf48b1a4"}
Nov 04 02:20:40.470675 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.470639    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5"
Nov 04 02:20:40.544335 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.544284    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l" podStartSLOduration=4.080201372 podStartE2EDuration="52.544268658s" totalImagesPullingTime="48.464067286s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:19:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:20:40.54386752 +0000 UTC m=+274.148880519" watchObservedRunningTime="2026-11-04 02:20:40.544268658 +0000 UTC m=+274.149281655"
Nov 04 02:20:40.606440 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.606396    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65924a14-a1d1-4101-971e-aecede66fc85-bundle\" (UniqueName: \"kubernetes.io/empty-dir/65924a14-a1d1-4101-971e-aecede66fc85-bundle\") pod \"65924a14-a1d1-4101-971e-aecede66fc85\" (UID: \"65924a14-a1d1-4101-971e-aecede66fc85\") "
Nov 04 02:20:40.606624 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.606461    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/65924a14-a1d1-4101-971e-aecede66fc85-kube-api-access-ghwlq\" (UniqueName: \"kubernetes.io/projected/65924a14-a1d1-4101-971e-aecede66fc85-kube-api-access-ghwlq\") pod \"65924a14-a1d1-4101-971e-aecede66fc85\" (UID: \"65924a14-a1d1-4101-971e-aecede66fc85\") "
Nov 04 02:20:40.606624 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.606542    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/65924a14-a1d1-4101-971e-aecede66fc85-util\" (UniqueName: \"kubernetes.io/empty-dir/65924a14-a1d1-4101-971e-aecede66fc85-util\") pod \"65924a14-a1d1-4101-971e-aecede66fc85\" (UID: \"65924a14-a1d1-4101-971e-aecede66fc85\") "
Nov 04 02:20:40.607001 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.606966    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65924a14-a1d1-4101-971e-aecede66fc85-bundle" pod "65924a14-a1d1-4101-971e-aecede66fc85" (UID: "65924a14-a1d1-4101-971e-aecede66fc85"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:40.608871 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.608830    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65924a14-a1d1-4101-971e-aecede66fc85-kube-api-access-ghwlq" pod "65924a14-a1d1-4101-971e-aecede66fc85" (UID: "65924a14-a1d1-4101-971e-aecede66fc85"). InnerVolumeSpecName "kube-api-access-ghwlq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:20:40.613331 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.613300    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65924a14-a1d1-4101-971e-aecede66fc85-util" pod "65924a14-a1d1-4101-971e-aecede66fc85" (UID: "65924a14-a1d1-4101-971e-aecede66fc85"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:40.618076 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:20:40.618038    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:20:40.665090 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.665019    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466" podStartSLOduration=3.134647174 podStartE2EDuration="48.664995852s" totalImagesPullingTime="45.530348678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:19:52 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:20:40.662804616 +0000 UTC m=+274.267817615" watchObservedRunningTime="2026-11-04 02:20:40.664995852 +0000 UTC m=+274.270008851"
Nov 04 02:20:40.707648 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.707614    4548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/65924a14-a1d1-4101-971e-aecede66fc85-bundle\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:40.707648 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.707644    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghwlq\" (UniqueName: \"kubernetes.io/projected/65924a14-a1d1-4101-971e-aecede66fc85-kube-api-access-ghwlq\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:40.707648 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.707655    4548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/65924a14-a1d1-4101-971e-aecede66fc85-util\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:40.782105 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:40.782049    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh" podStartSLOduration=3.527205697 podStartE2EDuration="56.782033188s" totalImagesPullingTime="53.254827491s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:19:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:20:40.781147963 +0000 UTC m=+274.386160962" watchObservedRunningTime="2026-11-04 02:20:40.782033188 +0000 UTC m=+274.387046186"
Nov 04 02:20:41.328544 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.328507    4548 generic.go:356] "Generic (PLEG): container finished" podID="a933162b-e883-4beb-9f00-34b31c3c7e1a" containerID="0f36dc282ec989f1e49a9dcf9f6cc6cf93260d5d59d5f3042929a4e00f6370f4" exitCode=0
Nov 04 02:20:41.329049 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.328591    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466" event={"ID":"a933162b-e883-4beb-9f00-34b31c3c7e1a","Type":"ContainerDied","Data":"0f36dc282ec989f1e49a9dcf9f6cc6cf93260d5d59d5f3042929a4e00f6370f4"}
Nov 04 02:20:41.330890 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.330854    4548 generic.go:356] "Generic (PLEG): container finished" podID="a2f160b0-ca53-4e4d-9163-49d7079f9091" containerID="3cfbea0f0b85c68f0ca890dcfb61165bf3c4a4eb8878cd8078ae84d2c201f53d" exitCode=0
Nov 04 02:20:41.331052 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.330931    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh" event={"ID":"a2f160b0-ca53-4e4d-9163-49d7079f9091","Type":"ContainerDied","Data":"3cfbea0f0b85c68f0ca890dcfb61165bf3c4a4eb8878cd8078ae84d2c201f53d"}
Nov 04 02:20:41.332853 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.332836    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5"
Nov 04 02:20:41.332993 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.332831    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c6gcmc5" event={"ID":"65924a14-a1d1-4101-971e-aecede66fc85","Type":"ContainerDied","Data":"986d0a8d2cde75ddb4477c185dc701f90c8b863fede22526b2747afceefee237"}
Nov 04 02:20:41.332993 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.332944    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="986d0a8d2cde75ddb4477c185dc701f90c8b863fede22526b2747afceefee237"
Nov 04 02:20:41.335076 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.335054    4548 generic.go:356] "Generic (PLEG): container finished" podID="d3ec8475-b258-49b5-b1bd-46648102fd0e" containerID="7fc2bc71e5706bb6ee0e95f7df13938bdf6485cf85b46e4da0e2e4f6bf48b1a4" exitCode=0
Nov 04 02:20:41.335210 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.335120    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l" event={"ID":"d3ec8475-b258-49b5-b1bd-46648102fd0e","Type":"ContainerDied","Data":"7fc2bc71e5706bb6ee0e95f7df13938bdf6485cf85b46e4da0e2e4f6bf48b1a4"}
Nov 04 02:20:41.337543 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.337518    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn" event={"ID":"99d9e86c-92fc-488a-a371-1d66a26020ec","Type":"ContainerStarted","Data":"faea4ba46758618377d3a1a552ac970be324a00752bc40bf5b3b36c8d69963be"}
Nov 04 02:20:41.339606 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.339583    4548 generic.go:356] "Generic (PLEG): container finished" podID="85d2e37b-734e-4e99-8366-c19efb002440" containerID="a08acdb6fa7275eeed174cc56e0948bafa272cb123e4a1c3620fdf74f30b3b26" exitCode=0
Nov 04 02:20:41.339716 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.339668    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l" event={"ID":"85d2e37b-734e-4e99-8366-c19efb002440","Type":"ContainerDied","Data":"a08acdb6fa7275eeed174cc56e0948bafa272cb123e4a1c3620fdf74f30b3b26"}
Nov 04 02:20:41.342381 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.342359    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk" event={"ID":"386f800a-9968-4225-b9db-e643d416be01","Type":"ContainerStarted","Data":"ce71f1184986f9a0a32302559e02be5fb5bab1641f87dd280b35f4613fc9d863"}
Nov 04 02:20:41.344476 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.344450    4548 generic.go:356] "Generic (PLEG): container finished" podID="d9317ace-8bc7-4042-8032-68ef8f9f192b" containerID="c92d06375fe89ac6326d44a7885d70722c55cf07012807899132132a8d924204" exitCode=0
Nov 04 02:20:41.344566 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.344532    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8" event={"ID":"d9317ace-8bc7-4042-8032-68ef8f9f192b","Type":"ContainerDied","Data":"c92d06375fe89ac6326d44a7885d70722c55cf07012807899132132a8d924204"}
Nov 04 02:20:41.346615 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.346594    4548 generic.go:356] "Generic (PLEG): container finished" podID="c2488a78-d7af-4346-a841-0deda0b64591" containerID="bcc5fbdc75282f3e035fa53957a1b48b4e933eaba0e3ef7d4b47147d0f55b0f6" exitCode=0
Nov 04 02:20:41.346699 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.346676    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd" event={"ID":"c2488a78-d7af-4346-a841-0deda0b64591","Type":"ContainerDied","Data":"bcc5fbdc75282f3e035fa53957a1b48b4e933eaba0e3ef7d4b47147d0f55b0f6"}
Nov 04 02:20:41.501540 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.501152    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x"
Nov 04 02:20:41.567723 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.567620    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn" podStartSLOduration=3.8603154330000002 podStartE2EDuration="56.567607143s" totalImagesPullingTime="52.70729171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:19:45 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:20:41.566834098 +0000 UTC m=+275.171847121" watchObservedRunningTime="2026-11-04 02:20:41.567607143 +0000 UTC m=+275.172620140"
Nov 04 02:20:41.616959 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.616898    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9390a762-09f8-465b-8bea-1e7fb91d6b06-kube-api-access-m6vtj\" (UniqueName: \"kubernetes.io/projected/9390a762-09f8-465b-8bea-1e7fb91d6b06-kube-api-access-m6vtj\") pod \"9390a762-09f8-465b-8bea-1e7fb91d6b06\" (UID: \"9390a762-09f8-465b-8bea-1e7fb91d6b06\") "
Nov 04 02:20:41.617144 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.616977    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9390a762-09f8-465b-8bea-1e7fb91d6b06-util\" (UniqueName: \"kubernetes.io/empty-dir/9390a762-09f8-465b-8bea-1e7fb91d6b06-util\") pod \"9390a762-09f8-465b-8bea-1e7fb91d6b06\" (UID: \"9390a762-09f8-465b-8bea-1e7fb91d6b06\") "
Nov 04 02:20:41.617144 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.617117    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9390a762-09f8-465b-8bea-1e7fb91d6b06-bundle\" (UniqueName: \"kubernetes.io/empty-dir/9390a762-09f8-465b-8bea-1e7fb91d6b06-bundle\") pod \"9390a762-09f8-465b-8bea-1e7fb91d6b06\" (UID: \"9390a762-09f8-465b-8bea-1e7fb91d6b06\") "
Nov 04 02:20:41.617622 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.617596    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9390a762-09f8-465b-8bea-1e7fb91d6b06-bundle" pod "9390a762-09f8-465b-8bea-1e7fb91d6b06" (UID: "9390a762-09f8-465b-8bea-1e7fb91d6b06"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:41.619448 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.619416    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9390a762-09f8-465b-8bea-1e7fb91d6b06-kube-api-access-m6vtj" pod "9390a762-09f8-465b-8bea-1e7fb91d6b06" (UID: "9390a762-09f8-465b-8bea-1e7fb91d6b06"). InnerVolumeSpecName "kube-api-access-m6vtj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:20:41.623506 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.623473    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9390a762-09f8-465b-8bea-1e7fb91d6b06-util" pod "9390a762-09f8-465b-8bea-1e7fb91d6b06" (UID: "9390a762-09f8-465b-8bea-1e7fb91d6b06"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:41.718020 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.717974    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m6vtj\" (UniqueName: \"kubernetes.io/projected/9390a762-09f8-465b-8bea-1e7fb91d6b06-kube-api-access-m6vtj\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:41.718020 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.718012    4548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9390a762-09f8-465b-8bea-1e7fb91d6b06-util\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:41.718020 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.718022    4548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9390a762-09f8-465b-8bea-1e7fb91d6b06-bundle\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:41.804674 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:41.804621    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk" podStartSLOduration=3.836343606 podStartE2EDuration="57.804603883s" totalImagesPullingTime="53.968260277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:19:44 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:20:41.803510151 +0000 UTC m=+275.408523148" watchObservedRunningTime="2026-11-04 02:20:41.804603883 +0000 UTC m=+275.409616890"
Nov 04 02:20:42.358696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.358660    4548 generic.go:356] "Generic (PLEG): container finished" podID="99d9e86c-92fc-488a-a371-1d66a26020ec" containerID="faea4ba46758618377d3a1a552ac970be324a00752bc40bf5b3b36c8d69963be" exitCode=0
Nov 04 02:20:42.359153 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.358747    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn" event={"ID":"99d9e86c-92fc-488a-a371-1d66a26020ec","Type":"ContainerDied","Data":"faea4ba46758618377d3a1a552ac970be324a00752bc40bf5b3b36c8d69963be"}
Nov 04 02:20:42.361722 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.361692    4548 generic.go:356] "Generic (PLEG): container finished" podID="386f800a-9968-4225-b9db-e643d416be01" containerID="ce71f1184986f9a0a32302559e02be5fb5bab1641f87dd280b35f4613fc9d863" exitCode=0
Nov 04 02:20:42.361884 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.361774    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk" event={"ID":"386f800a-9968-4225-b9db-e643d416be01","Type":"ContainerDied","Data":"ce71f1184986f9a0a32302559e02be5fb5bab1641f87dd280b35f4613fc9d863"}
Nov 04 02:20:42.363752 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.363731    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x"
Nov 04 02:20:42.363895 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.363777    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4cpk22x" event={"ID":"9390a762-09f8-465b-8bea-1e7fb91d6b06","Type":"ContainerDied","Data":"1c40af6c0c4490c7242fa53e7acc76501ceb1b47069d3e4f9c7588cbf22760bf"}
Nov 04 02:20:42.363895 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.363837    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1c40af6c0c4490c7242fa53e7acc76501ceb1b47069d3e4f9c7588cbf22760bf"
Nov 04 02:20:42.540456 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.540424    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l"
Nov 04 02:20:42.615997 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.615920    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l"
Nov 04 02:20:42.619204 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.619158    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8"
Nov 04 02:20:42.622989 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.622961    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd"
Nov 04 02:20:42.626876 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.626850    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh"
Nov 04 02:20:42.627135 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.627120    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/85d2e37b-734e-4e99-8366-c19efb002440-bundle\" (UniqueName: \"kubernetes.io/empty-dir/85d2e37b-734e-4e99-8366-c19efb002440-bundle\") pod \"85d2e37b-734e-4e99-8366-c19efb002440\" (UID: \"85d2e37b-734e-4e99-8366-c19efb002440\") "
Nov 04 02:20:42.627350 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.627291    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/85d2e37b-734e-4e99-8366-c19efb002440-util\" (UniqueName: \"kubernetes.io/empty-dir/85d2e37b-734e-4e99-8366-c19efb002440-util\") pod \"85d2e37b-734e-4e99-8366-c19efb002440\" (UID: \"85d2e37b-734e-4e99-8366-c19efb002440\") "
Nov 04 02:20:42.627409 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.627395    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/85d2e37b-734e-4e99-8366-c19efb002440-kube-api-access-fkk67\" (UniqueName: \"kubernetes.io/projected/85d2e37b-734e-4e99-8366-c19efb002440-kube-api-access-fkk67\") pod \"85d2e37b-734e-4e99-8366-c19efb002440\" (UID: \"85d2e37b-734e-4e99-8366-c19efb002440\") "
Nov 04 02:20:42.627710 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.627682    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d2e37b-734e-4e99-8366-c19efb002440-bundle" pod "85d2e37b-734e-4e99-8366-c19efb002440" (UID: "85d2e37b-734e-4e99-8366-c19efb002440"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:42.629740 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.629718    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85d2e37b-734e-4e99-8366-c19efb002440-kube-api-access-fkk67" pod "85d2e37b-734e-4e99-8366-c19efb002440" (UID: "85d2e37b-734e-4e99-8366-c19efb002440"). InnerVolumeSpecName "kube-api-access-fkk67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:20:42.630617 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.630600    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466"
Nov 04 02:20:42.633028 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.633003    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85d2e37b-734e-4e99-8366-c19efb002440-util" pod "85d2e37b-734e-4e99-8366-c19efb002440" (UID: "85d2e37b-734e-4e99-8366-c19efb002440"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:42.728645 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.728596    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a2f160b0-ca53-4e4d-9163-49d7079f9091-util\" (UniqueName: \"kubernetes.io/empty-dir/a2f160b0-ca53-4e4d-9163-49d7079f9091-util\") pod \"a2f160b0-ca53-4e4d-9163-49d7079f9091\" (UID: \"a2f160b0-ca53-4e4d-9163-49d7079f9091\") "
Nov 04 02:20:42.728855 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.728662    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3ec8475-b258-49b5-b1bd-46648102fd0e-bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3ec8475-b258-49b5-b1bd-46648102fd0e-bundle\") pod \"d3ec8475-b258-49b5-b1bd-46648102fd0e\" (UID: \"d3ec8475-b258-49b5-b1bd-46648102fd0e\") "
Nov 04 02:20:42.728855 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.728693    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c2488a78-d7af-4346-a841-0deda0b64591-kube-api-access-87n7n\" (UniqueName: \"kubernetes.io/projected/c2488a78-d7af-4346-a841-0deda0b64591-kube-api-access-87n7n\") pod \"c2488a78-d7af-4346-a841-0deda0b64591\" (UID: \"c2488a78-d7af-4346-a841-0deda0b64591\") "
Nov 04 02:20:42.728855 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.728732    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a2f160b0-ca53-4e4d-9163-49d7079f9091-bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2f160b0-ca53-4e4d-9163-49d7079f9091-bundle\") pod \"a2f160b0-ca53-4e4d-9163-49d7079f9091\" (UID: \"a2f160b0-ca53-4e4d-9163-49d7079f9091\") "
Nov 04 02:20:42.728855 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.728755    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d3ec8475-b258-49b5-b1bd-46648102fd0e-util\" (UniqueName: \"kubernetes.io/empty-dir/d3ec8475-b258-49b5-b1bd-46648102fd0e-util\") pod \"d3ec8475-b258-49b5-b1bd-46648102fd0e\" (UID: \"d3ec8475-b258-49b5-b1bd-46648102fd0e\") "
Nov 04 02:20:42.729075 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.728870    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a933162b-e883-4beb-9f00-34b31c3c7e1a-kube-api-access-mfvv6\" (UniqueName: \"kubernetes.io/projected/a933162b-e883-4beb-9f00-34b31c3c7e1a-kube-api-access-mfvv6\") pod \"a933162b-e883-4beb-9f00-34b31c3c7e1a\" (UID: \"a933162b-e883-4beb-9f00-34b31c3c7e1a\") "
Nov 04 02:20:42.729075 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.728898    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a933162b-e883-4beb-9f00-34b31c3c7e1a-bundle\" (UniqueName: \"kubernetes.io/empty-dir/a933162b-e883-4beb-9f00-34b31c3c7e1a-bundle\") pod \"a933162b-e883-4beb-9f00-34b31c3c7e1a\" (UID: \"a933162b-e883-4beb-9f00-34b31c3c7e1a\") "
Nov 04 02:20:42.729075 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.728918    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a933162b-e883-4beb-9f00-34b31c3c7e1a-util\" (UniqueName: \"kubernetes.io/empty-dir/a933162b-e883-4beb-9f00-34b31c3c7e1a-util\") pod \"a933162b-e883-4beb-9f00-34b31c3c7e1a\" (UID: \"a933162b-e883-4beb-9f00-34b31c3c7e1a\") "
Nov 04 02:20:42.729075 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.728951    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9317ace-8bc7-4042-8032-68ef8f9f192b-util\" (UniqueName: \"kubernetes.io/empty-dir/d9317ace-8bc7-4042-8032-68ef8f9f192b-util\") pod \"d9317ace-8bc7-4042-8032-68ef8f9f192b\" (UID: \"d9317ace-8bc7-4042-8032-68ef8f9f192b\") "
Nov 04 02:20:42.729075 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.728988    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2488a78-d7af-4346-a841-0deda0b64591-bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2488a78-d7af-4346-a841-0deda0b64591-bundle\") pod \"c2488a78-d7af-4346-a841-0deda0b64591\" (UID: \"c2488a78-d7af-4346-a841-0deda0b64591\") "
Nov 04 02:20:42.729075 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.729027    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d9317ace-8bc7-4042-8032-68ef8f9f192b-kube-api-access-dpg4l\" (UniqueName: \"kubernetes.io/projected/d9317ace-8bc7-4042-8032-68ef8f9f192b-kube-api-access-dpg4l\") pod \"d9317ace-8bc7-4042-8032-68ef8f9f192b\" (UID: \"d9317ace-8bc7-4042-8032-68ef8f9f192b\") "
Nov 04 02:20:42.729075 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.729068    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c2488a78-d7af-4346-a841-0deda0b64591-util\" (UniqueName: \"kubernetes.io/empty-dir/c2488a78-d7af-4346-a841-0deda0b64591-util\") pod \"c2488a78-d7af-4346-a841-0deda0b64591\" (UID: \"c2488a78-d7af-4346-a841-0deda0b64591\") "
Nov 04 02:20:42.729437 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.729126    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d3ec8475-b258-49b5-b1bd-46648102fd0e-kube-api-access-d8l7j\" (UniqueName: \"kubernetes.io/projected/d3ec8475-b258-49b5-b1bd-46648102fd0e-kube-api-access-d8l7j\") pod \"d3ec8475-b258-49b5-b1bd-46648102fd0e\" (UID: \"d3ec8475-b258-49b5-b1bd-46648102fd0e\") "
Nov 04 02:20:42.729437 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.729210    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d9317ace-8bc7-4042-8032-68ef8f9f192b-bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9317ace-8bc7-4042-8032-68ef8f9f192b-bundle\") pod \"d9317ace-8bc7-4042-8032-68ef8f9f192b\" (UID: \"d9317ace-8bc7-4042-8032-68ef8f9f192b\") "
Nov 04 02:20:42.729437 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.729255    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a2f160b0-ca53-4e4d-9163-49d7079f9091-kube-api-access-lbh27\" (UniqueName: \"kubernetes.io/projected/a2f160b0-ca53-4e4d-9163-49d7079f9091-kube-api-access-lbh27\") pod \"a2f160b0-ca53-4e4d-9163-49d7079f9091\" (UID: \"a2f160b0-ca53-4e4d-9163-49d7079f9091\") "
Nov 04 02:20:42.729437 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.729350    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2f160b0-ca53-4e4d-9163-49d7079f9091-bundle" pod "a2f160b0-ca53-4e4d-9163-49d7079f9091" (UID: "a2f160b0-ca53-4e4d-9163-49d7079f9091"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:42.731702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.729987    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2488a78-d7af-4346-a841-0deda0b64591-bundle" pod "c2488a78-d7af-4346-a841-0deda0b64591" (UID: "c2488a78-d7af-4346-a841-0deda0b64591"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:42.731702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.730000    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkk67\" (UniqueName: \"kubernetes.io/projected/85d2e37b-734e-4e99-8366-c19efb002440-kube-api-access-fkk67\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:42.731702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.730049    4548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85d2e37b-734e-4e99-8366-c19efb002440-bundle\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:42.731702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.730067    4548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a2f160b0-ca53-4e4d-9163-49d7079f9091-bundle\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:42.731702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.730080    4548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85d2e37b-734e-4e99-8366-c19efb002440-util\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:42.731702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.730149    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ec8475-b258-49b5-b1bd-46648102fd0e-bundle" pod "d3ec8475-b258-49b5-b1bd-46648102fd0e" (UID: "d3ec8475-b258-49b5-b1bd-46648102fd0e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:42.731702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.731053    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a933162b-e883-4beb-9f00-34b31c3c7e1a-bundle" pod "a933162b-e883-4beb-9f00-34b31c3c7e1a" (UID: "a933162b-e883-4beb-9f00-34b31c3c7e1a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:42.732159 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.732053    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9317ace-8bc7-4042-8032-68ef8f9f192b-bundle" pod "d9317ace-8bc7-4042-8032-68ef8f9f192b" (UID: "d9317ace-8bc7-4042-8032-68ef8f9f192b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:42.732377 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.732354    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2488a78-d7af-4346-a841-0deda0b64591-kube-api-access-87n7n" pod "c2488a78-d7af-4346-a841-0deda0b64591" (UID: "c2488a78-d7af-4346-a841-0deda0b64591"). InnerVolumeSpecName "kube-api-access-87n7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:20:42.732496 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.732461    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2f160b0-ca53-4e4d-9163-49d7079f9091-kube-api-access-lbh27" pod "a2f160b0-ca53-4e4d-9163-49d7079f9091" (UID: "a2f160b0-ca53-4e4d-9163-49d7079f9091"). InnerVolumeSpecName "kube-api-access-lbh27". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:20:42.732667 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.732640    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a933162b-e883-4beb-9f00-34b31c3c7e1a-kube-api-access-mfvv6" pod "a933162b-e883-4beb-9f00-34b31c3c7e1a" (UID: "a933162b-e883-4beb-9f00-34b31c3c7e1a"). InnerVolumeSpecName "kube-api-access-mfvv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:20:42.734279 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.734256    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9317ace-8bc7-4042-8032-68ef8f9f192b-kube-api-access-dpg4l" pod "d9317ace-8bc7-4042-8032-68ef8f9f192b" (UID: "d9317ace-8bc7-4042-8032-68ef8f9f192b"). InnerVolumeSpecName "kube-api-access-dpg4l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:20:42.735896 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.735864    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3ec8475-b258-49b5-b1bd-46648102fd0e-kube-api-access-d8l7j" pod "d3ec8475-b258-49b5-b1bd-46648102fd0e" (UID: "d3ec8475-b258-49b5-b1bd-46648102fd0e"). InnerVolumeSpecName "kube-api-access-d8l7j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:20:42.738452 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.738426    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a2f160b0-ca53-4e4d-9163-49d7079f9091-util" pod "a2f160b0-ca53-4e4d-9163-49d7079f9091" (UID: "a2f160b0-ca53-4e4d-9163-49d7079f9091"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:42.739053 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.739026    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3ec8475-b258-49b5-b1bd-46648102fd0e-util" pod "d3ec8475-b258-49b5-b1bd-46648102fd0e" (UID: "d3ec8475-b258-49b5-b1bd-46648102fd0e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:42.739205 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.739185    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9317ace-8bc7-4042-8032-68ef8f9f192b-util" pod "d9317ace-8bc7-4042-8032-68ef8f9f192b" (UID: "d9317ace-8bc7-4042-8032-68ef8f9f192b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:42.739732 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.739712    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a933162b-e883-4beb-9f00-34b31c3c7e1a-util" pod "a933162b-e883-4beb-9f00-34b31c3c7e1a" (UID: "a933162b-e883-4beb-9f00-34b31c3c7e1a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:42.740573 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.740553    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c2488a78-d7af-4346-a841-0deda0b64591-util" pod "c2488a78-d7af-4346-a841-0deda0b64591" (UID: "c2488a78-d7af-4346-a841-0deda0b64591"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:42.830852 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.830809    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8l7j\" (UniqueName: \"kubernetes.io/projected/d3ec8475-b258-49b5-b1bd-46648102fd0e-kube-api-access-d8l7j\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:42.830852 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.830845    4548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9317ace-8bc7-4042-8032-68ef8f9f192b-bundle\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:42.830852 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.830856    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lbh27\" (UniqueName: \"kubernetes.io/projected/a2f160b0-ca53-4e4d-9163-49d7079f9091-kube-api-access-lbh27\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:42.830852 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.830865    4548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a2f160b0-ca53-4e4d-9163-49d7079f9091-util\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:42.831134 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.830875    4548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d3ec8475-b258-49b5-b1bd-46648102fd0e-bundle\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:42.831134 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.830884    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-87n7n\" (UniqueName: \"kubernetes.io/projected/c2488a78-d7af-4346-a841-0deda0b64591-kube-api-access-87n7n\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:42.831134 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.830892    4548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d3ec8475-b258-49b5-b1bd-46648102fd0e-util\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:42.831134 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.830901    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfvv6\" (UniqueName: \"kubernetes.io/projected/a933162b-e883-4beb-9f00-34b31c3c7e1a-kube-api-access-mfvv6\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:42.831134 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.830911    4548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a933162b-e883-4beb-9f00-34b31c3c7e1a-bundle\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:42.831134 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.830919    4548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a933162b-e883-4beb-9f00-34b31c3c7e1a-util\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:42.831134 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.830927    4548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9317ace-8bc7-4042-8032-68ef8f9f192b-util\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:42.831134 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.830935    4548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c2488a78-d7af-4346-a841-0deda0b64591-bundle\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:42.831134 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.830942    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dpg4l\" (UniqueName: \"kubernetes.io/projected/d9317ace-8bc7-4042-8032-68ef8f9f192b-kube-api-access-dpg4l\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:42.831134 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:42.830951    4548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c2488a78-d7af-4346-a841-0deda0b64591-util\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:43.370471 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.370437    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466"
Nov 04 02:20:43.370956 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.370439    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847ad9466" event={"ID":"a933162b-e883-4beb-9f00-34b31c3c7e1a","Type":"ContainerDied","Data":"78ab134b71b1bcca14b6757f7f4575f0275752ae2e289106f4214636c555e564"}
Nov 04 02:20:43.370956 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.370564    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="78ab134b71b1bcca14b6757f7f4575f0275752ae2e289106f4214636c555e564"
Nov 04 02:20:43.372614 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.372590    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh"
Nov 04 02:20:43.372733 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.372603    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4c8g2hh" event={"ID":"a2f160b0-ca53-4e4d-9163-49d7079f9091","Type":"ContainerDied","Data":"a4dc0ba87888946a0bb8e52c6781048b95d1366a8e6e0388717f6f2bcb649b65"}
Nov 04 02:20:43.372733 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.372655    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4dc0ba87888946a0bb8e52c6781048b95d1366a8e6e0388717f6f2bcb649b65"
Nov 04 02:20:43.381862 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.381810    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l" event={"ID":"d3ec8475-b258-49b5-b1bd-46648102fd0e","Type":"ContainerDied","Data":"45da1597f377f3a2f1e0870a40ad427cc9bf816a541d932540f18ad5a6807d80"}
Nov 04 02:20:43.382043 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.381912    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="45da1597f377f3a2f1e0870a40ad427cc9bf816a541d932540f18ad5a6807d80"
Nov 04 02:20:43.382043 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.381897    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c7537007944577f64df34960ace3c69136c4162cd56d2c48c7c51e651cs5l8l"
Nov 04 02:20:43.385434 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.385127    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l"
Nov 04 02:20:43.385680 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.385637    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7lm27l" event={"ID":"85d2e37b-734e-4e99-8366-c19efb002440","Type":"ContainerDied","Data":"cceeeacd922f8ee27418d199bcea66c778c31436f7709f3a0bdacdfe885bc621"}
Nov 04 02:20:43.385809 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.385727    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cceeeacd922f8ee27418d199bcea66c778c31436f7709f3a0bdacdfe885bc621"
Nov 04 02:20:43.387485 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.387458    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8" event={"ID":"d9317ace-8bc7-4042-8032-68ef8f9f192b","Type":"ContainerDied","Data":"63c9516c03acad095a50ecce249117352e0b804bcabbc6fb0b30bd3f65881bf9"}
Nov 04 02:20:43.387592 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.387502    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63c9516c03acad095a50ecce249117352e0b804bcabbc6fb0b30bd3f65881bf9"
Nov 04 02:20:43.387592 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.387588    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c4959aeb960c8e20c88ac2de924a35b8221494bf772d0dcdd61893e644wgvp8"
Nov 04 02:20:43.393892 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.393858    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd" event={"ID":"c2488a78-d7af-4346-a841-0deda0b64591","Type":"ContainerDied","Data":"4d4facb4e8cc847fea79f9c1f7fd2be970435eb313154ff028c9f4b0afebd7d7"}
Nov 04 02:20:43.393992 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.393914    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d4facb4e8cc847fea79f9c1f7fd2be970435eb313154ff028c9f4b0afebd7d7"
Nov 04 02:20:43.393992 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.393923    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7nndcd"
Nov 04 02:20:43.538936 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.538905    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn"
Nov 04 02:20:43.558370 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.558341    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk"
Nov 04 02:20:43.637465 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.637363    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/99d9e86c-92fc-488a-a371-1d66a26020ec-bundle\" (UniqueName: \"kubernetes.io/empty-dir/99d9e86c-92fc-488a-a371-1d66a26020ec-bundle\") pod \"99d9e86c-92fc-488a-a371-1d66a26020ec\" (UID: \"99d9e86c-92fc-488a-a371-1d66a26020ec\") "
Nov 04 02:20:43.637465 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.637411    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/386f800a-9968-4225-b9db-e643d416be01-util\" (UniqueName: \"kubernetes.io/empty-dir/386f800a-9968-4225-b9db-e643d416be01-util\") pod \"386f800a-9968-4225-b9db-e643d416be01\" (UID: \"386f800a-9968-4225-b9db-e643d416be01\") "
Nov 04 02:20:43.637465 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.637440    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/386f800a-9968-4225-b9db-e643d416be01-bundle\" (UniqueName: \"kubernetes.io/empty-dir/386f800a-9968-4225-b9db-e643d416be01-bundle\") pod \"386f800a-9968-4225-b9db-e643d416be01\" (UID: \"386f800a-9968-4225-b9db-e643d416be01\") "
Nov 04 02:20:43.637744 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.637494    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/99d9e86c-92fc-488a-a371-1d66a26020ec-util\" (UniqueName: \"kubernetes.io/empty-dir/99d9e86c-92fc-488a-a371-1d66a26020ec-util\") pod \"99d9e86c-92fc-488a-a371-1d66a26020ec\" (UID: \"99d9e86c-92fc-488a-a371-1d66a26020ec\") "
Nov 04 02:20:43.637744 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.637540    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/386f800a-9968-4225-b9db-e643d416be01-kube-api-access-mz7h2\" (UniqueName: \"kubernetes.io/projected/386f800a-9968-4225-b9db-e643d416be01-kube-api-access-mz7h2\") pod \"386f800a-9968-4225-b9db-e643d416be01\" (UID: \"386f800a-9968-4225-b9db-e643d416be01\") "
Nov 04 02:20:43.637744 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.637575    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/99d9e86c-92fc-488a-a371-1d66a26020ec-kube-api-access-c7tcr\" (UniqueName: \"kubernetes.io/projected/99d9e86c-92fc-488a-a371-1d66a26020ec-kube-api-access-c7tcr\") pod \"99d9e86c-92fc-488a-a371-1d66a26020ec\" (UID: \"99d9e86c-92fc-488a-a371-1d66a26020ec\") "
Nov 04 02:20:43.638007 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.637976    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/386f800a-9968-4225-b9db-e643d416be01-bundle" pod "386f800a-9968-4225-b9db-e643d416be01" (UID: "386f800a-9968-4225-b9db-e643d416be01"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:43.638078 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.638063    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99d9e86c-92fc-488a-a371-1d66a26020ec-bundle" pod "99d9e86c-92fc-488a-a371-1d66a26020ec" (UID: "99d9e86c-92fc-488a-a371-1d66a26020ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:43.640657 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.640631    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/99d9e86c-92fc-488a-a371-1d66a26020ec-kube-api-access-c7tcr" pod "99d9e86c-92fc-488a-a371-1d66a26020ec" (UID: "99d9e86c-92fc-488a-a371-1d66a26020ec"). InnerVolumeSpecName "kube-api-access-c7tcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:20:43.641073 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.641050    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/386f800a-9968-4225-b9db-e643d416be01-kube-api-access-mz7h2" pod "386f800a-9968-4225-b9db-e643d416be01" (UID: "386f800a-9968-4225-b9db-e643d416be01"). InnerVolumeSpecName "kube-api-access-mz7h2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:20:43.644911 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.644882    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/386f800a-9968-4225-b9db-e643d416be01-util" pod "386f800a-9968-4225-b9db-e643d416be01" (UID: "386f800a-9968-4225-b9db-e643d416be01"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:43.646551 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.646528    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/99d9e86c-92fc-488a-a371-1d66a26020ec-util" pod "99d9e86c-92fc-488a-a371-1d66a26020ec" (UID: "99d9e86c-92fc-488a-a371-1d66a26020ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:20:43.739139 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.739097    4548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/99d9e86c-92fc-488a-a371-1d66a26020ec-bundle\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:43.739139 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.739130    4548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/386f800a-9968-4225-b9db-e643d416be01-util\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:43.739139 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.739139    4548 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/386f800a-9968-4225-b9db-e643d416be01-bundle\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:43.739139 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.739147    4548 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/99d9e86c-92fc-488a-a371-1d66a26020ec-util\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:43.739426 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.739157    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz7h2\" (UniqueName: \"kubernetes.io/projected/386f800a-9968-4225-b9db-e643d416be01-kube-api-access-mz7h2\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:43.739426 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:43.739188    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7tcr\" (UniqueName: \"kubernetes.io/projected/99d9e86c-92fc-488a-a371-1d66a26020ec-kube-api-access-c7tcr\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:20:44.400556 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:44.400525    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn"
Nov 04 02:20:44.401013 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:44.400523    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e644421527c169d876fdb59235c927986d6bd2881f72d188068392be712stmn" event={"ID":"99d9e86c-92fc-488a-a371-1d66a26020ec","Type":"ContainerDied","Data":"06154bdd5bdb85584f63f64cda8fc96c45543950fe49688c4bbfc6e3e8d9c530"}
Nov 04 02:20:44.401013 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:44.400639    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06154bdd5bdb85584f63f64cda8fc96c45543950fe49688c4bbfc6e3e8d9c530"
Nov 04 02:20:44.402686 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:44.402653    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk"
Nov 04 02:20:44.402686 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:44.402659    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c687pgk" event={"ID":"386f800a-9968-4225-b9db-e643d416be01","Type":"ContainerDied","Data":"f2cb7681cf1b23a451a9c78f47705c1cc9e2b8f530004ab30e0434875ea137cc"}
Nov 04 02:20:44.402837 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:44.402704    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f2cb7681cf1b23a451a9c78f47705c1cc9e2b8f530004ab30e0434875ea137cc"
Nov 04 02:20:47.707898 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.707865    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-47l84"]
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708164    4548 cpu_manager.go:414] "containerMap: removing container" podUID="a2f160b0-ca53-4e4d-9163-49d7079f9091" containerName="util"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708191    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a2f160b0-ca53-4e4d-9163-49d7079f9091" containerName="util"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708202    4548 cpu_manager.go:414] "containerMap: removing container" podUID="6e659478-7758-4b59-bd70-27738e2cbca8" containerName="pull"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708207    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e659478-7758-4b59-bd70-27738e2cbca8" containerName="pull"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708214    4548 cpu_manager.go:414] "containerMap: removing container" podUID="a933162b-e883-4beb-9f00-34b31c3c7e1a" containerName="pull"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708219    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a933162b-e883-4beb-9f00-34b31c3c7e1a" containerName="pull"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708225    4548 cpu_manager.go:414] "containerMap: removing container" podUID="a2f160b0-ca53-4e4d-9163-49d7079f9091" containerName="extract"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708230    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a2f160b0-ca53-4e4d-9163-49d7079f9091" containerName="extract"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708236    4548 cpu_manager.go:414] "containerMap: removing container" podUID="d9317ace-8bc7-4042-8032-68ef8f9f192b" containerName="extract"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708240    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d9317ace-8bc7-4042-8032-68ef8f9f192b" containerName="extract"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708251    4548 cpu_manager.go:414] "containerMap: removing container" podUID="f649e927-25bf-4f4c-8237-e61aaf7c2a85" containerName="util"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708256    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f649e927-25bf-4f4c-8237-e61aaf7c2a85" containerName="util"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708265    4548 cpu_manager.go:414] "containerMap: removing container" podUID="6e659478-7758-4b59-bd70-27738e2cbca8" containerName="util"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708270    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e659478-7758-4b59-bd70-27738e2cbca8" containerName="util"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708275    4548 cpu_manager.go:414] "containerMap: removing container" podUID="85d2e37b-734e-4e99-8366-c19efb002440" containerName="util"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708279    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="85d2e37b-734e-4e99-8366-c19efb002440" containerName="util"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708285    4548 cpu_manager.go:414] "containerMap: removing container" podUID="f649e927-25bf-4f4c-8237-e61aaf7c2a85" containerName="pull"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708289    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f649e927-25bf-4f4c-8237-e61aaf7c2a85" containerName="pull"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708294    4548 cpu_manager.go:414] "containerMap: removing container" podUID="d3ec8475-b258-49b5-b1bd-46648102fd0e" containerName="pull"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708298    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d3ec8475-b258-49b5-b1bd-46648102fd0e" containerName="pull"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708305    4548 cpu_manager.go:414] "containerMap: removing container" podUID="65924a14-a1d1-4101-971e-aecede66fc85" containerName="pull"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708309    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="65924a14-a1d1-4101-971e-aecede66fc85" containerName="pull"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708317    4548 cpu_manager.go:414] "containerMap: removing container" podUID="d3ec8475-b258-49b5-b1bd-46648102fd0e" containerName="util"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708321    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d3ec8475-b258-49b5-b1bd-46648102fd0e" containerName="util"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708329    4548 cpu_manager.go:414] "containerMap: removing container" podUID="85d2e37b-734e-4e99-8366-c19efb002440" containerName="pull"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708333    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="85d2e37b-734e-4e99-8366-c19efb002440" containerName="pull"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708339    4548 cpu_manager.go:414] "containerMap: removing container" podUID="9390a762-09f8-465b-8bea-1e7fb91d6b06" containerName="extract"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708343    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9390a762-09f8-465b-8bea-1e7fb91d6b06" containerName="extract"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708349    4548 cpu_manager.go:414] "containerMap: removing container" podUID="d3ec8475-b258-49b5-b1bd-46648102fd0e" containerName="extract"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708353    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d3ec8475-b258-49b5-b1bd-46648102fd0e" containerName="extract"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708360    4548 cpu_manager.go:414] "containerMap: removing container" podUID="c2488a78-d7af-4346-a841-0deda0b64591" containerName="pull"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708364    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2488a78-d7af-4346-a841-0deda0b64591" containerName="pull"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708369    4548 cpu_manager.go:414] "containerMap: removing container" podUID="6e659478-7758-4b59-bd70-27738e2cbca8" containerName="extract"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708373    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6e659478-7758-4b59-bd70-27738e2cbca8" containerName="extract"
Nov 04 02:20:47.708358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708378    4548 cpu_manager.go:414] "containerMap: removing container" podUID="a933162b-e883-4beb-9f00-34b31c3c7e1a" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708384    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a933162b-e883-4beb-9f00-34b31c3c7e1a" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708392    4548 cpu_manager.go:414] "containerMap: removing container" podUID="386f800a-9968-4225-b9db-e643d416be01" containerName="util"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708396    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="386f800a-9968-4225-b9db-e643d416be01" containerName="util"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708401    4548 cpu_manager.go:414] "containerMap: removing container" podUID="99d9e86c-92fc-488a-a371-1d66a26020ec" containerName="util"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708406    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="99d9e86c-92fc-488a-a371-1d66a26020ec" containerName="util"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708411    4548 cpu_manager.go:414] "containerMap: removing container" podUID="386f800a-9968-4225-b9db-e643d416be01" containerName="pull"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708416    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="386f800a-9968-4225-b9db-e643d416be01" containerName="pull"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708421    4548 cpu_manager.go:414] "containerMap: removing container" podUID="65924a14-a1d1-4101-971e-aecede66fc85" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708425    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="65924a14-a1d1-4101-971e-aecede66fc85" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708431    4548 cpu_manager.go:414] "containerMap: removing container" podUID="99d9e86c-92fc-488a-a371-1d66a26020ec" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708435    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="99d9e86c-92fc-488a-a371-1d66a26020ec" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708443    4548 cpu_manager.go:414] "containerMap: removing container" podUID="d9317ace-8bc7-4042-8032-68ef8f9f192b" containerName="pull"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708447    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d9317ace-8bc7-4042-8032-68ef8f9f192b" containerName="pull"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708452    4548 cpu_manager.go:414] "containerMap: removing container" podUID="c2488a78-d7af-4346-a841-0deda0b64591" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708455    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2488a78-d7af-4346-a841-0deda0b64591" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708460    4548 cpu_manager.go:414] "containerMap: removing container" podUID="85d2e37b-734e-4e99-8366-c19efb002440" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708464    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="85d2e37b-734e-4e99-8366-c19efb002440" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708471    4548 cpu_manager.go:414] "containerMap: removing container" podUID="99d9e86c-92fc-488a-a371-1d66a26020ec" containerName="pull"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708475    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="99d9e86c-92fc-488a-a371-1d66a26020ec" containerName="pull"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708481    4548 cpu_manager.go:414] "containerMap: removing container" podUID="9390a762-09f8-465b-8bea-1e7fb91d6b06" containerName="pull"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708485    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9390a762-09f8-465b-8bea-1e7fb91d6b06" containerName="pull"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708492    4548 cpu_manager.go:414] "containerMap: removing container" podUID="9390a762-09f8-465b-8bea-1e7fb91d6b06" containerName="util"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708496    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9390a762-09f8-465b-8bea-1e7fb91d6b06" containerName="util"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708501    4548 cpu_manager.go:414] "containerMap: removing container" podUID="c2488a78-d7af-4346-a841-0deda0b64591" containerName="util"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708505    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c2488a78-d7af-4346-a841-0deda0b64591" containerName="util"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708510    4548 cpu_manager.go:414] "containerMap: removing container" podUID="d9317ace-8bc7-4042-8032-68ef8f9f192b" containerName="util"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708514    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d9317ace-8bc7-4042-8032-68ef8f9f192b" containerName="util"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708519    4548 cpu_manager.go:414] "containerMap: removing container" podUID="a2f160b0-ca53-4e4d-9163-49d7079f9091" containerName="pull"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708523    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a2f160b0-ca53-4e4d-9163-49d7079f9091" containerName="pull"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708528    4548 cpu_manager.go:414] "containerMap: removing container" podUID="f649e927-25bf-4f4c-8237-e61aaf7c2a85" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708532    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f649e927-25bf-4f4c-8237-e61aaf7c2a85" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708539    4548 cpu_manager.go:414] "containerMap: removing container" podUID="65924a14-a1d1-4101-971e-aecede66fc85" containerName="util"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708543    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="65924a14-a1d1-4101-971e-aecede66fc85" containerName="util"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708550    4548 cpu_manager.go:414] "containerMap: removing container" podUID="a933162b-e883-4beb-9f00-34b31c3c7e1a" containerName="util"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708555    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a933162b-e883-4beb-9f00-34b31c3c7e1a" containerName="util"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708559    4548 cpu_manager.go:414] "containerMap: removing container" podUID="386f800a-9968-4225-b9db-e643d416be01" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708563    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="386f800a-9968-4225-b9db-e643d416be01" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708602    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="f649e927-25bf-4f4c-8237-e61aaf7c2a85" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708608    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="386f800a-9968-4225-b9db-e643d416be01" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708614    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="d9317ace-8bc7-4042-8032-68ef8f9f192b" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708622    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="a2f160b0-ca53-4e4d-9163-49d7079f9091" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708629    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="d3ec8475-b258-49b5-b1bd-46648102fd0e" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708635    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="9390a762-09f8-465b-8bea-1e7fb91d6b06" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708640    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="6e659478-7758-4b59-bd70-27738e2cbca8" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708645    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="a933162b-e883-4beb-9f00-34b31c3c7e1a" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708650    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="99d9e86c-92fc-488a-a371-1d66a26020ec" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708654    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="65924a14-a1d1-4101-971e-aecede66fc85" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708659    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="c2488a78-d7af-4346-a841-0deda0b64591" containerName="extract"
Nov 04 02:20:47.709316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.708664    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="85d2e37b-734e-4e99-8366-c19efb002440" containerName="extract"
Nov 04 02:20:47.710618 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.710434    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-47l84"
Nov 04 02:20:47.759375 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.759335    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-47l84"]
Nov 04 02:20:47.807410 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.807376    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:20:47.807410 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.807399    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Nov 04 02:20:47.807635 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.807469    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-2xgvn\""
Nov 04 02:20:47.870412 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.870375    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3532bd65-942b-4773-93a2-9cdab8f20923-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-47l84\" (UID: \"3532bd65-942b-4773-93a2-9cdab8f20923\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-47l84"
Nov 04 02:20:47.870556 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.870432    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtvrk\" (UniqueName: \"kubernetes.io/projected/3532bd65-942b-4773-93a2-9cdab8f20923-kube-api-access-vtvrk\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-47l84\" (UID: \"3532bd65-942b-4773-93a2-9cdab8f20923\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-47l84"
Nov 04 02:20:47.971703 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.971606    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3532bd65-942b-4773-93a2-9cdab8f20923-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-47l84\" (UID: \"3532bd65-942b-4773-93a2-9cdab8f20923\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-47l84"
Nov 04 02:20:47.971703 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.971672    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtvrk\" (UniqueName: \"kubernetes.io/projected/3532bd65-942b-4773-93a2-9cdab8f20923-kube-api-access-vtvrk\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-47l84\" (UID: \"3532bd65-942b-4773-93a2-9cdab8f20923\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-47l84"
Nov 04 02:20:47.972037 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:47.972015    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3532bd65-942b-4773-93a2-9cdab8f20923-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-47l84\" (UID: \"3532bd65-942b-4773-93a2-9cdab8f20923\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-47l84"
Nov 04 02:20:48.033626 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:48.033593    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtvrk\" (UniqueName: \"kubernetes.io/projected/3532bd65-942b-4773-93a2-9cdab8f20923-kube-api-access-vtvrk\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-47l84\" (UID: \"3532bd65-942b-4773-93a2-9cdab8f20923\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-47l84"
Nov 04 02:20:48.321149 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:48.321109    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-47l84"
Nov 04 02:20:48.804572 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:48.804478    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-47l84"]
Nov 04 02:20:48.807240 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:20:48.807213    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3532bd65_942b_4773_93a2_9cdab8f20923.slice/crio-4deeb3f95d4757b0908d53406a3ed078ef917f903a70d8c5a0e82f778d0b63ea WatchSource:0}: Error finding container 4deeb3f95d4757b0908d53406a3ed078ef917f903a70d8c5a0e82f778d0b63ea: Status 404 returned error can't find the container with id 4deeb3f95d4757b0908d53406a3ed078ef917f903a70d8c5a0e82f778d0b63ea
Nov 04 02:20:49.426889 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:49.426852    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-47l84" event={"ID":"3532bd65-942b-4773-93a2-9cdab8f20923","Type":"ContainerStarted","Data":"4deeb3f95d4757b0908d53406a3ed078ef917f903a70d8c5a0e82f778d0b63ea"}
Nov 04 02:20:52.443571 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:52.443530    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-47l84" event={"ID":"3532bd65-942b-4773-93a2-9cdab8f20923","Type":"ContainerStarted","Data":"9739458a31264b97abc2b12480059c9c93d25b7e9e75f2094f082d00bd207b2f"}
Nov 04 02:20:52.665805 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:52.665739    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-47l84" podStartSLOduration=2.763250302 podStartE2EDuration="5.66572495s" totalImagesPullingTime="2.902474648s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:20:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:20:52.614702506 +0000 UTC m=+286.219715505" watchObservedRunningTime="2026-11-04 02:20:52.66572495 +0000 UTC m=+286.270737948"
Nov 04 02:20:58.191413 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:58.191370    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-b2r9v"]
Nov 04 02:20:58.194983 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:58.194965    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-b2r9v"
Nov 04 02:20:58.264611 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:58.264568    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tks6l\" (UniqueName: \"kubernetes.io/projected/a269fbce-7da0-4be1-b18e-2b571e1a870a-kube-api-access-tks6l\") pod \"limitador-operator-controller-manager-5778bb4449-b2r9v\" (UID: \"a269fbce-7da0-4be1-b18e-2b571e1a870a\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-b2r9v"
Nov 04 02:20:58.300428 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:58.300387    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Nov 04 02:20:58.300428 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:58.300387    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Nov 04 02:20:58.300680 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:58.300497    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-txxxw\""
Nov 04 02:20:58.303633 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:58.303606    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-b2r9v"]
Nov 04 02:20:58.365043 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:58.365003    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tks6l\" (UniqueName: \"kubernetes.io/projected/a269fbce-7da0-4be1-b18e-2b571e1a870a-kube-api-access-tks6l\") pod \"limitador-operator-controller-manager-5778bb4449-b2r9v\" (UID: \"a269fbce-7da0-4be1-b18e-2b571e1a870a\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-b2r9v"
Nov 04 02:20:58.427074 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:58.427028    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tks6l\" (UniqueName: \"kubernetes.io/projected/a269fbce-7da0-4be1-b18e-2b571e1a870a-kube-api-access-tks6l\") pod \"limitador-operator-controller-manager-5778bb4449-b2r9v\" (UID: \"a269fbce-7da0-4be1-b18e-2b571e1a870a\") " pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-b2r9v"
Nov 04 02:20:58.507763 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:58.507671    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-b2r9v"
Nov 04 02:20:58.883833 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:58.883809    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-5778bb4449-b2r9v"]
Nov 04 02:20:58.886243 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:20:58.886199    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda269fbce_7da0_4be1_b18e_2b571e1a870a.slice/crio-de725292a9792165beeb8b92f7a1b4544458297b279eaa3c155e7b0d32929727 WatchSource:0}: Error finding container de725292a9792165beeb8b92f7a1b4544458297b279eaa3c155e7b0d32929727: Status 404 returned error can't find the container with id de725292a9792165beeb8b92f7a1b4544458297b279eaa3c155e7b0d32929727
Nov 04 02:20:59.478010 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:20:59.477972    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-b2r9v" event={"ID":"a269fbce-7da0-4be1-b18e-2b571e1a870a","Type":"ContainerStarted","Data":"de725292a9792165beeb8b92f7a1b4544458297b279eaa3c155e7b0d32929727"}
Nov 04 02:21:03.713856 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:03.713818    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-fswlr"]
Nov 04 02:21:03.733507 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:03.733470    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fswlr"
Nov 04 02:21:03.786431 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:03.786392    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4t92m\""
Nov 04 02:21:03.810340 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:03.810306    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lkm5\" (UniqueName: \"kubernetes.io/projected/f2850da4-b47d-4643-b196-e916720d8e05-kube-api-access-2lkm5\") pod \"authorino-operator-7b7bb4bc77-fswlr\" (UID: \"f2850da4-b47d-4643-b196-e916720d8e05\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-fswlr"
Nov 04 02:21:03.839597 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:03.839551    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-fswlr"]
Nov 04 02:21:03.910976 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:03.910940    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lkm5\" (UniqueName: \"kubernetes.io/projected/f2850da4-b47d-4643-b196-e916720d8e05-kube-api-access-2lkm5\") pod \"authorino-operator-7b7bb4bc77-fswlr\" (UID: \"f2850da4-b47d-4643-b196-e916720d8e05\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-fswlr"
Nov 04 02:21:03.973156 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:03.973074    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lkm5\" (UniqueName: \"kubernetes.io/projected/f2850da4-b47d-4643-b196-e916720d8e05-kube-api-access-2lkm5\") pod \"authorino-operator-7b7bb4bc77-fswlr\" (UID: \"f2850da4-b47d-4643-b196-e916720d8e05\") " pod="kuadrant-system/authorino-operator-7b7bb4bc77-fswlr"
Nov 04 02:21:04.069319 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:04.069247    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fswlr"
Nov 04 02:21:04.455307 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:04.455283    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-7b7bb4bc77-fswlr"]
Nov 04 02:21:04.457866 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:21:04.457835    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2850da4_b47d_4643_b196_e916720d8e05.slice/crio-4d3fc181ffbdc9fda3b37d06ce3423c719c88af96ef9ac07d6f66c9abe5d2c74 WatchSource:0}: Error finding container 4d3fc181ffbdc9fda3b37d06ce3423c719c88af96ef9ac07d6f66c9abe5d2c74: Status 404 returned error can't find the container with id 4d3fc181ffbdc9fda3b37d06ce3423c719c88af96ef9ac07d6f66c9abe5d2c74
Nov 04 02:21:04.505077 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:04.505036    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-b2r9v" event={"ID":"a269fbce-7da0-4be1-b18e-2b571e1a870a","Type":"ContainerStarted","Data":"ebd398fb9685989049c08eed95774af4aa98a9d3c149c0c79bc7b000dfc976d4"}
Nov 04 02:21:04.505313 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:04.505111    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-b2r9v"
Nov 04 02:21:04.506472 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:04.506448    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fswlr" event={"ID":"f2850da4-b47d-4643-b196-e916720d8e05","Type":"ContainerStarted","Data":"4d3fc181ffbdc9fda3b37d06ce3423c719c88af96ef9ac07d6f66c9abe5d2c74"}
Nov 04 02:21:04.628507 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:04.628398    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-b2r9v" podStartSLOduration=1.154425681 podStartE2EDuration="6.628383257s" totalImagesPullingTime="5.473957576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:04.626531913 +0000 UTC m=+298.231544913" watchObservedRunningTime="2026-11-04 02:21:04.628383257 +0000 UTC m=+298.233396254"
Nov 04 02:21:05.159089 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.159044    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"]
Nov 04 02:21:05.161559 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.161539    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.219868 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.219830    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Nov 04 02:21:05.219868 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.219835    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Nov 04 02:21:05.220390 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.219952    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Nov 04 02:21:05.220390 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.220021    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-fkgjv\""
Nov 04 02:21:05.220390 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.220232    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Nov 04 02:21:05.220390 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.220378    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Nov 04 02:21:05.222696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.222675    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/372699d6-6393-42e2-a619-91b05010e006-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-jckrs\" (UID: \"372699d6-6393-42e2-a619-91b05010e006\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.222773 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.222726    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/372699d6-6393-42e2-a619-91b05010e006-metrics-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-jckrs\" (UID: \"372699d6-6393-42e2-a619-91b05010e006\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.222773 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.222744    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/372699d6-6393-42e2-a619-91b05010e006-manifests\") pod \"opendatahub-operator-controller-manager-8bf8997fb-jckrs\" (UID: \"372699d6-6393-42e2-a619-91b05010e006\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.222883 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.222817    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd722\" (UniqueName: \"kubernetes.io/projected/372699d6-6393-42e2-a619-91b05010e006-kube-api-access-gd722\") pod \"opendatahub-operator-controller-manager-8bf8997fb-jckrs\" (UID: \"372699d6-6393-42e2-a619-91b05010e006\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.222883 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.222857    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/372699d6-6393-42e2-a619-91b05010e006-webhook-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-jckrs\" (UID: \"372699d6-6393-42e2-a619-91b05010e006\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.222953 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.222921    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/372699d6-6393-42e2-a619-91b05010e006-tmp\") pod \"opendatahub-operator-controller-manager-8bf8997fb-jckrs\" (UID: \"372699d6-6393-42e2-a619-91b05010e006\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.272198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.272123    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"]
Nov 04 02:21:05.324239 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.324199    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/372699d6-6393-42e2-a619-91b05010e006-tmp\") pod \"opendatahub-operator-controller-manager-8bf8997fb-jckrs\" (UID: \"372699d6-6393-42e2-a619-91b05010e006\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.324414 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.324285    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/372699d6-6393-42e2-a619-91b05010e006-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-jckrs\" (UID: \"372699d6-6393-42e2-a619-91b05010e006\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.324414 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.324366    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/372699d6-6393-42e2-a619-91b05010e006-metrics-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-jckrs\" (UID: \"372699d6-6393-42e2-a619-91b05010e006\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.324414 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.324391    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/372699d6-6393-42e2-a619-91b05010e006-manifests\") pod \"opendatahub-operator-controller-manager-8bf8997fb-jckrs\" (UID: \"372699d6-6393-42e2-a619-91b05010e006\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.324563 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.324418    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd722\" (UniqueName: \"kubernetes.io/projected/372699d6-6393-42e2-a619-91b05010e006-kube-api-access-gd722\") pod \"opendatahub-operator-controller-manager-8bf8997fb-jckrs\" (UID: \"372699d6-6393-42e2-a619-91b05010e006\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.324563 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.324446    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/372699d6-6393-42e2-a619-91b05010e006-webhook-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-jckrs\" (UID: \"372699d6-6393-42e2-a619-91b05010e006\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.324804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.324768    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/372699d6-6393-42e2-a619-91b05010e006-manifests\") pod \"opendatahub-operator-controller-manager-8bf8997fb-jckrs\" (UID: \"372699d6-6393-42e2-a619-91b05010e006\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.326856 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.326834    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/372699d6-6393-42e2-a619-91b05010e006-tmp\") pod \"opendatahub-operator-controller-manager-8bf8997fb-jckrs\" (UID: \"372699d6-6393-42e2-a619-91b05010e006\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.327090 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.327067    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/372699d6-6393-42e2-a619-91b05010e006-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-jckrs\" (UID: \"372699d6-6393-42e2-a619-91b05010e006\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.327195 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.327132    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/372699d6-6393-42e2-a619-91b05010e006-webhook-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-jckrs\" (UID: \"372699d6-6393-42e2-a619-91b05010e006\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.327195 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.327134    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/372699d6-6393-42e2-a619-91b05010e006-metrics-cert\") pod \"opendatahub-operator-controller-manager-8bf8997fb-jckrs\" (UID: \"372699d6-6393-42e2-a619-91b05010e006\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.387376 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.387342    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd722\" (UniqueName: \"kubernetes.io/projected/372699d6-6393-42e2-a619-91b05010e006-kube-api-access-gd722\") pod \"opendatahub-operator-controller-manager-8bf8997fb-jckrs\" (UID: \"372699d6-6393-42e2-a619-91b05010e006\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.475637 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.475542    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:05.970147 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:05.970122    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"]
Nov 04 02:21:05.971604 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:21:05.971563    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod372699d6_6393_42e2_a619_91b05010e006.slice/crio-bca8615de0c2b908bcf9aa719fff916e6336e3303fe4573411c6d214012d32a1 WatchSource:0}: Error finding container bca8615de0c2b908bcf9aa719fff916e6336e3303fe4573411c6d214012d32a1: Status 404 returned error can't find the container with id bca8615de0c2b908bcf9aa719fff916e6336e3303fe4573411c6d214012d32a1
Nov 04 02:21:06.523738 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:06.523698    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs" event={"ID":"372699d6-6393-42e2-a619-91b05010e006","Type":"ContainerStarted","Data":"bca8615de0c2b908bcf9aa719fff916e6336e3303fe4573411c6d214012d32a1"}
Nov 04 02:21:06.542557 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:06.542527    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:21:06.548925 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:06.548899    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:21:07.528992 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:07.528948    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fswlr" event={"ID":"f2850da4-b47d-4643-b196-e916720d8e05","Type":"ContainerStarted","Data":"93aa3c17345881f9641242486a575232f4a7d7da93d08875ebcf89862290ce0a"}
Nov 04 02:21:07.529593 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:07.529287    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fswlr"
Nov 04 02:21:07.680855 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:07.680748    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fswlr" podStartSLOduration=1.874524141 podStartE2EDuration="4.680675779s" totalImagesPullingTime="2.806151638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:07.677238114 +0000 UTC m=+301.282251113" watchObservedRunningTime="2026-11-04 02:21:07.680675779 +0000 UTC m=+301.285688770"
Nov 04 02:21:07.945035 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:07.944939    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-ll6br"]
Nov 04 02:21:07.948846 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:07.948802    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-ll6br"
Nov 04 02:21:08.002823 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:08.002791    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Nov 04 02:21:08.003082 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:08.002911    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-z9tn5\""
Nov 04 02:21:08.031923 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:08.031873    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-ll6br"]
Nov 04 02:21:08.046422 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:08.046377    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zhf6\" (UniqueName: \"kubernetes.io/projected/b71cf041-25c1-4269-b62d-48aec85bf660-kube-api-access-2zhf6\") pod \"dns-operator-controller-manager-8557cbdb84-ll6br\" (UID: \"b71cf041-25c1-4269-b62d-48aec85bf660\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-ll6br"
Nov 04 02:21:08.147417 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:08.147363    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zhf6\" (UniqueName: \"kubernetes.io/projected/b71cf041-25c1-4269-b62d-48aec85bf660-kube-api-access-2zhf6\") pod \"dns-operator-controller-manager-8557cbdb84-ll6br\" (UID: \"b71cf041-25c1-4269-b62d-48aec85bf660\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-ll6br"
Nov 04 02:21:08.209967 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:08.209892    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zhf6\" (UniqueName: \"kubernetes.io/projected/b71cf041-25c1-4269-b62d-48aec85bf660-kube-api-access-2zhf6\") pod \"dns-operator-controller-manager-8557cbdb84-ll6br\" (UID: \"b71cf041-25c1-4269-b62d-48aec85bf660\") " pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-ll6br"
Nov 04 02:21:08.265380 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:08.265346    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-ll6br"
Nov 04 02:21:08.646601 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:08.646564    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-8557cbdb84-ll6br"]
Nov 04 02:21:08.680209 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:21:08.680147    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb71cf041_25c1_4269_b62d_48aec85bf660.slice/crio-1afa2a83603a373524f5d1ee9ff179b9f7f1b04ac692efadd43160839221eab9 WatchSource:0}: Error finding container 1afa2a83603a373524f5d1ee9ff179b9f7f1b04ac692efadd43160839221eab9: Status 404 returned error can't find the container with id 1afa2a83603a373524f5d1ee9ff179b9f7f1b04ac692efadd43160839221eab9
Nov 04 02:21:08.683038 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:08.683016    4548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 02:21:09.542157 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:09.542115    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-ll6br" event={"ID":"b71cf041-25c1-4269-b62d-48aec85bf660","Type":"ContainerStarted","Data":"1afa2a83603a373524f5d1ee9ff179b9f7f1b04ac692efadd43160839221eab9"}
Nov 04 02:21:10.548980 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:10.548940    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs" event={"ID":"372699d6-6393-42e2-a619-91b05010e006","Type":"ContainerStarted","Data":"5b31e78f5879aecedd06b5e511c0de66727fa0bb9826789c20a08c39f7f7a876"}
Nov 04 02:21:10.611198 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:21:10.611143    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:21:11.556476 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:11.556440    4548 generic.go:356] "Generic (PLEG): container finished" podID="372699d6-6393-42e2-a619-91b05010e006" containerID="5b31e78f5879aecedd06b5e511c0de66727fa0bb9826789c20a08c39f7f7a876" exitCode=0
Nov 04 02:21:11.556949 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:11.556526    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs" event={"ID":"372699d6-6393-42e2-a619-91b05010e006","Type":"ContainerDied","Data":"5b31e78f5879aecedd06b5e511c0de66727fa0bb9826789c20a08c39f7f7a876"}
Nov 04 02:21:12.563836 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:12.563797    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-ll6br" event={"ID":"b71cf041-25c1-4269-b62d-48aec85bf660","Type":"ContainerStarted","Data":"20d0de61c8caa037874fd9f2a8d7d6475b95998945d888b77799b0745240d710"}
Nov 04 02:21:12.564263 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:12.563865    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-ll6br"
Nov 04 02:21:12.681251 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:12.681198    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-ll6br" podStartSLOduration=2.308119258 podStartE2EDuration="5.681154516s" totalImagesPullingTime="3.373035258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:12.680665539 +0000 UTC m=+306.285678558" watchObservedRunningTime="2026-11-04 02:21:12.681154516 +0000 UTC m=+306.286167492"
Nov 04 02:21:13.570760 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:13.570722    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs" event={"ID":"372699d6-6393-42e2-a619-91b05010e006","Type":"ContainerStarted","Data":"c2b365219b05168fd9b4dc7f5dd90336b64355e48ca0f5acfedc7fb461262c92"}
Nov 04 02:21:13.571282 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:13.570902    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:13.810789 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:13.810708    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs" podStartSLOduration=3.229131666 podStartE2EDuration="8.810690408s" totalImagesPullingTime="5.161983522s" totalInitContainerRuntime="419.57522ms" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:05 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:13.760478741 +0000 UTC m=+307.365491738" watchObservedRunningTime="2026-11-04 02:21:13.810690408 +0000 UTC m=+307.415703400"
Nov 04 02:21:14.212620 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:14.212585    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq"]
Nov 04 02:21:14.216246 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:14.216227    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq"
Nov 04 02:21:14.276520 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:14.276483    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq"]
Nov 04 02:21:14.303634 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:14.303592    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-qtzcq\" (UID: \"7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq"
Nov 04 02:21:14.303789 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:14.303730    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2rfm\" (UniqueName: \"kubernetes.io/projected/7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d-kube-api-access-c2rfm\") pod \"kuadrant-operator-controller-manager-cf8469d7b-qtzcq\" (UID: \"7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq"
Nov 04 02:21:14.310908 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:14.310876    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-6hb5j\""
Nov 04 02:21:14.405012 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:14.404970    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2rfm\" (UniqueName: \"kubernetes.io/projected/7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d-kube-api-access-c2rfm\") pod \"kuadrant-operator-controller-manager-cf8469d7b-qtzcq\" (UID: \"7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq"
Nov 04 02:21:14.405284 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:14.405040    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-qtzcq\" (UID: \"7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq"
Nov 04 02:21:14.405483 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:14.405465    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-cf8469d7b-qtzcq\" (UID: \"7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq"
Nov 04 02:21:14.466635 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:14.466559    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2rfm\" (UniqueName: \"kubernetes.io/projected/7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d-kube-api-access-c2rfm\") pod \"kuadrant-operator-controller-manager-cf8469d7b-qtzcq\" (UID: \"7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq"
Nov 04 02:21:14.529886 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:14.529844    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq"
Nov 04 02:21:15.015365 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:15.015339    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq"]
Nov 04 02:21:15.017460 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:21:15.017430    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f450aa2_f3d5_4e6b_a0fe_6195665a6a4d.slice/crio-e902ee0d0b708174ffe3beaee09e91ec497ed530b94a436f02c2be223fffc623 WatchSource:0}: Error finding container e902ee0d0b708174ffe3beaee09e91ec497ed530b94a436f02c2be223fffc623: Status 404 returned error can't find the container with id e902ee0d0b708174ffe3beaee09e91ec497ed530b94a436f02c2be223fffc623
Nov 04 02:21:15.513815 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:15.513784    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-5778bb4449-b2r9v"
Nov 04 02:21:15.581883 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:15.581841    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq" event={"ID":"7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d","Type":"ContainerStarted","Data":"e902ee0d0b708174ffe3beaee09e91ec497ed530b94a436f02c2be223fffc623"}
Nov 04 02:21:18.536316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:18.536229    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-7b7bb4bc77-fswlr"
Nov 04 02:21:21.615444 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:21.615394    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq" event={"ID":"7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d","Type":"ContainerStarted","Data":"1075cfba41f6fbba31fc7db1d78ee3d83993fdf53626381734ca15a4e9c30132"}
Nov 04 02:21:21.615918 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:21.615489    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq"
Nov 04 02:21:21.816473 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:21.816408    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq" podStartSLOduration=1.3784439769999999 podStartE2EDuration="7.816393808s" totalImagesPullingTime="6.437949831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:21.814721619 +0000 UTC m=+315.419734618" watchObservedRunningTime="2026-11-04 02:21:21.816393808 +0000 UTC m=+315.421406806"
Nov 04 02:21:23.573534 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:23.573499    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-8557cbdb84-ll6br"
Nov 04 02:21:24.578726 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:24.578699    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-8bf8997fb-jckrs"
Nov 04 02:21:32.623286 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:32.623253    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq"
Nov 04 02:21:33.046462 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:33.046427    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-f9kjr"]
Nov 04 02:21:33.052722 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:33.052680    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-f9kjr"
Nov 04 02:21:33.114129 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:33.114091    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-f9kjr"]
Nov 04 02:21:33.176590 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:33.176554    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbjxr\" (UniqueName: \"kubernetes.io/projected/51a542d5-9e7d-43c6-894e-effabe622978-kube-api-access-lbjxr\") pod \"kuadrant-operator-controller-manager-678d87766f-f9kjr\" (UID: \"51a542d5-9e7d-43c6-894e-effabe622978\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-f9kjr"
Nov 04 02:21:33.176792 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:33.176610    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51a542d5-9e7d-43c6-894e-effabe622978-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-f9kjr\" (UID: \"51a542d5-9e7d-43c6-894e-effabe622978\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-f9kjr"
Nov 04 02:21:33.278115 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:33.278070    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbjxr\" (UniqueName: \"kubernetes.io/projected/51a542d5-9e7d-43c6-894e-effabe622978-kube-api-access-lbjxr\") pod \"kuadrant-operator-controller-manager-678d87766f-f9kjr\" (UID: \"51a542d5-9e7d-43c6-894e-effabe622978\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-f9kjr"
Nov 04 02:21:33.278307 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:33.278136    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51a542d5-9e7d-43c6-894e-effabe622978-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-f9kjr\" (UID: \"51a542d5-9e7d-43c6-894e-effabe622978\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-f9kjr"
Nov 04 02:21:33.278578 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:33.278552    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51a542d5-9e7d-43c6-894e-effabe622978-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-678d87766f-f9kjr\" (UID: \"51a542d5-9e7d-43c6-894e-effabe622978\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-f9kjr"
Nov 04 02:21:33.342389 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:33.342311    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbjxr\" (UniqueName: \"kubernetes.io/projected/51a542d5-9e7d-43c6-894e-effabe622978-kube-api-access-lbjxr\") pod \"kuadrant-operator-controller-manager-678d87766f-f9kjr\" (UID: \"51a542d5-9e7d-43c6-894e-effabe622978\") " pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-f9kjr"
Nov 04 02:21:33.367185 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:33.367132    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-f9kjr"
Nov 04 02:21:33.799610 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:33.799579    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-678d87766f-f9kjr"]
Nov 04 02:21:33.802787 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:21:33.802745    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a542d5_9e7d_43c6_894e_effabe622978.slice/crio-c370643852ace73840bdfc6bec000d8c4aee1a6eabb75a9b39d1f49cb1bea927 WatchSource:0}: Error finding container c370643852ace73840bdfc6bec000d8c4aee1a6eabb75a9b39d1f49cb1bea927: Status 404 returned error can't find the container with id c370643852ace73840bdfc6bec000d8c4aee1a6eabb75a9b39d1f49cb1bea927
Nov 04 02:21:34.680381 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:34.680339    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-f9kjr" event={"ID":"51a542d5-9e7d-43c6-894e-effabe622978","Type":"ContainerStarted","Data":"8b53d7ea88227dd691a661144b1e62ed255242e8f3adf9bfddd545614f3ccbad"}
Nov 04 02:21:34.680552 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:34.680407    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-f9kjr" event={"ID":"51a542d5-9e7d-43c6-894e-effabe622978","Type":"ContainerStarted","Data":"c370643852ace73840bdfc6bec000d8c4aee1a6eabb75a9b39d1f49cb1bea927"}
Nov 04 02:21:34.680552 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:34.680499    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-f9kjr"
Nov 04 02:21:34.852716 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:34.852659    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-f9kjr" podStartSLOduration=2.852645059 podStartE2EDuration="2.852645059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:34.85021459 +0000 UTC m=+328.455227586" watchObservedRunningTime="2026-11-04 02:21:34.852645059 +0000 UTC m=+328.457658056"
Nov 04 02:21:40.610313 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:21:40.610273    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:21:43.234390 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.234349    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"]
Nov 04 02:21:43.323779 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.323736    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.342271 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.342235    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"]
Nov 04 02:21:43.365050 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.365019    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51bb2c26-5dfb-442e-9653-ce7e01362efa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.365050 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.365055    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51bb2c26-5dfb-442e-9653-ce7e01362efa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.365370 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.365090    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5f4b2\" (UniqueName: \"kubernetes.io/projected/51bb2c26-5dfb-442e-9653-ce7e01362efa-kube-api-access-5f4b2\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.365370 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.365253    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51bb2c26-5dfb-442e-9653-ce7e01362efa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.365370 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.365313    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51bb2c26-5dfb-442e-9653-ce7e01362efa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.365370 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.365354    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51bb2c26-5dfb-442e-9653-ce7e01362efa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.365570 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.365386    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51bb2c26-5dfb-442e-9653-ce7e01362efa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.365570 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.365495    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51bb2c26-5dfb-442e-9653-ce7e01362efa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.365647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.365565    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51bb2c26-5dfb-442e-9653-ce7e01362efa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.389733 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.389700    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-r2n7x\""
Nov 04 02:21:43.466619 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.466584    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51bb2c26-5dfb-442e-9653-ce7e01362efa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.466786 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.466641    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51bb2c26-5dfb-442e-9653-ce7e01362efa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.466786 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.466664    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51bb2c26-5dfb-442e-9653-ce7e01362efa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.466786 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.466692    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5f4b2\" (UniqueName: \"kubernetes.io/projected/51bb2c26-5dfb-442e-9653-ce7e01362efa-kube-api-access-5f4b2\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.466786 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.466717    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51bb2c26-5dfb-442e-9653-ce7e01362efa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.466786 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.466744    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51bb2c26-5dfb-442e-9653-ce7e01362efa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.466786 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.466766    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51bb2c26-5dfb-442e-9653-ce7e01362efa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.467105 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.466793    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51bb2c26-5dfb-442e-9653-ce7e01362efa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.467226 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.467144    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51bb2c26-5dfb-442e-9653-ce7e01362efa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.467304 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.467264    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/51bb2c26-5dfb-442e-9653-ce7e01362efa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.467361 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.467303    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/51bb2c26-5dfb-442e-9653-ce7e01362efa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.467361 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.467320    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/51bb2c26-5dfb-442e-9653-ce7e01362efa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.467524 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.467501    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/51bb2c26-5dfb-442e-9653-ce7e01362efa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.467584 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.467568    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/51bb2c26-5dfb-442e-9653-ce7e01362efa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.469202 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.469161    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/51bb2c26-5dfb-442e-9653-ce7e01362efa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.469793 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.469769    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/51bb2c26-5dfb-442e-9653-ce7e01362efa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.528282 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.528252    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/51bb2c26-5dfb-442e-9653-ce7e01362efa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.528449 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.528382    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5f4b2\" (UniqueName: \"kubernetes.io/projected/51bb2c26-5dfb-442e-9653-ce7e01362efa-kube-api-access-5f4b2\") pod \"data-science-gateway-data-science-gateway-class-79f98cb86f2b78h\" (UID: \"51bb2c26-5dfb-442e-9653-ce7e01362efa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:43.649404 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:43.649360    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:44.110023 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:44.109988    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"]
Nov 04 02:21:44.112355 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:21:44.112316    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51bb2c26_5dfb_442e_9653_ce7e01362efa.slice/crio-fac4816f15b5758de4833529bcec01d4a36e5f39603669e69f775310de3ddcfb WatchSource:0}: Error finding container fac4816f15b5758de4833529bcec01d4a36e5f39603669e69f775310de3ddcfb: Status 404 returned error can't find the container with id fac4816f15b5758de4833529bcec01d4a36e5f39603669e69f775310de3ddcfb
Nov 04 02:21:44.114570 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:44.114521    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:21:44.114660 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:44.114626    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:21:44.114698 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:44.114673    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:21:44.739739 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:44.739706    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h" event={"ID":"51bb2c26-5dfb-442e-9653-ce7e01362efa","Type":"ContainerStarted","Data":"ea022c1f5191293f73f7aca83d2a292eccbdc2bfdd437aac896760114f002e61"}
Nov 04 02:21:44.740246 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:44.739756    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h" event={"ID":"51bb2c26-5dfb-442e-9653-ce7e01362efa","Type":"ContainerStarted","Data":"fac4816f15b5758de4833529bcec01d4a36e5f39603669e69f775310de3ddcfb"}
Nov 04 02:21:44.861499 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:44.861432    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h" podStartSLOduration=1.8614111819999999 podStartE2EDuration="1.861411182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:44.86054115 +0000 UTC m=+338.465554149" watchObservedRunningTime="2026-11-04 02:21:44.861411182 +0000 UTC m=+338.466424182"
Nov 04 02:21:45.650399 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:45.650354    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:45.656011 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:45.655978    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:45.690927 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:45.690895    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-678d87766f-f9kjr"
Nov 04 02:21:45.745433 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:45.745395    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:45.746401 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:45.746384    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-79f98cb86f2b78h"
Nov 04 02:21:45.987475 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:45.987349    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq"]
Nov 04 02:21:45.987668 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:45.987558    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq" podUID="7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d" containerName="manager" containerID="cri-o://1075cfba41f6fbba31fc7db1d78ee3d83993fdf53626381734ca15a4e9c30132" gracePeriod=10
Nov 04 02:21:46.297346 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:46.297290    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57f7f8659f-r9rw9"]
Nov 04 02:21:46.299681 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:46.299659    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-r9rw9"
Nov 04 02:21:46.352454 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:46.352409    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gsqs5\""
Nov 04 02:21:46.354824 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:46.354797    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-r9rw9"]
Nov 04 02:21:46.389912 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:46.389872    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k856n\" (UniqueName: \"kubernetes.io/projected/d9f4f1bc-7d56-427f-bad7-46e6050d37eb-kube-api-access-k856n\") pod \"authorino-57f7f8659f-r9rw9\" (UID: \"d9f4f1bc-7d56-427f-bad7-46e6050d37eb\") " pod="kuadrant-system/authorino-57f7f8659f-r9rw9"
Nov 04 02:21:46.490347 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:46.490303    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k856n\" (UniqueName: \"kubernetes.io/projected/d9f4f1bc-7d56-427f-bad7-46e6050d37eb-kube-api-access-k856n\") pod \"authorino-57f7f8659f-r9rw9\" (UID: \"d9f4f1bc-7d56-427f-bad7-46e6050d37eb\") " pod="kuadrant-system/authorino-57f7f8659f-r9rw9"
Nov 04 02:21:46.562112 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:46.562029    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k856n\" (UniqueName: \"kubernetes.io/projected/d9f4f1bc-7d56-427f-bad7-46e6050d37eb-kube-api-access-k856n\") pod \"authorino-57f7f8659f-r9rw9\" (UID: \"d9f4f1bc-7d56-427f-bad7-46e6050d37eb\") " pod="kuadrant-system/authorino-57f7f8659f-r9rw9"
Nov 04 02:21:46.624087 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:46.624043    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-r9rw9"
Nov 04 02:21:46.999793 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:46.999768    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-r9rw9"]
Nov 04 02:21:47.001863 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:21:47.001824    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd9f4f1bc_7d56_427f_bad7_46e6050d37eb.slice/crio-a472364c3ee1a7112a9e8a904bdd44a573880c550764d97363dd72cc4f6897bc WatchSource:0}: Error finding container a472364c3ee1a7112a9e8a904bdd44a573880c550764d97363dd72cc4f6897bc: Status 404 returned error can't find the container with id a472364c3ee1a7112a9e8a904bdd44a573880c550764d97363dd72cc4f6897bc
Nov 04 02:21:47.760162 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:47.760133    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq"
Nov 04 02:21:47.763254 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:47.763214    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-r9rw9" event={"ID":"d9f4f1bc-7d56-427f-bad7-46e6050d37eb","Type":"ContainerStarted","Data":"a472364c3ee1a7112a9e8a904bdd44a573880c550764d97363dd72cc4f6897bc"}
Nov 04 02:21:47.764759 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:47.764734    4548 generic.go:356] "Generic (PLEG): container finished" podID="7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d" containerID="1075cfba41f6fbba31fc7db1d78ee3d83993fdf53626381734ca15a4e9c30132" exitCode=0
Nov 04 02:21:47.764865 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:47.764778    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq"
Nov 04 02:21:47.764865 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:47.764817    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq" event={"ID":"7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d","Type":"ContainerDied","Data":"1075cfba41f6fbba31fc7db1d78ee3d83993fdf53626381734ca15a4e9c30132"}
Nov 04 02:21:47.764936 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:47.764888    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq" event={"ID":"7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d","Type":"ContainerDied","Data":"e902ee0d0b708174ffe3beaee09e91ec497ed530b94a436f02c2be223fffc623"}
Nov 04 02:21:47.764936 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:47.764910    4548 scope.go:122] "RemoveContainer" containerID="1075cfba41f6fbba31fc7db1d78ee3d83993fdf53626381734ca15a4e9c30132"
Nov 04 02:21:47.774406 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:47.774384    4548 scope.go:122] "RemoveContainer" containerID="1075cfba41f6fbba31fc7db1d78ee3d83993fdf53626381734ca15a4e9c30132"
Nov 04 02:21:47.774765 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:21:47.774744    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1075cfba41f6fbba31fc7db1d78ee3d83993fdf53626381734ca15a4e9c30132\": container with ID starting with 1075cfba41f6fbba31fc7db1d78ee3d83993fdf53626381734ca15a4e9c30132 not found: ID does not exist" containerID="1075cfba41f6fbba31fc7db1d78ee3d83993fdf53626381734ca15a4e9c30132"
Nov 04 02:21:47.774835 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:47.774781    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1075cfba41f6fbba31fc7db1d78ee3d83993fdf53626381734ca15a4e9c30132"} err="failed to get container status \"1075cfba41f6fbba31fc7db1d78ee3d83993fdf53626381734ca15a4e9c30132\": rpc error: code = NotFound desc = could not find container \"1075cfba41f6fbba31fc7db1d78ee3d83993fdf53626381734ca15a4e9c30132\": container with ID starting with 1075cfba41f6fbba31fc7db1d78ee3d83993fdf53626381734ca15a4e9c30132 not found: ID does not exist"
Nov 04 02:21:47.899254 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:47.899143    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d-kube-api-access-c2rfm\" (UniqueName: \"kubernetes.io/projected/7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d-kube-api-access-c2rfm\") pod \"7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d\" (UID: \"7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d\") "
Nov 04 02:21:47.899414 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:47.899295    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d-extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d-extensions-socket-volume\") pod \"7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d\" (UID: \"7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d\") "
Nov 04 02:21:47.899790 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:47.899762    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d-extensions-socket-volume" pod "7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d" (UID: "7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:21:47.901760 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:47.901738    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d-kube-api-access-c2rfm" pod "7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d" (UID: "7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d"). InnerVolumeSpecName "kube-api-access-c2rfm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:21:47.999907 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:47.999864    4548 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d-extensions-socket-volume\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:21:47.999907 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:47.999900    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2rfm\" (UniqueName: \"kubernetes.io/projected/7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d-kube-api-access-c2rfm\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:21:48.190424 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:48.190325    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq"]
Nov 04 02:21:48.194117 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:48.194088    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-cf8469d7b-qtzcq"]
Nov 04 02:21:48.523087 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:48.523060    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d" path="/var/lib/kubelet/pods/7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d/volumes"
Nov 04 02:21:51.514103 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.514007    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"]
Nov 04 02:21:51.514605 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.514530    4548 cpu_manager.go:414] "containerMap: removing container" podUID="7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d" containerName="manager"
Nov 04 02:21:51.514605 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.514548    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d" containerName="manager"
Nov 04 02:21:51.514710 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.514664    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="7f450aa2-f3d5-4e6b-a0fe-6195665a6a4d" containerName="manager"
Nov 04 02:21:51.517691 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.517667    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"
Nov 04 02:21:51.526569 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.526543    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29df2b43-9d59-46af-8e71-2c43e16a3b26-metrics-certs\") pod \"jobset-controller-manager-589bb644c6-flmh9\" (UID: \"29df2b43-9d59-46af-8e71-2c43e16a3b26\") " pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"
Nov 04 02:21:51.526702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.526594    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s8w4\" (UniqueName: \"kubernetes.io/projected/29df2b43-9d59-46af-8e71-2c43e16a3b26-kube-api-access-7s8w4\") pod \"jobset-controller-manager-589bb644c6-flmh9\" (UID: \"29df2b43-9d59-46af-8e71-2c43e16a3b26\") " pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"
Nov 04 02:21:51.526702 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.526691    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29df2b43-9d59-46af-8e71-2c43e16a3b26-cert\") pod \"jobset-controller-manager-589bb644c6-flmh9\" (UID: \"29df2b43-9d59-46af-8e71-2c43e16a3b26\") " pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"
Nov 04 02:21:51.526785 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.526734    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/29df2b43-9d59-46af-8e71-2c43e16a3b26-manager-config\") pod \"jobset-controller-manager-589bb644c6-flmh9\" (UID: \"29df2b43-9d59-46af-8e71-2c43e16a3b26\") " pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"
Nov 04 02:21:51.573293 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.573244    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"]
Nov 04 02:21:51.621190 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.621132    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Nov 04 02:21:51.621423 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.621393    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"jobset-manager-config\""
Nov 04 02:21:51.621423 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.621421    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"metrics-server-cert\""
Nov 04 02:21:51.621564 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.621416    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Nov 04 02:21:51.621564 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.621436    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-controller-manager-dockercfg-txqwr\""
Nov 04 02:21:51.621564 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.621488    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"webhook-server-cert\""
Nov 04 02:21:51.627224 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.627196    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29df2b43-9d59-46af-8e71-2c43e16a3b26-metrics-certs\") pod \"jobset-controller-manager-589bb644c6-flmh9\" (UID: \"29df2b43-9d59-46af-8e71-2c43e16a3b26\") " pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"
Nov 04 02:21:51.627397 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.627241    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s8w4\" (UniqueName: \"kubernetes.io/projected/29df2b43-9d59-46af-8e71-2c43e16a3b26-kube-api-access-7s8w4\") pod \"jobset-controller-manager-589bb644c6-flmh9\" (UID: \"29df2b43-9d59-46af-8e71-2c43e16a3b26\") " pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"
Nov 04 02:21:51.627397 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.627287    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29df2b43-9d59-46af-8e71-2c43e16a3b26-cert\") pod \"jobset-controller-manager-589bb644c6-flmh9\" (UID: \"29df2b43-9d59-46af-8e71-2c43e16a3b26\") " pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"
Nov 04 02:21:51.627397 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.627336    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/29df2b43-9d59-46af-8e71-2c43e16a3b26-manager-config\") pod \"jobset-controller-manager-589bb644c6-flmh9\" (UID: \"29df2b43-9d59-46af-8e71-2c43e16a3b26\") " pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"
Nov 04 02:21:51.628268 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.628236    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/29df2b43-9d59-46af-8e71-2c43e16a3b26-manager-config\") pod \"jobset-controller-manager-589bb644c6-flmh9\" (UID: \"29df2b43-9d59-46af-8e71-2c43e16a3b26\") " pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"
Nov 04 02:21:51.629957 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.629929    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/29df2b43-9d59-46af-8e71-2c43e16a3b26-cert\") pod \"jobset-controller-manager-589bb644c6-flmh9\" (UID: \"29df2b43-9d59-46af-8e71-2c43e16a3b26\") " pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"
Nov 04 02:21:51.630071 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.629989    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/29df2b43-9d59-46af-8e71-2c43e16a3b26-metrics-certs\") pod \"jobset-controller-manager-589bb644c6-flmh9\" (UID: \"29df2b43-9d59-46af-8e71-2c43e16a3b26\") " pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"
Nov 04 02:21:51.695799 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.695765    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s8w4\" (UniqueName: \"kubernetes.io/projected/29df2b43-9d59-46af-8e71-2c43e16a3b26-kube-api-access-7s8w4\") pod \"jobset-controller-manager-589bb644c6-flmh9\" (UID: \"29df2b43-9d59-46af-8e71-2c43e16a3b26\") " pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"
Nov 04 02:21:51.791807 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.791761    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-r9rw9" event={"ID":"d9f4f1bc-7d56-427f-bad7-46e6050d37eb","Type":"ContainerStarted","Data":"7c055fe24bb05a295c12342763f3031e9895afc73c046cd88f4303d93d429183"}
Nov 04 02:21:51.830334 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.830291    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"
Nov 04 02:21:51.907707 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:51.907502    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-57f7f8659f-r9rw9" podStartSLOduration=1.648182678 podStartE2EDuration="5.907487205s" totalImagesPullingTime="4.259304527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:51.907332715 +0000 UTC m=+345.512345714" watchObservedRunningTime="2026-11-04 02:21:51.907487205 +0000 UTC m=+345.512500202"
Nov 04 02:21:52.220023 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:52.219996    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"]
Nov 04 02:21:52.221846 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:21:52.221818    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29df2b43_9d59_46af_8e71_2c43e16a3b26.slice/crio-d1ce0bd5c5943e7638c293b066d0a47f94f8509183ead9e41518f896b1207ad7 WatchSource:0}: Error finding container d1ce0bd5c5943e7638c293b066d0a47f94f8509183ead9e41518f896b1207ad7: Status 404 returned error can't find the container with id d1ce0bd5c5943e7638c293b066d0a47f94f8509183ead9e41518f896b1207ad7
Nov 04 02:21:52.798558 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:52.798519    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9" event={"ID":"29df2b43-9d59-46af-8e71-2c43e16a3b26","Type":"ContainerStarted","Data":"d1ce0bd5c5943e7638c293b066d0a47f94f8509183ead9e41518f896b1207ad7"}
Nov 04 02:21:57.827535 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:57.827497    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9" event={"ID":"29df2b43-9d59-46af-8e71-2c43e16a3b26","Type":"ContainerStarted","Data":"701b86fc36172ec9c87369a7cf2f55a506a148e5f527ab3699abf47b246acb9e"}
Nov 04 02:21:57.827959 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:57.827704    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"
Nov 04 02:21:57.949159 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:21:57.949101    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9" podStartSLOduration=2.383304495 podStartE2EDuration="6.949082367s" totalImagesPullingTime="4.565777872s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:21:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:21:57.946766576 +0000 UTC m=+351.551779573" watchObservedRunningTime="2026-11-04 02:21:57.949082367 +0000 UTC m=+351.554095365"
Nov 04 02:22:08.838554 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:22:08.838518    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-jobset-operator/jobset-controller-manager-589bb644c6-flmh9"
Nov 04 02:22:10.610873 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:22:10.610834    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:22:13.237621 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:22:13.237576    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-r9rw9"]
Nov 04 02:22:13.238251 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:22:13.237855    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-57f7f8659f-r9rw9" podUID="d9f4f1bc-7d56-427f-bad7-46e6050d37eb" containerName="authorino" containerID="cri-o://7c055fe24bb05a295c12342763f3031e9895afc73c046cd88f4303d93d429183" gracePeriod=30
Nov 04 02:22:13.492850 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:22:13.492781    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-r9rw9"
Nov 04 02:22:13.608753 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:22:13.608716    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d9f4f1bc-7d56-427f-bad7-46e6050d37eb-kube-api-access-k856n\" (UniqueName: \"kubernetes.io/projected/d9f4f1bc-7d56-427f-bad7-46e6050d37eb-kube-api-access-k856n\") pod \"d9f4f1bc-7d56-427f-bad7-46e6050d37eb\" (UID: \"d9f4f1bc-7d56-427f-bad7-46e6050d37eb\") "
Nov 04 02:22:13.611347 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:22:13.611313    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9f4f1bc-7d56-427f-bad7-46e6050d37eb-kube-api-access-k856n" pod "d9f4f1bc-7d56-427f-bad7-46e6050d37eb" (UID: "d9f4f1bc-7d56-427f-bad7-46e6050d37eb"). InnerVolumeSpecName "kube-api-access-k856n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:22:13.709984 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:22:13.709940    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k856n\" (UniqueName: \"kubernetes.io/projected/d9f4f1bc-7d56-427f-bad7-46e6050d37eb-kube-api-access-k856n\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:22:13.922517 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:22:13.922473    4548 generic.go:356] "Generic (PLEG): container finished" podID="d9f4f1bc-7d56-427f-bad7-46e6050d37eb" containerID="7c055fe24bb05a295c12342763f3031e9895afc73c046cd88f4303d93d429183" exitCode=0
Nov 04 02:22:13.922517 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:22:13.922519    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57f7f8659f-r9rw9"
Nov 04 02:22:13.922769 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:22:13.922564    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-r9rw9" event={"ID":"d9f4f1bc-7d56-427f-bad7-46e6050d37eb","Type":"ContainerDied","Data":"7c055fe24bb05a295c12342763f3031e9895afc73c046cd88f4303d93d429183"}
Nov 04 02:22:13.922769 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:22:13.922605    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57f7f8659f-r9rw9" event={"ID":"d9f4f1bc-7d56-427f-bad7-46e6050d37eb","Type":"ContainerDied","Data":"a472364c3ee1a7112a9e8a904bdd44a573880c550764d97363dd72cc4f6897bc"}
Nov 04 02:22:13.922769 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:22:13.922622    4548 scope.go:122] "RemoveContainer" containerID="7c055fe24bb05a295c12342763f3031e9895afc73c046cd88f4303d93d429183"
Nov 04 02:22:13.932030 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:22:13.932012    4548 scope.go:122] "RemoveContainer" containerID="7c055fe24bb05a295c12342763f3031e9895afc73c046cd88f4303d93d429183"
Nov 04 02:22:13.932371 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:22:13.932347    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c055fe24bb05a295c12342763f3031e9895afc73c046cd88f4303d93d429183\": container with ID starting with 7c055fe24bb05a295c12342763f3031e9895afc73c046cd88f4303d93d429183 not found: ID does not exist" containerID="7c055fe24bb05a295c12342763f3031e9895afc73c046cd88f4303d93d429183"
Nov 04 02:22:13.932452 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:22:13.932387    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c055fe24bb05a295c12342763f3031e9895afc73c046cd88f4303d93d429183"} err="failed to get container status \"7c055fe24bb05a295c12342763f3031e9895afc73c046cd88f4303d93d429183\": rpc error: code = NotFound desc = could not find container \"7c055fe24bb05a295c12342763f3031e9895afc73c046cd88f4303d93d429183\": container with ID starting with 7c055fe24bb05a295c12342763f3031e9895afc73c046cd88f4303d93d429183 not found: ID does not exist"
Nov 04 02:22:14.087193 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:22:14.087134    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-r9rw9"]
Nov 04 02:22:14.090872 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:22:14.090842    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57f7f8659f-r9rw9"]
Nov 04 02:22:14.522578 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:22:14.522541    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d9f4f1bc-7d56-427f-bad7-46e6050d37eb" path="/var/lib/kubelet/pods/d9f4f1bc-7d56-427f-bad7-46e6050d37eb/volumes"
Nov 04 02:22:40.611070 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:22:40.611021    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:23:10.611301 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:23:10.611257    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:23:40.612111 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:23:40.612071    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:23:59.412995 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:23:59.412951    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-d7jz2"]
Nov 04 02:23:59.413493 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:23:59.413336    4548 cpu_manager.go:414] "containerMap: removing container" podUID="d9f4f1bc-7d56-427f-bad7-46e6050d37eb" containerName="authorino"
Nov 04 02:23:59.413493 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:23:59.413349    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d9f4f1bc-7d56-427f-bad7-46e6050d37eb" containerName="authorino"
Nov 04 02:23:59.413493 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:23:59.413419    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="d9f4f1bc-7d56-427f-bad7-46e6050d37eb" containerName="authorino"
Nov 04 02:23:59.416645 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:23:59.416620    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-d7jz2"
Nov 04 02:23:59.451572 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:23:59.451534    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjs9x\" (UniqueName: \"kubernetes.io/projected/5badb272-fa1d-4666-a45a-5e7d06575bf1-kube-api-access-fjs9x\") pod \"authorino-6f6944bcdd-d7jz2\" (UID: \"5badb272-fa1d-4666-a45a-5e7d06575bf1\") " pod="kuadrant-system/authorino-6f6944bcdd-d7jz2"
Nov 04 02:23:59.470366 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:23:59.470329    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-d7jz2"]
Nov 04 02:23:59.518064 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:23:59.518027    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gsqs5\""
Nov 04 02:23:59.552581 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:23:59.552533    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjs9x\" (UniqueName: \"kubernetes.io/projected/5badb272-fa1d-4666-a45a-5e7d06575bf1-kube-api-access-fjs9x\") pod \"authorino-6f6944bcdd-d7jz2\" (UID: \"5badb272-fa1d-4666-a45a-5e7d06575bf1\") " pod="kuadrant-system/authorino-6f6944bcdd-d7jz2"
Nov 04 02:23:59.616553 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:23:59.616517    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjs9x\" (UniqueName: \"kubernetes.io/projected/5badb272-fa1d-4666-a45a-5e7d06575bf1-kube-api-access-fjs9x\") pod \"authorino-6f6944bcdd-d7jz2\" (UID: \"5badb272-fa1d-4666-a45a-5e7d06575bf1\") " pod="kuadrant-system/authorino-6f6944bcdd-d7jz2"
Nov 04 02:23:59.742782 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:23:59.742683    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-d7jz2"
Nov 04 02:23:59.795949 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:23:59.795905    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-d7jz2"]
Nov 04 02:23:59.825330 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:23:59.823957    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5bb7848768-52mgq"]
Nov 04 02:23:59.827958 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:23:59.827926    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bb7848768-52mgq"
Nov 04 02:23:59.855685 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:23:59.855646    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mscrx\" (UniqueName: \"kubernetes.io/projected/226bdb70-0641-487e-950b-c84cc36b36a7-kube-api-access-mscrx\") pod \"authorino-5bb7848768-52mgq\" (UID: \"226bdb70-0641-487e-950b-c84cc36b36a7\") " pod="kuadrant-system/authorino-5bb7848768-52mgq"
Nov 04 02:23:59.883801 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:23:59.883771    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5bb7848768-52mgq"]
Nov 04 02:23:59.956524 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:23:59.956483    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mscrx\" (UniqueName: \"kubernetes.io/projected/226bdb70-0641-487e-950b-c84cc36b36a7-kube-api-access-mscrx\") pod \"authorino-5bb7848768-52mgq\" (UID: \"226bdb70-0641-487e-950b-c84cc36b36a7\") " pod="kuadrant-system/authorino-5bb7848768-52mgq"
Nov 04 02:24:00.018609 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:00.018533    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mscrx\" (UniqueName: \"kubernetes.io/projected/226bdb70-0641-487e-950b-c84cc36b36a7-kube-api-access-mscrx\") pod \"authorino-5bb7848768-52mgq\" (UID: \"226bdb70-0641-487e-950b-c84cc36b36a7\") " pod="kuadrant-system/authorino-5bb7848768-52mgq"
Nov 04 02:24:00.126068 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:00.126024    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-d7jz2"]
Nov 04 02:24:00.129069 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:24:00.129035    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5badb272_fa1d_4666_a45a_5e7d06575bf1.slice/crio-683c4128e7e43f82e68e943d05077a79899b532e78eb6a027ea9b9f0883a8ae0 WatchSource:0}: Error finding container 683c4128e7e43f82e68e943d05077a79899b532e78eb6a027ea9b9f0883a8ae0: Status 404 returned error can't find the container with id 683c4128e7e43f82e68e943d05077a79899b532e78eb6a027ea9b9f0883a8ae0
Nov 04 02:24:00.144359 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:00.144322    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bb7848768-52mgq"
Nov 04 02:24:00.453382 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:00.453346    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bb7848768-52mgq"]
Nov 04 02:24:00.473635 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:00.473597    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-d7jz2" event={"ID":"5badb272-fa1d-4666-a45a-5e7d06575bf1","Type":"ContainerStarted","Data":"683c4128e7e43f82e68e943d05077a79899b532e78eb6a027ea9b9f0883a8ae0"}
Nov 04 02:24:00.484308 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:00.484263    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7975ddd498-zgbbp"]
Nov 04 02:24:00.488135 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:00.488112    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7975ddd498-zgbbp"
Nov 04 02:24:00.529204 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:24:00.529148    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod226bdb70_0641_487e_950b_c84cc36b36a7.slice/crio-1aa7497121e919b7a782ecd7bf3b25650f12b60177753bbc09bba3ef745dc12a WatchSource:0}: Error finding container 1aa7497121e919b7a782ecd7bf3b25650f12b60177753bbc09bba3ef745dc12a: Status 404 returned error can't find the container with id 1aa7497121e919b7a782ecd7bf3b25650f12b60177753bbc09bba3ef745dc12a
Nov 04 02:24:00.530463 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:00.530432    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bb7848768-52mgq"]
Nov 04 02:24:00.541374 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:00.541343    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Nov 04 02:24:00.542760 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:00.542730    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7975ddd498-zgbbp"]
Nov 04 02:24:00.563111 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:00.563066    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45d6aaee-0636-4952-8ee6-7a189874a36a-tls-cert\") pod \"authorino-7975ddd498-zgbbp\" (UID: \"45d6aaee-0636-4952-8ee6-7a189874a36a\") " pod="kuadrant-system/authorino-7975ddd498-zgbbp"
Nov 04 02:24:00.563299 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:00.563118    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvzkq\" (UniqueName: \"kubernetes.io/projected/45d6aaee-0636-4952-8ee6-7a189874a36a-kube-api-access-dvzkq\") pod \"authorino-7975ddd498-zgbbp\" (UID: \"45d6aaee-0636-4952-8ee6-7a189874a36a\") " pod="kuadrant-system/authorino-7975ddd498-zgbbp"
Nov 04 02:24:00.664508 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:00.664462    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45d6aaee-0636-4952-8ee6-7a189874a36a-tls-cert\") pod \"authorino-7975ddd498-zgbbp\" (UID: \"45d6aaee-0636-4952-8ee6-7a189874a36a\") " pod="kuadrant-system/authorino-7975ddd498-zgbbp"
Nov 04 02:24:00.664508 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:00.664510    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvzkq\" (UniqueName: \"kubernetes.io/projected/45d6aaee-0636-4952-8ee6-7a189874a36a-kube-api-access-dvzkq\") pod \"authorino-7975ddd498-zgbbp\" (UID: \"45d6aaee-0636-4952-8ee6-7a189874a36a\") " pod="kuadrant-system/authorino-7975ddd498-zgbbp"
Nov 04 02:24:00.667245 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:00.667209    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45d6aaee-0636-4952-8ee6-7a189874a36a-tls-cert\") pod \"authorino-7975ddd498-zgbbp\" (UID: \"45d6aaee-0636-4952-8ee6-7a189874a36a\") " pod="kuadrant-system/authorino-7975ddd498-zgbbp"
Nov 04 02:24:00.726435 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:00.726358    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvzkq\" (UniqueName: \"kubernetes.io/projected/45d6aaee-0636-4952-8ee6-7a189874a36a-kube-api-access-dvzkq\") pod \"authorino-7975ddd498-zgbbp\" (UID: \"45d6aaee-0636-4952-8ee6-7a189874a36a\") " pod="kuadrant-system/authorino-7975ddd498-zgbbp"
Nov 04 02:24:00.801525 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:00.801483    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7975ddd498-zgbbp"
Nov 04 02:24:01.177477 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:01.177453    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7975ddd498-zgbbp"]
Nov 04 02:24:01.179554 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:24:01.179522    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45d6aaee_0636_4952_8ee6_7a189874a36a.slice/crio-61bd4cb1930b7dec14aed0bc1b356b4ce2bd1a4f6258b7959d76acd301861e1d WatchSource:0}: Error finding container 61bd4cb1930b7dec14aed0bc1b356b4ce2bd1a4f6258b7959d76acd301861e1d: Status 404 returned error can't find the container with id 61bd4cb1930b7dec14aed0bc1b356b4ce2bd1a4f6258b7959d76acd301861e1d
Nov 04 02:24:01.481673 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:01.481640    4548 generic.go:356] "Generic (PLEG): container finished" podID="3753909e-9a2a-4f55-978a-1974bfdbbbd1" containerID="46e98f05255e8e447e44341db26871348ce24229418d5442ec7e1be7446672c8" exitCode=0
Nov 04 02:24:01.482132 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:01.481716    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff" event={"ID":"3753909e-9a2a-4f55-978a-1974bfdbbbd1","Type":"ContainerDied","Data":"46e98f05255e8e447e44341db26871348ce24229418d5442ec7e1be7446672c8"}
Nov 04 02:24:01.482132 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:01.482106    4548 scope.go:122] "RemoveContainer" containerID="46e98f05255e8e447e44341db26871348ce24229418d5442ec7e1be7446672c8"
Nov 04 02:24:01.483153 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:01.483117    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bb7848768-52mgq" event={"ID":"226bdb70-0641-487e-950b-c84cc36b36a7","Type":"ContainerStarted","Data":"1aa7497121e919b7a782ecd7bf3b25650f12b60177753bbc09bba3ef745dc12a"}
Nov 04 02:24:01.483325 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:01.483296    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:24:01.483393 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:01.483373    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:24:01.483448 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:01.483422    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:24:01.484450 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:01.484430    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7975ddd498-zgbbp" event={"ID":"45d6aaee-0636-4952-8ee6-7a189874a36a","Type":"ContainerStarted","Data":"61bd4cb1930b7dec14aed0bc1b356b4ce2bd1a4f6258b7959d76acd301861e1d"}
Nov 04 02:24:02.492701 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:02.492668    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff" event={"ID":"3753909e-9a2a-4f55-978a-1974bfdbbbd1","Type":"ContainerStarted","Data":"5c7958995856cc8a861d84a971d7d0118eb9134d639c8895af2188749f8d9986"}
Nov 04 02:24:02.700185 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:02.700139    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:24:02.700394 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:02.700368    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-b8qff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Nov 04 02:24:02.700446 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:02.700420    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff" podUID="3753909e-9a2a-4f55-978a-1974bfdbbbd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Nov 04 02:24:03.699557 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:03.699517    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-b8qff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Nov 04 02:24:03.700074 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:03.699590    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff" podUID="3753909e-9a2a-4f55-978a-1974bfdbbbd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Nov 04 02:24:04.505873 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:04.505836    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bb7848768-52mgq" event={"ID":"226bdb70-0641-487e-950b-c84cc36b36a7","Type":"ContainerStarted","Data":"827a2be53bbe44ec3491617dd53abaeed6ee9093d2f14cc2a0f88a5bb1210ac5"}
Nov 04 02:24:04.506079 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:04.505867    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-5bb7848768-52mgq" podUID="226bdb70-0641-487e-950b-c84cc36b36a7" containerName="authorino" containerID="cri-o://827a2be53bbe44ec3491617dd53abaeed6ee9093d2f14cc2a0f88a5bb1210ac5" gracePeriod=30
Nov 04 02:24:04.508143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:04.508114    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7975ddd498-zgbbp" event={"ID":"45d6aaee-0636-4952-8ee6-7a189874a36a","Type":"ContainerStarted","Data":"faa73ee6d78073b0bca2a4abaa729267cc562ed326872081bf06631154841bf8"}
Nov 04 02:24:04.645766 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:04.645706    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-5bb7848768-52mgq" podStartSLOduration=2.619702369 podStartE2EDuration="5.645693256s" totalImagesPullingTime="3.025990887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:24:04.645348352 +0000 UTC m=+478.250361350" watchObservedRunningTime="2026-11-04 02:24:04.645693256 +0000 UTC m=+478.250706285"
Nov 04 02:24:04.701124 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:04.701084    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-b8qff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Nov 04 02:24:04.701680 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:04.701135    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff" podUID="3753909e-9a2a-4f55-978a-1974bfdbbbd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Nov 04 02:24:04.777202 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:04.776053    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-7975ddd498-zgbbp" podStartSLOduration=2.113176318 podStartE2EDuration="4.776033487s" totalImagesPullingTime="2.662857169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:24:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:24:04.772547637 +0000 UTC m=+478.377560636" watchObservedRunningTime="2026-11-04 02:24:04.776033487 +0000 UTC m=+478.381046489"
Nov 04 02:24:04.831841 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:04.831817    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bb7848768-52mgq"
Nov 04 02:24:04.906746 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:04.906707    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/226bdb70-0641-487e-950b-c84cc36b36a7-kube-api-access-mscrx\" (UniqueName: \"kubernetes.io/projected/226bdb70-0641-487e-950b-c84cc36b36a7-kube-api-access-mscrx\") pod \"226bdb70-0641-487e-950b-c84cc36b36a7\" (UID: \"226bdb70-0641-487e-950b-c84cc36b36a7\") "
Nov 04 02:24:04.909222 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:04.909187    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/226bdb70-0641-487e-950b-c84cc36b36a7-kube-api-access-mscrx" pod "226bdb70-0641-487e-950b-c84cc36b36a7" (UID: "226bdb70-0641-487e-950b-c84cc36b36a7"). InnerVolumeSpecName "kube-api-access-mscrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:24:05.007434 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:05.007392    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mscrx\" (UniqueName: \"kubernetes.io/projected/226bdb70-0641-487e-950b-c84cc36b36a7-kube-api-access-mscrx\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:24:05.515323 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:05.515275    4548 generic.go:356] "Generic (PLEG): container finished" podID="226bdb70-0641-487e-950b-c84cc36b36a7" containerID="827a2be53bbe44ec3491617dd53abaeed6ee9093d2f14cc2a0f88a5bb1210ac5" exitCode=0
Nov 04 02:24:05.515525 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:05.515338    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5bb7848768-52mgq"
Nov 04 02:24:05.515525 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:05.515361    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bb7848768-52mgq" event={"ID":"226bdb70-0641-487e-950b-c84cc36b36a7","Type":"ContainerDied","Data":"827a2be53bbe44ec3491617dd53abaeed6ee9093d2f14cc2a0f88a5bb1210ac5"}
Nov 04 02:24:05.515525 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:05.515417    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5bb7848768-52mgq" event={"ID":"226bdb70-0641-487e-950b-c84cc36b36a7","Type":"ContainerDied","Data":"1aa7497121e919b7a782ecd7bf3b25650f12b60177753bbc09bba3ef745dc12a"}
Nov 04 02:24:05.515525 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:05.515442    4548 scope.go:122] "RemoveContainer" containerID="827a2be53bbe44ec3491617dd53abaeed6ee9093d2f14cc2a0f88a5bb1210ac5"
Nov 04 02:24:05.524986 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:05.524963    4548 scope.go:122] "RemoveContainer" containerID="827a2be53bbe44ec3491617dd53abaeed6ee9093d2f14cc2a0f88a5bb1210ac5"
Nov 04 02:24:05.525368 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:24:05.525343    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"827a2be53bbe44ec3491617dd53abaeed6ee9093d2f14cc2a0f88a5bb1210ac5\": container with ID starting with 827a2be53bbe44ec3491617dd53abaeed6ee9093d2f14cc2a0f88a5bb1210ac5 not found: ID does not exist" containerID="827a2be53bbe44ec3491617dd53abaeed6ee9093d2f14cc2a0f88a5bb1210ac5"
Nov 04 02:24:05.525451 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:05.525385    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"827a2be53bbe44ec3491617dd53abaeed6ee9093d2f14cc2a0f88a5bb1210ac5"} err="failed to get container status \"827a2be53bbe44ec3491617dd53abaeed6ee9093d2f14cc2a0f88a5bb1210ac5\": rpc error: code = NotFound desc = could not find container \"827a2be53bbe44ec3491617dd53abaeed6ee9093d2f14cc2a0f88a5bb1210ac5\": container with ID starting with 827a2be53bbe44ec3491617dd53abaeed6ee9093d2f14cc2a0f88a5bb1210ac5 not found: ID does not exist"
Nov 04 02:24:05.694289 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:05.694255    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5bb7848768-52mgq"]
Nov 04 02:24:05.699768 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:05.699740    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-b8qff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Nov 04 02:24:05.699932 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:05.699796    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff" podUID="3753909e-9a2a-4f55-978a-1974bfdbbbd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Nov 04 02:24:05.701935 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:05.701906    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5bb7848768-52mgq"]
Nov 04 02:24:06.523525 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:06.523493    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="226bdb70-0641-487e-950b-c84cc36b36a7" path="/var/lib/kubelet/pods/226bdb70-0641-487e-950b-c84cc36b36a7/volumes"
Nov 04 02:24:06.699761 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:06.699724    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-b8qff container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused" start-of-body=
Nov 04 02:24:06.699953 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:06.699780    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff" podUID="3753909e-9a2a-4f55-978a-1974bfdbbbd1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.24:15021/healthz/ready\": dial tcp 10.133.0.24:15021: connect: connection refused"
Nov 04 02:24:07.703843 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:07.703814    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:24:07.704287 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:07.704153    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:24:07.704929 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:07.704911    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:24:08.546317 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:08.546282    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-d7jz2" event={"ID":"5badb272-fa1d-4666-a45a-5e7d06575bf1","Type":"ContainerStarted","Data":"d1038a0af370df2569a2145799df15780bbe886ec3fb13c3dc388d5eb89ba051"}
Nov 04 02:24:08.546514 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:08.546329    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-6f6944bcdd-d7jz2" podUID="5badb272-fa1d-4666-a45a-5e7d06575bf1" containerName="authorino" containerID="cri-o://d1038a0af370df2569a2145799df15780bbe886ec3fb13c3dc388d5eb89ba051" gracePeriod=30
Nov 04 02:24:08.663514 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:08.663449    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-6f6944bcdd-d7jz2" podStartSLOduration=2.15051701 podStartE2EDuration="9.663427097s" totalImagesPullingTime="7.512910087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:23:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:24:08.660302907 +0000 UTC m=+482.265315905" watchObservedRunningTime="2026-11-04 02:24:08.663427097 +0000 UTC m=+482.268440096"
Nov 04 02:24:08.807014 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:08.806947    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-d7jz2"
Nov 04 02:24:08.841054 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:08.841017    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5badb272-fa1d-4666-a45a-5e7d06575bf1-kube-api-access-fjs9x\" (UniqueName: \"kubernetes.io/projected/5badb272-fa1d-4666-a45a-5e7d06575bf1-kube-api-access-fjs9x\") pod \"5badb272-fa1d-4666-a45a-5e7d06575bf1\" (UID: \"5badb272-fa1d-4666-a45a-5e7d06575bf1\") "
Nov 04 02:24:08.843394 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:08.843367    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5badb272-fa1d-4666-a45a-5e7d06575bf1-kube-api-access-fjs9x" pod "5badb272-fa1d-4666-a45a-5e7d06575bf1" (UID: "5badb272-fa1d-4666-a45a-5e7d06575bf1"). InnerVolumeSpecName "kube-api-access-fjs9x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:24:08.942042 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:08.942004    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjs9x\" (UniqueName: \"kubernetes.io/projected/5badb272-fa1d-4666-a45a-5e7d06575bf1-kube-api-access-fjs9x\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:24:09.552859 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:09.552819    4548 generic.go:356] "Generic (PLEG): container finished" podID="5badb272-fa1d-4666-a45a-5e7d06575bf1" containerID="d1038a0af370df2569a2145799df15780bbe886ec3fb13c3dc388d5eb89ba051" exitCode=0
Nov 04 02:24:09.552859 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:09.552857    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6f6944bcdd-d7jz2"
Nov 04 02:24:09.553094 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:09.552889    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-d7jz2" event={"ID":"5badb272-fa1d-4666-a45a-5e7d06575bf1","Type":"ContainerDied","Data":"d1038a0af370df2569a2145799df15780bbe886ec3fb13c3dc388d5eb89ba051"}
Nov 04 02:24:09.553094 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:09.552919    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6f6944bcdd-d7jz2" event={"ID":"5badb272-fa1d-4666-a45a-5e7d06575bf1","Type":"ContainerDied","Data":"683c4128e7e43f82e68e943d05077a79899b532e78eb6a027ea9b9f0883a8ae0"}
Nov 04 02:24:09.553094 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:09.552935    4548 scope.go:122] "RemoveContainer" containerID="d1038a0af370df2569a2145799df15780bbe886ec3fb13c3dc388d5eb89ba051"
Nov 04 02:24:09.562823 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:09.562797    4548 scope.go:122] "RemoveContainer" containerID="d1038a0af370df2569a2145799df15780bbe886ec3fb13c3dc388d5eb89ba051"
Nov 04 02:24:09.563142 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:24:09.563122    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1038a0af370df2569a2145799df15780bbe886ec3fb13c3dc388d5eb89ba051\": container with ID starting with d1038a0af370df2569a2145799df15780bbe886ec3fb13c3dc388d5eb89ba051 not found: ID does not exist" containerID="d1038a0af370df2569a2145799df15780bbe886ec3fb13c3dc388d5eb89ba051"
Nov 04 02:24:09.563260 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:09.563157    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1038a0af370df2569a2145799df15780bbe886ec3fb13c3dc388d5eb89ba051"} err="failed to get container status \"d1038a0af370df2569a2145799df15780bbe886ec3fb13c3dc388d5eb89ba051\": rpc error: code = NotFound desc = could not find container \"d1038a0af370df2569a2145799df15780bbe886ec3fb13c3dc388d5eb89ba051\": container with ID starting with d1038a0af370df2569a2145799df15780bbe886ec3fb13c3dc388d5eb89ba051 not found: ID does not exist"
Nov 04 02:24:09.717264 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:09.717218    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-d7jz2"]
Nov 04 02:24:09.720078 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:09.720050    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6f6944bcdd-d7jz2"]
Nov 04 02:24:10.521867 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:24:10.521821    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5badb272-fa1d-4666-a45a-5e7d06575bf1" path="/var/lib/kubelet/pods/5badb272-fa1d-4666-a45a-5e7d06575bf1/volumes"
Nov 04 02:24:10.611624 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:24:10.611590    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:24:40.610616 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:24:40.610516    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:25:00.350648 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.350599    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-5gvws"]
Nov 04 02:25:00.351221 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.351112    4548 cpu_manager.go:414] "containerMap: removing container" podUID="226bdb70-0641-487e-950b-c84cc36b36a7" containerName="authorino"
Nov 04 02:25:00.351221 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.351131    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="226bdb70-0641-487e-950b-c84cc36b36a7" containerName="authorino"
Nov 04 02:25:00.351221 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.351154    4548 cpu_manager.go:414] "containerMap: removing container" podUID="5badb272-fa1d-4666-a45a-5e7d06575bf1" containerName="authorino"
Nov 04 02:25:00.351221 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.351161    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5badb272-fa1d-4666-a45a-5e7d06575bf1" containerName="authorino"
Nov 04 02:25:00.351442 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.351261    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="226bdb70-0641-487e-950b-c84cc36b36a7" containerName="authorino"
Nov 04 02:25:00.351442 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.351275    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="5badb272-fa1d-4666-a45a-5e7d06575bf1" containerName="authorino"
Nov 04 02:25:00.354398 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.354375    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-5gvws"
Nov 04 02:25:00.458004 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.457959    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Nov 04 02:25:00.458004 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.457982    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Nov 04 02:25:00.458320 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.458052    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Nov 04 02:25:00.458320 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.458119    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\""
Nov 04 02:25:00.458320 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.458214    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-2h452\""
Nov 04 02:25:00.460341 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.460315    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-5gvws"]
Nov 04 02:25:00.501998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.501953    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwmwd\" (UniqueName: \"kubernetes.io/projected/aeba4f48-4497-4e02-9383-27f0aad262c9-kube-api-access-fwmwd\") pod \"ai-gateway-controller-5d8dddb676-5gvws\" (UID: \"aeba4f48-4497-4e02-9383-27f0aad262c9\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-5gvws"
Nov 04 02:25:00.501998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.502011    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeba4f48-4497-4e02-9383-27f0aad262c9-metrics-certs\") pod \"ai-gateway-controller-5d8dddb676-5gvws\" (UID: \"aeba4f48-4497-4e02-9383-27f0aad262c9\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-5gvws"
Nov 04 02:25:00.602820 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.602713    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeba4f48-4497-4e02-9383-27f0aad262c9-metrics-certs\") pod \"ai-gateway-controller-5d8dddb676-5gvws\" (UID: \"aeba4f48-4497-4e02-9383-27f0aad262c9\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-5gvws"
Nov 04 02:25:00.602820 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.602805    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fwmwd\" (UniqueName: \"kubernetes.io/projected/aeba4f48-4497-4e02-9383-27f0aad262c9-kube-api-access-fwmwd\") pod \"ai-gateway-controller-5d8dddb676-5gvws\" (UID: \"aeba4f48-4497-4e02-9383-27f0aad262c9\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-5gvws"
Nov 04 02:25:00.605662 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.605629    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeba4f48-4497-4e02-9383-27f0aad262c9-metrics-certs\") pod \"ai-gateway-controller-5d8dddb676-5gvws\" (UID: \"aeba4f48-4497-4e02-9383-27f0aad262c9\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-5gvws"
Nov 04 02:25:00.665072 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.665027    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwmwd\" (UniqueName: \"kubernetes.io/projected/aeba4f48-4497-4e02-9383-27f0aad262c9-kube-api-access-fwmwd\") pod \"ai-gateway-controller-5d8dddb676-5gvws\" (UID: \"aeba4f48-4497-4e02-9383-27f0aad262c9\") " pod="opendatahub/ai-gateway-controller-5d8dddb676-5gvws"
Nov 04 02:25:00.668321 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:00.668295    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-5gvws"
Nov 04 02:25:01.047719 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:01.047691    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-5gvws"]
Nov 04 02:25:01.050073 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:25:01.050038    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeba4f48_4497_4e02_9383_27f0aad262c9.slice/crio-19f74b8fa34a20d8ee4cf5c009d6a568b67e1728d2b9812cd290a587b4df8f6f WatchSource:0}: Error finding container 19f74b8fa34a20d8ee4cf5c009d6a568b67e1728d2b9812cd290a587b4df8f6f: Status 404 returned error can't find the container with id 19f74b8fa34a20d8ee4cf5c009d6a568b67e1728d2b9812cd290a587b4df8f6f
Nov 04 02:25:01.825419 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:01.825382    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-5gvws" event={"ID":"aeba4f48-4497-4e02-9383-27f0aad262c9","Type":"ContainerStarted","Data":"19f74b8fa34a20d8ee4cf5c009d6a568b67e1728d2b9812cd290a587b4df8f6f"}
Nov 04 02:25:04.847077 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:04.847041    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-5gvws" event={"ID":"aeba4f48-4497-4e02-9383-27f0aad262c9","Type":"ContainerStarted","Data":"09e72a8641fe10805afab7295b6fbb34aa3746cfac74ce37c63c96a9ae352f74"}
Nov 04 02:25:04.847500 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:04.847136    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-5d8dddb676-5gvws"
Nov 04 02:25:04.964124 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:04.964069    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-5d8dddb676-5gvws" podStartSLOduration=1.634195424 podStartE2EDuration="4.96405355s" totalImagesPullingTime="3.329858126s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:25:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:25:04.963399445 +0000 UTC m=+538.568412447" watchObservedRunningTime="2026-11-04 02:25:04.96405355 +0000 UTC m=+538.569066863"
Nov 04 02:25:10.610043 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:25:10.610002    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:25:15.855343 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:15.855310    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-5d8dddb676-5gvws"
Nov 04 02:25:16.246186 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:16.246083    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-f6fb8bb7-gkb7n"]
Nov 04 02:25:16.251000 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:16.250980    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-f6fb8bb7-gkb7n"
Nov 04 02:25:16.306132 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:16.306099    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-f6fb8bb7-gkb7n"]
Nov 04 02:25:16.342957 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:16.342909    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnpdc\" (UniqueName: \"kubernetes.io/projected/c75bb18b-ba06-4a79-9839-e2ac02ef62d1-kube-api-access-wnpdc\") pod \"ai-gateway-controller-f6fb8bb7-gkb7n\" (UID: \"c75bb18b-ba06-4a79-9839-e2ac02ef62d1\") " pod="opendatahub/ai-gateway-controller-f6fb8bb7-gkb7n"
Nov 04 02:25:16.343161 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:16.342977    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c75bb18b-ba06-4a79-9839-e2ac02ef62d1-metrics-certs\") pod \"ai-gateway-controller-f6fb8bb7-gkb7n\" (UID: \"c75bb18b-ba06-4a79-9839-e2ac02ef62d1\") " pod="opendatahub/ai-gateway-controller-f6fb8bb7-gkb7n"
Nov 04 02:25:16.443534 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:16.443492    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c75bb18b-ba06-4a79-9839-e2ac02ef62d1-metrics-certs\") pod \"ai-gateway-controller-f6fb8bb7-gkb7n\" (UID: \"c75bb18b-ba06-4a79-9839-e2ac02ef62d1\") " pod="opendatahub/ai-gateway-controller-f6fb8bb7-gkb7n"
Nov 04 02:25:16.443747 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:16.443595    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnpdc\" (UniqueName: \"kubernetes.io/projected/c75bb18b-ba06-4a79-9839-e2ac02ef62d1-kube-api-access-wnpdc\") pod \"ai-gateway-controller-f6fb8bb7-gkb7n\" (UID: \"c75bb18b-ba06-4a79-9839-e2ac02ef62d1\") " pod="opendatahub/ai-gateway-controller-f6fb8bb7-gkb7n"
Nov 04 02:25:16.446191 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:16.446148    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c75bb18b-ba06-4a79-9839-e2ac02ef62d1-metrics-certs\") pod \"ai-gateway-controller-f6fb8bb7-gkb7n\" (UID: \"c75bb18b-ba06-4a79-9839-e2ac02ef62d1\") " pod="opendatahub/ai-gateway-controller-f6fb8bb7-gkb7n"
Nov 04 02:25:16.505825 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:16.505744    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnpdc\" (UniqueName: \"kubernetes.io/projected/c75bb18b-ba06-4a79-9839-e2ac02ef62d1-kube-api-access-wnpdc\") pod \"ai-gateway-controller-f6fb8bb7-gkb7n\" (UID: \"c75bb18b-ba06-4a79-9839-e2ac02ef62d1\") " pod="opendatahub/ai-gateway-controller-f6fb8bb7-gkb7n"
Nov 04 02:25:16.564287 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:16.564251    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-f6fb8bb7-gkb7n"
Nov 04 02:25:16.941512 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:16.941484    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-f6fb8bb7-gkb7n"]
Nov 04 02:25:16.943867 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:25:16.943837    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc75bb18b_ba06_4a79_9839_e2ac02ef62d1.slice/crio-cf9ea334936bc005edcdcead92554f0346f0a3d6cb0b541b068777f2605aaf6e WatchSource:0}: Error finding container cf9ea334936bc005edcdcead92554f0346f0a3d6cb0b541b068777f2605aaf6e: Status 404 returned error can't find the container with id cf9ea334936bc005edcdcead92554f0346f0a3d6cb0b541b068777f2605aaf6e
Nov 04 02:25:17.917089 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:17.917055    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-f6fb8bb7-gkb7n" event={"ID":"c75bb18b-ba06-4a79-9839-e2ac02ef62d1","Type":"ContainerStarted","Data":"cf9ea334936bc005edcdcead92554f0346f0a3d6cb0b541b068777f2605aaf6e"}
Nov 04 02:25:18.924003 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:18.923951    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-f6fb8bb7-gkb7n" event={"ID":"c75bb18b-ba06-4a79-9839-e2ac02ef62d1","Type":"ContainerStarted","Data":"4d3da21719dffd294205c5e8759c4d17dd7828f91f28cb60661cc7a22decabab"}
Nov 04 02:25:18.924478 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:18.924082    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-f6fb8bb7-gkb7n"
Nov 04 02:25:19.042126 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:19.042073    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-f6fb8bb7-gkb7n" podStartSLOduration=2.116389423 podStartE2EDuration="3.042058792s" totalImagesPullingTime="925.669369ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:25:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:25:19.041294787 +0000 UTC m=+552.646307767" watchObservedRunningTime="2026-11-04 02:25:19.042058792 +0000 UTC m=+552.647071844"
Nov 04 02:25:29.931263 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:29.931229    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-f6fb8bb7-gkb7n"
Nov 04 02:25:30.101525 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:30.101493    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-5gvws"]
Nov 04 02:25:30.101743 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:30.101719    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-5d8dddb676-5gvws" podUID="aeba4f48-4497-4e02-9383-27f0aad262c9" containerName="manager" containerID="cri-o://09e72a8641fe10805afab7295b6fbb34aa3746cfac74ce37c63c96a9ae352f74" gracePeriod=30
Nov 04 02:25:30.358794 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:30.358761    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-5gvws"
Nov 04 02:25:30.470146 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:30.470110    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/aeba4f48-4497-4e02-9383-27f0aad262c9-kube-api-access-fwmwd\" (UniqueName: \"kubernetes.io/projected/aeba4f48-4497-4e02-9383-27f0aad262c9-kube-api-access-fwmwd\") pod \"aeba4f48-4497-4e02-9383-27f0aad262c9\" (UID: \"aeba4f48-4497-4e02-9383-27f0aad262c9\") "
Nov 04 02:25:30.470332 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:30.470277    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/aeba4f48-4497-4e02-9383-27f0aad262c9-metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeba4f48-4497-4e02-9383-27f0aad262c9-metrics-certs\") pod \"aeba4f48-4497-4e02-9383-27f0aad262c9\" (UID: \"aeba4f48-4497-4e02-9383-27f0aad262c9\") "
Nov 04 02:25:30.472672 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:30.472604    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aeba4f48-4497-4e02-9383-27f0aad262c9-kube-api-access-fwmwd" pod "aeba4f48-4497-4e02-9383-27f0aad262c9" (UID: "aeba4f48-4497-4e02-9383-27f0aad262c9"). InnerVolumeSpecName "kube-api-access-fwmwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:25:30.472795 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:30.472756    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aeba4f48-4497-4e02-9383-27f0aad262c9-metrics-certs" pod "aeba4f48-4497-4e02-9383-27f0aad262c9" (UID: "aeba4f48-4497-4e02-9383-27f0aad262c9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:25:30.571464 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:30.571419    4548 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/aeba4f48-4497-4e02-9383-27f0aad262c9-metrics-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:25:30.571464 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:30.571453    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fwmwd\" (UniqueName: \"kubernetes.io/projected/aeba4f48-4497-4e02-9383-27f0aad262c9-kube-api-access-fwmwd\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:25:30.994898 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:30.994859    4548 generic.go:356] "Generic (PLEG): container finished" podID="aeba4f48-4497-4e02-9383-27f0aad262c9" containerID="09e72a8641fe10805afab7295b6fbb34aa3746cfac74ce37c63c96a9ae352f74" exitCode=0
Nov 04 02:25:30.995448 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:30.994906    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-5d8dddb676-5gvws"
Nov 04 02:25:30.995448 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:30.994950    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-5gvws" event={"ID":"aeba4f48-4497-4e02-9383-27f0aad262c9","Type":"ContainerDied","Data":"09e72a8641fe10805afab7295b6fbb34aa3746cfac74ce37c63c96a9ae352f74"}
Nov 04 02:25:30.995448 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:30.995010    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-5d8dddb676-5gvws" event={"ID":"aeba4f48-4497-4e02-9383-27f0aad262c9","Type":"ContainerDied","Data":"19f74b8fa34a20d8ee4cf5c009d6a568b67e1728d2b9812cd290a587b4df8f6f"}
Nov 04 02:25:30.995448 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:30.995043    4548 scope.go:122] "RemoveContainer" containerID="09e72a8641fe10805afab7295b6fbb34aa3746cfac74ce37c63c96a9ae352f74"
Nov 04 02:25:31.004707 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:31.004687    4548 scope.go:122] "RemoveContainer" containerID="09e72a8641fe10805afab7295b6fbb34aa3746cfac74ce37c63c96a9ae352f74"
Nov 04 02:25:31.005031 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:25:31.005011    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09e72a8641fe10805afab7295b6fbb34aa3746cfac74ce37c63c96a9ae352f74\": container with ID starting with 09e72a8641fe10805afab7295b6fbb34aa3746cfac74ce37c63c96a9ae352f74 not found: ID does not exist" containerID="09e72a8641fe10805afab7295b6fbb34aa3746cfac74ce37c63c96a9ae352f74"
Nov 04 02:25:31.005069 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:31.005043    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09e72a8641fe10805afab7295b6fbb34aa3746cfac74ce37c63c96a9ae352f74"} err="failed to get container status \"09e72a8641fe10805afab7295b6fbb34aa3746cfac74ce37c63c96a9ae352f74\": rpc error: code = NotFound desc = could not find container \"09e72a8641fe10805afab7295b6fbb34aa3746cfac74ce37c63c96a9ae352f74\": container with ID starting with 09e72a8641fe10805afab7295b6fbb34aa3746cfac74ce37c63c96a9ae352f74 not found: ID does not exist"
Nov 04 02:25:31.161315 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:31.161267    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-5gvws"]
Nov 04 02:25:31.211391 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:31.211352    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-5d8dddb676-5gvws"]
Nov 04 02:25:32.523000 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:32.522967    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="aeba4f48-4497-4e02-9383-27f0aad262c9" path="/var/lib/kubelet/pods/aeba4f48-4497-4e02-9383-27f0aad262c9/volumes"
Nov 04 02:25:40.610839 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:25:40.610798    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:25:40.684099 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.684060    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"]
Nov 04 02:25:40.684441 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.684428    4548 cpu_manager.go:414] "containerMap: removing container" podUID="aeba4f48-4497-4e02-9383-27f0aad262c9" containerName="manager"
Nov 04 02:25:40.684491 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.684443    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="aeba4f48-4497-4e02-9383-27f0aad262c9" containerName="manager"
Nov 04 02:25:40.684556 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.684546    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="aeba4f48-4497-4e02-9383-27f0aad262c9" containerName="manager"
Nov 04 02:25:40.693092 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.693064    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:40.743902 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.743868    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"]
Nov 04 02:25:40.771016 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.770981    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Nov 04 02:25:40.791315 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.791277    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Nov 04 02:25:40.791315 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.791292    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-nvkrm\""
Nov 04 02:25:40.795792 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.795767    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Nov 04 02:25:40.875985 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.875897    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4175a613-1eb4-468b-b609-e32980da64dc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc\" (UID: \"4175a613-1eb4-468b-b609-e32980da64dc\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:40.875985 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.875944    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4175a613-1eb4-468b-b609-e32980da64dc-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc\" (UID: \"4175a613-1eb4-468b-b609-e32980da64dc\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:40.875985 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.875971    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hz2k\" (UniqueName: \"kubernetes.io/projected/4175a613-1eb4-468b-b609-e32980da64dc-kube-api-access-7hz2k\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc\" (UID: \"4175a613-1eb4-468b-b609-e32980da64dc\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:40.876231 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.876094    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4175a613-1eb4-468b-b609-e32980da64dc-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc\" (UID: \"4175a613-1eb4-468b-b609-e32980da64dc\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:40.876231 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.876113    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4175a613-1eb4-468b-b609-e32980da64dc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc\" (UID: \"4175a613-1eb4-468b-b609-e32980da64dc\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:40.876231 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.876152    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4175a613-1eb4-468b-b609-e32980da64dc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc\" (UID: \"4175a613-1eb4-468b-b609-e32980da64dc\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:40.977133 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.977096    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4175a613-1eb4-468b-b609-e32980da64dc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc\" (UID: \"4175a613-1eb4-468b-b609-e32980da64dc\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:40.977367 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.977152    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4175a613-1eb4-468b-b609-e32980da64dc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc\" (UID: \"4175a613-1eb4-468b-b609-e32980da64dc\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:40.977367 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.977194    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4175a613-1eb4-468b-b609-e32980da64dc-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc\" (UID: \"4175a613-1eb4-468b-b609-e32980da64dc\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:40.977367 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.977221    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hz2k\" (UniqueName: \"kubernetes.io/projected/4175a613-1eb4-468b-b609-e32980da64dc-kube-api-access-7hz2k\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc\" (UID: \"4175a613-1eb4-468b-b609-e32980da64dc\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:40.977367 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.977245    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4175a613-1eb4-468b-b609-e32980da64dc-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc\" (UID: \"4175a613-1eb4-468b-b609-e32980da64dc\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:40.977367 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.977260    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4175a613-1eb4-468b-b609-e32980da64dc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc\" (UID: \"4175a613-1eb4-468b-b609-e32980da64dc\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:40.977640 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.977624    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4175a613-1eb4-468b-b609-e32980da64dc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc\" (UID: \"4175a613-1eb4-468b-b609-e32980da64dc\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:40.977703 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.977653    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4175a613-1eb4-468b-b609-e32980da64dc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc\" (UID: \"4175a613-1eb4-468b-b609-e32980da64dc\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:40.977749 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.977718    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4175a613-1eb4-468b-b609-e32980da64dc-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc\" (UID: \"4175a613-1eb4-468b-b609-e32980da64dc\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:40.979823 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.979796    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4175a613-1eb4-468b-b609-e32980da64dc-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc\" (UID: \"4175a613-1eb4-468b-b609-e32980da64dc\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:40.980084 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:40.980065    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4175a613-1eb4-468b-b609-e32980da64dc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc\" (UID: \"4175a613-1eb4-468b-b609-e32980da64dc\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:41.043708 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:41.043465    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hz2k\" (UniqueName: \"kubernetes.io/projected/4175a613-1eb4-468b-b609-e32980da64dc-kube-api-access-7hz2k\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc\" (UID: \"4175a613-1eb4-468b-b609-e32980da64dc\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:41.307349 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:41.307303    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:41.687430 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:41.687394    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"]
Nov 04 02:25:41.689521 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:25:41.689490    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4175a613_1eb4_468b_b609_e32980da64dc.slice/crio-f42b2e45f7654eed71bed035d531f64f182678fe666fc1066dc56c0843ccec28 WatchSource:0}: Error finding container f42b2e45f7654eed71bed035d531f64f182678fe666fc1066dc56c0843ccec28: Status 404 returned error can't find the container with id f42b2e45f7654eed71bed035d531f64f182678fe666fc1066dc56c0843ccec28
Nov 04 02:25:42.056201 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:42.056152    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc" event={"ID":"4175a613-1eb4-468b-b609-e32980da64dc","Type":"ContainerStarted","Data":"f42b2e45f7654eed71bed035d531f64f182678fe666fc1066dc56c0843ccec28"}
Nov 04 02:25:45.073151 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:45.073116    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc" event={"ID":"4175a613-1eb4-468b-b609-e32980da64dc","Type":"ContainerStarted","Data":"823d01f53ee16796dbb2ac2a328d3f1615e4bb9bfbba247dcba6a2be65599b8a"}
Nov 04 02:25:45.193141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:45.193088    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc" podStartSLOduration=2.9040618350000003 podStartE2EDuration="5.193073132s" totalImagesPullingTime="2.289011297s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:25:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:25:45.191049768 +0000 UTC m=+578.796062765" watchObservedRunningTime="2026-11-04 02:25:45.193073132 +0000 UTC m=+578.798086130"
Nov 04 02:25:45.307530 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:45.307495    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:50.347003 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.346857    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"]
Nov 04 02:25:50.351499 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.351470    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.353740 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.353693    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rgrc\" (UniqueName: \"kubernetes.io/projected/1e43f9ba-e833-466b-bc3e-c2e9792a7fd0-kube-api-access-8rgrc\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fcdkx\" (UID: \"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.353887 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.353845    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e43f9ba-e833-466b-bc3e-c2e9792a7fd0-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fcdkx\" (UID: \"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.353945 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.353909    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e43f9ba-e833-466b-bc3e-c2e9792a7fd0-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fcdkx\" (UID: \"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.354004 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.353943    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e43f9ba-e833-466b-bc3e-c2e9792a7fd0-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fcdkx\" (UID: \"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.354068 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.354046    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e43f9ba-e833-466b-bc3e-c2e9792a7fd0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fcdkx\" (UID: \"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.354125 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.354103    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e43f9ba-e833-466b-bc3e-c2e9792a7fd0-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fcdkx\" (UID: \"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.415471 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.415408    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"]
Nov 04 02:25:50.453248 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.453213    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Nov 04 02:25:50.455505 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.455472    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e43f9ba-e833-466b-bc3e-c2e9792a7fd0-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fcdkx\" (UID: \"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.455678 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.455526    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e43f9ba-e833-466b-bc3e-c2e9792a7fd0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fcdkx\" (UID: \"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.455678 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.455561    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e43f9ba-e833-466b-bc3e-c2e9792a7fd0-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fcdkx\" (UID: \"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.455678 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.455584    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rgrc\" (UniqueName: \"kubernetes.io/projected/1e43f9ba-e833-466b-bc3e-c2e9792a7fd0-kube-api-access-8rgrc\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fcdkx\" (UID: \"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.455678 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.455658    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e43f9ba-e833-466b-bc3e-c2e9792a7fd0-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fcdkx\" (UID: \"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.455900 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.455682    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e43f9ba-e833-466b-bc3e-c2e9792a7fd0-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fcdkx\" (UID: \"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.456022 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.455995    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1e43f9ba-e833-466b-bc3e-c2e9792a7fd0-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fcdkx\" (UID: \"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.456270 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.456249    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1e43f9ba-e833-466b-bc3e-c2e9792a7fd0-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fcdkx\" (UID: \"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.456453 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.456431    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1e43f9ba-e833-466b-bc3e-c2e9792a7fd0-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fcdkx\" (UID: \"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.458584 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.458562    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1e43f9ba-e833-466b-bc3e-c2e9792a7fd0-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fcdkx\" (UID: \"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.459142 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.459118    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1e43f9ba-e833-466b-bc3e-c2e9792a7fd0-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fcdkx\" (UID: \"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.522029 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.521972    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rgrc\" (UniqueName: \"kubernetes.io/projected/1e43f9ba-e833-466b-bc3e-c2e9792a7fd0-kube-api-access-8rgrc\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-fcdkx\" (UID: \"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:50.668937 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:50.668836    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:51.068237 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:51.068203    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"]
Nov 04 02:25:51.070117 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:25:51.070081    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e43f9ba_e833_466b_bc3e_c2e9792a7fd0.slice/crio-ee7da5914787af9770ed2f3d5c1f35491c8c54b691389ba55905fc2c4c5000da WatchSource:0}: Error finding container ee7da5914787af9770ed2f3d5c1f35491c8c54b691389ba55905fc2c4c5000da: Status 404 returned error can't find the container with id ee7da5914787af9770ed2f3d5c1f35491c8c54b691389ba55905fc2c4c5000da
Nov 04 02:25:51.105032 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:51.104991    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx" event={"ID":"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0","Type":"ContainerStarted","Data":"ee7da5914787af9770ed2f3d5c1f35491c8c54b691389ba55905fc2c4c5000da"}
Nov 04 02:25:51.307657 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:51.307621    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:51.320672 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:51.320582    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:52.112158 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:52.112122    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx" event={"ID":"1e43f9ba-e833-466b-bc3e-c2e9792a7fd0","Type":"ContainerStarted","Data":"610b239d360b6718d392513ff033872dcdd20e5c78a3c60b682ab7adcfe7b992"}
Nov 04 02:25:52.123829 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:52.123797    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc"
Nov 04 02:25:52.231461 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:52.231402    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx" podStartSLOduration=1.658057192 podStartE2EDuration="2.231386382s" totalImagesPullingTime="573.32919ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:25:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:25:52.229696415 +0000 UTC m=+585.834709410" watchObservedRunningTime="2026-11-04 02:25:52.231386382 +0000 UTC m=+585.836399383"
Nov 04 02:25:52.669623 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:52.669554    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:25:54.155057 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.155015    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"]
Nov 04 02:25:54.159164 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.159139    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.188887 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.188843    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6jh5\" (UniqueName: \"kubernetes.io/projected/a0e47877-89f0-49db-a246-af40154deacc-kube-api-access-j6jh5\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rtvdm\" (UID: \"a0e47877-89f0-49db-a246-af40154deacc\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.189093 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.188952    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0e47877-89f0-49db-a246-af40154deacc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rtvdm\" (UID: \"a0e47877-89f0-49db-a246-af40154deacc\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.189093 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.188981    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0e47877-89f0-49db-a246-af40154deacc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rtvdm\" (UID: \"a0e47877-89f0-49db-a246-af40154deacc\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.189093 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.188999    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0e47877-89f0-49db-a246-af40154deacc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rtvdm\" (UID: \"a0e47877-89f0-49db-a246-af40154deacc\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.189093 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.189027    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0e47877-89f0-49db-a246-af40154deacc-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rtvdm\" (UID: \"a0e47877-89f0-49db-a246-af40154deacc\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.189348 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.189271    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0e47877-89f0-49db-a246-af40154deacc-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rtvdm\" (UID: \"a0e47877-89f0-49db-a246-af40154deacc\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.215593 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.215561    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"]
Nov 04 02:25:54.263029 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.263000    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Nov 04 02:25:54.290718 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.290679    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0e47877-89f0-49db-a246-af40154deacc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rtvdm\" (UID: \"a0e47877-89f0-49db-a246-af40154deacc\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.290718 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.290722    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0e47877-89f0-49db-a246-af40154deacc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rtvdm\" (UID: \"a0e47877-89f0-49db-a246-af40154deacc\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.290976 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.290761    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0e47877-89f0-49db-a246-af40154deacc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rtvdm\" (UID: \"a0e47877-89f0-49db-a246-af40154deacc\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.290976 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.290804    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0e47877-89f0-49db-a246-af40154deacc-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rtvdm\" (UID: \"a0e47877-89f0-49db-a246-af40154deacc\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.290976 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.290846    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0e47877-89f0-49db-a246-af40154deacc-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rtvdm\" (UID: \"a0e47877-89f0-49db-a246-af40154deacc\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.290976 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.290928    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6jh5\" (UniqueName: \"kubernetes.io/projected/a0e47877-89f0-49db-a246-af40154deacc-kube-api-access-j6jh5\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rtvdm\" (UID: \"a0e47877-89f0-49db-a246-af40154deacc\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.291208 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.291150    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a0e47877-89f0-49db-a246-af40154deacc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rtvdm\" (UID: \"a0e47877-89f0-49db-a246-af40154deacc\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.291286 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.291211    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a0e47877-89f0-49db-a246-af40154deacc-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rtvdm\" (UID: \"a0e47877-89f0-49db-a246-af40154deacc\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.291461 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.291439    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a0e47877-89f0-49db-a246-af40154deacc-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rtvdm\" (UID: \"a0e47877-89f0-49db-a246-af40154deacc\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.293639 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.293608    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a0e47877-89f0-49db-a246-af40154deacc-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rtvdm\" (UID: \"a0e47877-89f0-49db-a246-af40154deacc\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.294764 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.294729    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a0e47877-89f0-49db-a246-af40154deacc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rtvdm\" (UID: \"a0e47877-89f0-49db-a246-af40154deacc\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.353236 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.353189    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6jh5\" (UniqueName: \"kubernetes.io/projected/a0e47877-89f0-49db-a246-af40154deacc-kube-api-access-j6jh5\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-rtvdm\" (UID: \"a0e47877-89f0-49db-a246-af40154deacc\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.472920 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.472821    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:25:54.856920 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:54.856890    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"]
Nov 04 02:25:54.858575 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:25:54.858547    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0e47877_89f0_49db_a246_af40154deacc.slice/crio-b6e92d77cf5cb80b28754506766813594ac2e6097ceda75b22f3e7810c78530b WatchSource:0}: Error finding container b6e92d77cf5cb80b28754506766813594ac2e6097ceda75b22f3e7810c78530b: Status 404 returned error can't find the container with id b6e92d77cf5cb80b28754506766813594ac2e6097ceda75b22f3e7810c78530b
Nov 04 02:25:55.130443 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:55.130351    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm" event={"ID":"a0e47877-89f0-49db-a246-af40154deacc","Type":"ContainerStarted","Data":"b6e92d77cf5cb80b28754506766813594ac2e6097ceda75b22f3e7810c78530b"}
Nov 04 02:25:56.137330 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:56.137279    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm" event={"ID":"a0e47877-89f0-49db-a246-af40154deacc","Type":"ContainerStarted","Data":"d1e48c0271d5c5e72e986f177d0aefe12eb638585270362671f3c2fba72b0397"}
Nov 04 02:25:56.258371 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:56.258315    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm" podStartSLOduration=1.704484669 podStartE2EDuration="2.258298923s" totalImagesPullingTime="553.814254ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:25:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:25:56.256159318 +0000 UTC m=+589.861172317" watchObservedRunningTime="2026-11-04 02:25:56.258298923 +0000 UTC m=+589.863311920"
Nov 04 02:25:56.473899 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:25:56.473807    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:26:00.669517 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:00.669476    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:26:00.682332 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:00.682301    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:26:01.175933 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:01.175903    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-fcdkx"
Nov 04 02:26:04.473631 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:04.473587    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:26:04.486633 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:04.486598    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:26:05.190209 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.190154    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"]
Nov 04 02:26:05.194412 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.194389    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.200262 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.200234    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-rtvdm"
Nov 04 02:26:05.253335 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.253298    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"]
Nov 04 02:26:05.295029 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.294992    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/984140c9-4374-48c2-ba1e-2f784c87abb7-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd\" (UID: \"984140c9-4374-48c2-ba1e-2f784c87abb7\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.295267 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.295046    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/984140c9-4374-48c2-ba1e-2f784c87abb7-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd\" (UID: \"984140c9-4374-48c2-ba1e-2f784c87abb7\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.295267 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.295074    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/984140c9-4374-48c2-ba1e-2f784c87abb7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd\" (UID: \"984140c9-4374-48c2-ba1e-2f784c87abb7\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.295267 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.295236    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/984140c9-4374-48c2-ba1e-2f784c87abb7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd\" (UID: \"984140c9-4374-48c2-ba1e-2f784c87abb7\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.295450 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.295269    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qd74h\" (UniqueName: \"kubernetes.io/projected/984140c9-4374-48c2-ba1e-2f784c87abb7-kube-api-access-qd74h\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd\" (UID: \"984140c9-4374-48c2-ba1e-2f784c87abb7\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.295450 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.295292    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/984140c9-4374-48c2-ba1e-2f784c87abb7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd\" (UID: \"984140c9-4374-48c2-ba1e-2f784c87abb7\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.297647 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.297621    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Nov 04 02:26:05.396456 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.396421    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/984140c9-4374-48c2-ba1e-2f784c87abb7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd\" (UID: \"984140c9-4374-48c2-ba1e-2f784c87abb7\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.396456 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.396463    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qd74h\" (UniqueName: \"kubernetes.io/projected/984140c9-4374-48c2-ba1e-2f784c87abb7-kube-api-access-qd74h\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd\" (UID: \"984140c9-4374-48c2-ba1e-2f784c87abb7\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.396748 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.396486    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/984140c9-4374-48c2-ba1e-2f784c87abb7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd\" (UID: \"984140c9-4374-48c2-ba1e-2f784c87abb7\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.396748 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.396573    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/984140c9-4374-48c2-ba1e-2f784c87abb7-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd\" (UID: \"984140c9-4374-48c2-ba1e-2f784c87abb7\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.396748 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.396606    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/984140c9-4374-48c2-ba1e-2f784c87abb7-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd\" (UID: \"984140c9-4374-48c2-ba1e-2f784c87abb7\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.396748 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.396627    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/984140c9-4374-48c2-ba1e-2f784c87abb7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd\" (UID: \"984140c9-4374-48c2-ba1e-2f784c87abb7\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.397094 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.397069    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/984140c9-4374-48c2-ba1e-2f784c87abb7-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd\" (UID: \"984140c9-4374-48c2-ba1e-2f784c87abb7\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.397324 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.397301    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/984140c9-4374-48c2-ba1e-2f784c87abb7-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd\" (UID: \"984140c9-4374-48c2-ba1e-2f784c87abb7\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.397406 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.397360    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/984140c9-4374-48c2-ba1e-2f784c87abb7-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd\" (UID: \"984140c9-4374-48c2-ba1e-2f784c87abb7\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.399193 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.399139    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/984140c9-4374-48c2-ba1e-2f784c87abb7-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd\" (UID: \"984140c9-4374-48c2-ba1e-2f784c87abb7\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.399498 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.399479    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/984140c9-4374-48c2-ba1e-2f784c87abb7-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd\" (UID: \"984140c9-4374-48c2-ba1e-2f784c87abb7\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.477920 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.477829    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qd74h\" (UniqueName: \"kubernetes.io/projected/984140c9-4374-48c2-ba1e-2f784c87abb7-kube-api-access-qd74h\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd\" (UID: \"984140c9-4374-48c2-ba1e-2f784c87abb7\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.512081 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.512001    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:05.920548 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:05.920514    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"]
Nov 04 02:26:06.197426 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:06.197326    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd" event={"ID":"984140c9-4374-48c2-ba1e-2f784c87abb7","Type":"ContainerStarted","Data":"63c51b398cb9ca472bcd1c3dd58b2073534b1442d5fa946173937631162be09d"}
Nov 04 02:26:06.636564 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:06.636539    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:26:06.641038 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:06.641017    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:26:07.204936 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:07.204894    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd" event={"ID":"984140c9-4374-48c2-ba1e-2f784c87abb7","Type":"ContainerStarted","Data":"db69e19041d17f9ebf15f28c3bb9faa617005643d395c5b78261b791a9fdb7c3"}
Nov 04 02:26:07.325579 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:07.325521    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd" podStartSLOduration=1.750594344 podStartE2EDuration="2.325505688s" totalImagesPullingTime="574.911344ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:26:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:26:07.32360178 +0000 UTC m=+600.928614777" watchObservedRunningTime="2026-11-04 02:26:07.325505688 +0000 UTC m=+600.930518685"
Nov 04 02:26:07.512617 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:07.512531    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:08.722471 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.722432    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"]
Nov 04 02:26:08.726389 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.726362    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:08.830143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.830107    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Nov 04 02:26:08.832565 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.832541    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"]
Nov 04 02:26:08.837485 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.837452    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eafd96d-c3bb-494f-9b45-96c2d1d7bc00-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z\" (UID: \"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:08.837651 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.837506    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eafd96d-c3bb-494f-9b45-96c2d1d7bc00-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z\" (UID: \"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:08.837651 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.837586    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8eafd96d-c3bb-494f-9b45-96c2d1d7bc00-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z\" (UID: \"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:08.837745 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.837707    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8eafd96d-c3bb-494f-9b45-96c2d1d7bc00-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z\" (UID: \"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:08.837841 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.837822    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4ng7\" (UniqueName: \"kubernetes.io/projected/8eafd96d-c3bb-494f-9b45-96c2d1d7bc00-kube-api-access-l4ng7\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z\" (UID: \"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:08.837897 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.837854    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8eafd96d-c3bb-494f-9b45-96c2d1d7bc00-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z\" (UID: \"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:08.939245 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.939158    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eafd96d-c3bb-494f-9b45-96c2d1d7bc00-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z\" (UID: \"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:08.939430 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.939257    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8eafd96d-c3bb-494f-9b45-96c2d1d7bc00-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z\" (UID: \"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:08.939430 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.939298    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8eafd96d-c3bb-494f-9b45-96c2d1d7bc00-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z\" (UID: \"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:08.939536 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.939429    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4ng7\" (UniqueName: \"kubernetes.io/projected/8eafd96d-c3bb-494f-9b45-96c2d1d7bc00-kube-api-access-l4ng7\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z\" (UID: \"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:08.939536 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.939483    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8eafd96d-c3bb-494f-9b45-96c2d1d7bc00-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z\" (UID: \"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:08.939642 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.939568    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eafd96d-c3bb-494f-9b45-96c2d1d7bc00-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z\" (UID: \"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:08.939642 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.939624    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8eafd96d-c3bb-494f-9b45-96c2d1d7bc00-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z\" (UID: \"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:08.939814 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.939723    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8eafd96d-c3bb-494f-9b45-96c2d1d7bc00-home\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z\" (UID: \"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:08.939814 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.939763    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8eafd96d-c3bb-494f-9b45-96c2d1d7bc00-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z\" (UID: \"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:08.942202 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.942154    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8eafd96d-c3bb-494f-9b45-96c2d1d7bc00-dshm\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z\" (UID: \"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:08.942338 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:08.942292    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8eafd96d-c3bb-494f-9b45-96c2d1d7bc00-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z\" (UID: \"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:09.004255 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:09.002652    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4ng7\" (UniqueName: \"kubernetes.io/projected/8eafd96d-c3bb-494f-9b45-96c2d1d7bc00-kube-api-access-l4ng7\") pod \"premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z\" (UID: \"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00\") " pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:09.038616 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:09.038570    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:09.423473 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:09.423446    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"]
Nov 04 02:26:09.425875 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:26:09.425844    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8eafd96d_c3bb_494f_9b45_96c2d1d7bc00.slice/crio-cfd79ac15da1e3232e996dbebf46aa46548cf82d86aa933d4354ded7c771ad0d WatchSource:0}: Error finding container cfd79ac15da1e3232e996dbebf46aa46548cf82d86aa933d4354ded7c771ad0d: Status 404 returned error can't find the container with id cfd79ac15da1e3232e996dbebf46aa46548cf82d86aa933d4354ded7c771ad0d
Nov 04 02:26:09.427537 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:09.427507    4548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 02:26:10.223646 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:10.223607    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z" event={"ID":"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00","Type":"ContainerStarted","Data":"128b2448738c5faf3a39bd19ddf8f8957e9a25d02e32c0f5a6eff8de4da30711"}
Nov 04 02:26:10.224049 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:10.223661    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z" event={"ID":"8eafd96d-c3bb-494f-9b45-96c2d1d7bc00","Type":"ContainerStarted","Data":"cfd79ac15da1e3232e996dbebf46aa46548cf82d86aa933d4354ded7c771ad0d"}
Nov 04 02:26:10.342225 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:10.342118    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z" podStartSLOduration=1.760471349 podStartE2EDuration="2.342096495s" totalImagesPullingTime="581.625146ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:26:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:26:10.340742485 +0000 UTC m=+603.945755485" watchObservedRunningTime="2026-11-04 02:26:10.342096495 +0000 UTC m=+603.947109494"
Nov 04 02:26:10.612999 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:26:10.612909    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:26:11.039376 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:11.039337    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:15.512691 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:15.512636    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:15.531607 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:15.531575    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:16.270134 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:16.270093    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd"
Nov 04 02:26:19.039192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:19.039128    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:19.052308 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:19.052276    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:19.287157 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:19.287121    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z"
Nov 04 02:26:24.511024 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.510980    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"]
Nov 04 02:26:24.514757 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.514735    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.591976 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.591932    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8df164d-d2b2-469b-8203-cb157a218c8a-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.591976 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.591971    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8df164d-d2b2-469b-8203-cb157a218c8a-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.592279 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.591995    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8df164d-d2b2-469b-8203-cb157a218c8a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.592279 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.592115    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8df164d-d2b2-469b-8203-cb157a218c8a-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.592279 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.592151    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8df164d-d2b2-469b-8203-cb157a218c8a-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.592447 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.592291    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bds9j\" (UniqueName: \"kubernetes.io/projected/a8df164d-d2b2-469b-8203-cb157a218c8a-kube-api-access-bds9j\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.592447 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.592321    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8df164d-d2b2-469b-8203-cb157a218c8a-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.592447 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.592383    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8df164d-d2b2-469b-8203-cb157a218c8a-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.592447 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.592406    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8df164d-d2b2-469b-8203-cb157a218c8a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.620799 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.620761    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"]
Nov 04 02:26:24.693723 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.693685    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8df164d-d2b2-469b-8203-cb157a218c8a-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.693723 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.693724    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8df164d-d2b2-469b-8203-cb157a218c8a-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.693985 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.693749    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8df164d-d2b2-469b-8203-cb157a218c8a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.693985 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.693782    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8df164d-d2b2-469b-8203-cb157a218c8a-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.693985 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.693808    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8df164d-d2b2-469b-8203-cb157a218c8a-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.693985 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.693890    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bds9j\" (UniqueName: \"kubernetes.io/projected/a8df164d-d2b2-469b-8203-cb157a218c8a-kube-api-access-bds9j\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.693985 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.693919    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8df164d-d2b2-469b-8203-cb157a218c8a-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.693985 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.693970    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8df164d-d2b2-469b-8203-cb157a218c8a-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.694326 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.693994    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8df164d-d2b2-469b-8203-cb157a218c8a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.694326 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.694228    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a8df164d-d2b2-469b-8203-cb157a218c8a-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.694326 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.694312    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a8df164d-d2b2-469b-8203-cb157a218c8a-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.694501 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.694479    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a8df164d-d2b2-469b-8203-cb157a218c8a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.694573 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.694557    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8df164d-d2b2-469b-8203-cb157a218c8a-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.694644 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.694622    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a8df164d-d2b2-469b-8203-cb157a218c8a-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.696845 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.696814    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a8df164d-d2b2-469b-8203-cb157a218c8a-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.697018 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.697001    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a8df164d-d2b2-469b-8203-cb157a218c8a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.756407 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.756366    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a8df164d-d2b2-469b-8203-cb157a218c8a-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.756568 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.756472    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bds9j\" (UniqueName: \"kubernetes.io/projected/a8df164d-d2b2-469b-8203-cb157a218c8a-kube-api-access-bds9j\") pod \"maas-default-gateway-openshift-default-fd4b99879-9rmjg\" (UID: \"a8df164d-d2b2-469b-8203-cb157a218c8a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:24.828512 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:24.828451    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:25.262234 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:25.262200    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"]
Nov 04 02:26:25.263731 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:26:25.263700    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8df164d_d2b2_469b_8203_cb157a218c8a.slice/crio-fe8b03ece9cdbac4f13087a42d5c03f4fee62468c0aee7808146eddf7b392ac0 WatchSource:0}: Error finding container fe8b03ece9cdbac4f13087a42d5c03f4fee62468c0aee7808146eddf7b392ac0: Status 404 returned error can't find the container with id fe8b03ece9cdbac4f13087a42d5c03f4fee62468c0aee7808146eddf7b392ac0
Nov 04 02:26:25.266059 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:25.266023    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:26:25.266183 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:25.266094    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:26:25.266183 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:25.266122    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:26:25.309352 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:25.309319    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg" event={"ID":"a8df164d-d2b2-469b-8203-cb157a218c8a","Type":"ContainerStarted","Data":"fe8b03ece9cdbac4f13087a42d5c03f4fee62468c0aee7808146eddf7b392ac0"}
Nov 04 02:26:26.317099 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:26.317053    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg" event={"ID":"a8df164d-d2b2-469b-8203-cb157a218c8a","Type":"ContainerStarted","Data":"38ef2b4972838537471def3fb8010d30a869a622060042a55663fc88c8146b8c"}
Nov 04 02:26:26.489463 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:26.489408    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg" podStartSLOduration=2.489394862 podStartE2EDuration="2.489394862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:26:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:26:26.488674502 +0000 UTC m=+620.093687513" watchObservedRunningTime="2026-11-04 02:26:26.489394862 +0000 UTC m=+620.094407860"
Nov 04 02:26:26.828967 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:26.828927    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:26.830645 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:26.830617    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-9rmjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Nov 04 02:26:26.830792 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:26.830674    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg" podUID="a8df164d-d2b2-469b-8203-cb157a218c8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Nov 04 02:26:27.829522 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:27.829483    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-9rmjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Nov 04 02:26:27.829936 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:27.829543    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg" podUID="a8df164d-d2b2-469b-8203-cb157a218c8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Nov 04 02:26:28.829013 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:28.828980    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-9rmjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Nov 04 02:26:28.829222 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:28.829035    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg" podUID="a8df164d-d2b2-469b-8203-cb157a218c8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Nov 04 02:26:29.828923 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:29.828881    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-9rmjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Nov 04 02:26:29.829478 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:29.828951    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg" podUID="a8df164d-d2b2-469b-8203-cb157a218c8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Nov 04 02:26:30.829699 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:30.829654    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-9rmjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Nov 04 02:26:30.830148 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:30.829721    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg" podUID="a8df164d-d2b2-469b-8203-cb157a218c8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Nov 04 02:26:31.829126 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:31.829083    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-9rmjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Nov 04 02:26:31.829357 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:31.829197    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg" podUID="a8df164d-d2b2-469b-8203-cb157a218c8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Nov 04 02:26:32.829724 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:32.829685    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-9rmjg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused" start-of-body=
Nov 04 02:26:32.830270 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:32.829751    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg" podUID="a8df164d-d2b2-469b-8203-cb157a218c8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": dial tcp 10.133.0.50:15021: connect: connection refused"
Nov 04 02:26:33.918928 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:33.918893    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:33.919507 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:33.919286    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:33.920345 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:33.920317    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg"
Nov 04 02:26:37.794441 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:37.794399    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-785f46d47c-6xj7p"]
Nov 04 02:26:37.798293 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:37.798263    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-785f46d47c-6xj7p"
Nov 04 02:26:37.852507 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:37.852472    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-785f46d47c-6xj7p"]
Nov 04 02:26:37.925236 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:37.925161    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eaed5222-8ec7-4d25-aa3f-9246c736643f-tls-cert\") pod \"authorino-785f46d47c-6xj7p\" (UID: \"eaed5222-8ec7-4d25-aa3f-9246c736643f\") " pod="kuadrant-system/authorino-785f46d47c-6xj7p"
Nov 04 02:26:37.925436 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:37.925330    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qm72s\" (UniqueName: \"kubernetes.io/projected/eaed5222-8ec7-4d25-aa3f-9246c736643f-kube-api-access-qm72s\") pod \"authorino-785f46d47c-6xj7p\" (UID: \"eaed5222-8ec7-4d25-aa3f-9246c736643f\") " pod="kuadrant-system/authorino-785f46d47c-6xj7p"
Nov 04 02:26:38.026838 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:38.026794    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eaed5222-8ec7-4d25-aa3f-9246c736643f-tls-cert\") pod \"authorino-785f46d47c-6xj7p\" (UID: \"eaed5222-8ec7-4d25-aa3f-9246c736643f\") " pod="kuadrant-system/authorino-785f46d47c-6xj7p"
Nov 04 02:26:38.027033 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:38.026862    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qm72s\" (UniqueName: \"kubernetes.io/projected/eaed5222-8ec7-4d25-aa3f-9246c736643f-kube-api-access-qm72s\") pod \"authorino-785f46d47c-6xj7p\" (UID: \"eaed5222-8ec7-4d25-aa3f-9246c736643f\") " pod="kuadrant-system/authorino-785f46d47c-6xj7p"
Nov 04 02:26:38.029573 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:38.029546    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/eaed5222-8ec7-4d25-aa3f-9246c736643f-tls-cert\") pod \"authorino-785f46d47c-6xj7p\" (UID: \"eaed5222-8ec7-4d25-aa3f-9246c736643f\") " pod="kuadrant-system/authorino-785f46d47c-6xj7p"
Nov 04 02:26:38.088845 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:38.088761    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qm72s\" (UniqueName: \"kubernetes.io/projected/eaed5222-8ec7-4d25-aa3f-9246c736643f-kube-api-access-qm72s\") pod \"authorino-785f46d47c-6xj7p\" (UID: \"eaed5222-8ec7-4d25-aa3f-9246c736643f\") " pod="kuadrant-system/authorino-785f46d47c-6xj7p"
Nov 04 02:26:38.110664 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:38.110614    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-785f46d47c-6xj7p"
Nov 04 02:26:38.495933 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:38.495901    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-785f46d47c-6xj7p"]
Nov 04 02:26:38.496788 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:26:38.496755    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeaed5222_8ec7_4d25_aa3f_9246c736643f.slice/crio-439dfad24da1f8703b2bbe6c87830778001f37bd0b0e7f0345448987dd094775 WatchSource:0}: Error finding container 439dfad24da1f8703b2bbe6c87830778001f37bd0b0e7f0345448987dd094775: Status 404 returned error can't find the container with id 439dfad24da1f8703b2bbe6c87830778001f37bd0b0e7f0345448987dd094775
Nov 04 02:26:39.395278 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:39.395235    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-785f46d47c-6xj7p" event={"ID":"eaed5222-8ec7-4d25-aa3f-9246c736643f","Type":"ContainerStarted","Data":"439dfad24da1f8703b2bbe6c87830778001f37bd0b0e7f0345448987dd094775"}
Nov 04 02:26:40.403101 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:40.403001    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-785f46d47c-6xj7p" event={"ID":"eaed5222-8ec7-4d25-aa3f-9246c736643f","Type":"ContainerStarted","Data":"43243564e32f625636c49f4421afbbfa4070e5ac680937513bd498206131a9db"}
Nov 04 02:26:40.520590 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:40.520530    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/authorino-785f46d47c-6xj7p" podStartSLOduration=1.87275543 podStartE2EDuration="3.52051192s" totalImagesPullingTime="1.64775649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:26:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:26:40.519727305 +0000 UTC m=+634.124740304" watchObservedRunningTime="2026-11-04 02:26:40.52051192 +0000 UTC m=+634.125524922"
Nov 04 02:26:40.574025 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:40.573985    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7975ddd498-zgbbp"]
Nov 04 02:26:40.574265 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:40.574235    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/authorino-7975ddd498-zgbbp" podUID="45d6aaee-0636-4952-8ee6-7a189874a36a" containerName="authorino" containerID="cri-o://faa73ee6d78073b0bca2a4abaa729267cc562ed326872081bf06631154841bf8" gracePeriod=30
Nov 04 02:26:40.614325 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:26:40.614290    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:26:40.837523 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:40.837492    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7975ddd498-zgbbp"
Nov 04 02:26:40.959004 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:40.958911    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45d6aaee-0636-4952-8ee6-7a189874a36a-kube-api-access-dvzkq\" (UniqueName: \"kubernetes.io/projected/45d6aaee-0636-4952-8ee6-7a189874a36a-kube-api-access-dvzkq\") pod \"45d6aaee-0636-4952-8ee6-7a189874a36a\" (UID: \"45d6aaee-0636-4952-8ee6-7a189874a36a\") "
Nov 04 02:26:40.959164 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:40.959080    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/45d6aaee-0636-4952-8ee6-7a189874a36a-tls-cert\" (UniqueName: \"kubernetes.io/secret/45d6aaee-0636-4952-8ee6-7a189874a36a-tls-cert\") pod \"45d6aaee-0636-4952-8ee6-7a189874a36a\" (UID: \"45d6aaee-0636-4952-8ee6-7a189874a36a\") "
Nov 04 02:26:40.961456 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:40.961425    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45d6aaee-0636-4952-8ee6-7a189874a36a-kube-api-access-dvzkq" pod "45d6aaee-0636-4952-8ee6-7a189874a36a" (UID: "45d6aaee-0636-4952-8ee6-7a189874a36a"). InnerVolumeSpecName "kube-api-access-dvzkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:26:40.973930 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:40.973888    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45d6aaee-0636-4952-8ee6-7a189874a36a-tls-cert" pod "45d6aaee-0636-4952-8ee6-7a189874a36a" (UID: "45d6aaee-0636-4952-8ee6-7a189874a36a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:26:41.060863 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:41.060826    4548 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/45d6aaee-0636-4952-8ee6-7a189874a36a-tls-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:26:41.060863 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:41.060858    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvzkq\" (UniqueName: \"kubernetes.io/projected/45d6aaee-0636-4952-8ee6-7a189874a36a-kube-api-access-dvzkq\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:26:41.410085 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:41.410044    4548 generic.go:356] "Generic (PLEG): container finished" podID="45d6aaee-0636-4952-8ee6-7a189874a36a" containerID="faa73ee6d78073b0bca2a4abaa729267cc562ed326872081bf06631154841bf8" exitCode=0
Nov 04 02:26:41.410085 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:41.410090    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7975ddd498-zgbbp"
Nov 04 02:26:41.410692 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:41.410105    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7975ddd498-zgbbp" event={"ID":"45d6aaee-0636-4952-8ee6-7a189874a36a","Type":"ContainerDied","Data":"faa73ee6d78073b0bca2a4abaa729267cc562ed326872081bf06631154841bf8"}
Nov 04 02:26:41.410692 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:41.410149    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7975ddd498-zgbbp" event={"ID":"45d6aaee-0636-4952-8ee6-7a189874a36a","Type":"ContainerDied","Data":"61bd4cb1930b7dec14aed0bc1b356b4ce2bd1a4f6258b7959d76acd301861e1d"}
Nov 04 02:26:41.410692 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:41.410181    4548 scope.go:122] "RemoveContainer" containerID="faa73ee6d78073b0bca2a4abaa729267cc562ed326872081bf06631154841bf8"
Nov 04 02:26:41.421263 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:41.421241    4548 scope.go:122] "RemoveContainer" containerID="faa73ee6d78073b0bca2a4abaa729267cc562ed326872081bf06631154841bf8"
Nov 04 02:26:41.421606 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:26:41.421581    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faa73ee6d78073b0bca2a4abaa729267cc562ed326872081bf06631154841bf8\": container with ID starting with faa73ee6d78073b0bca2a4abaa729267cc562ed326872081bf06631154841bf8 not found: ID does not exist" containerID="faa73ee6d78073b0bca2a4abaa729267cc562ed326872081bf06631154841bf8"
Nov 04 02:26:41.421737 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:41.421614    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faa73ee6d78073b0bca2a4abaa729267cc562ed326872081bf06631154841bf8"} err="failed to get container status \"faa73ee6d78073b0bca2a4abaa729267cc562ed326872081bf06631154841bf8\": rpc error: code = NotFound desc = could not find container \"faa73ee6d78073b0bca2a4abaa729267cc562ed326872081bf06631154841bf8\": container with ID starting with faa73ee6d78073b0bca2a4abaa729267cc562ed326872081bf06631154841bf8 not found: ID does not exist"
Nov 04 02:26:41.575730 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:41.575697    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7975ddd498-zgbbp"]
Nov 04 02:26:41.579921 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:41.579886    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7975ddd498-zgbbp"]
Nov 04 02:26:42.526364 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:26:42.526288    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="45d6aaee-0636-4952-8ee6-7a189874a36a" path="/var/lib/kubelet/pods/45d6aaee-0636-4952-8ee6-7a189874a36a/volumes"
Nov 04 02:27:10.611829 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:27:10.611786    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:27:19.455264 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.455165    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"]
Nov 04 02:27:19.455664 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.455595    4548 cpu_manager.go:414] "containerMap: removing container" podUID="45d6aaee-0636-4952-8ee6-7a189874a36a" containerName="authorino"
Nov 04 02:27:19.455664 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.455608    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45d6aaee-0636-4952-8ee6-7a189874a36a" containerName="authorino"
Nov 04 02:27:19.455735 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.455680    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="45d6aaee-0636-4952-8ee6-7a189874a36a" containerName="authorino"
Nov 04 02:27:19.458913 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.458887    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.512314 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.512284    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-ab53c1-openshift-default-dockercfg-xpzps\""
Nov 04 02:27:19.565267 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.565231    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"]
Nov 04 02:27:19.639931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.639895    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxwjx\" (UniqueName: \"kubernetes.io/projected/9fdd3326-be0a-4c70-bf81-07435dda05e3-kube-api-access-qxwjx\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.640199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.639957    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.640199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.640028    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.640199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.640059    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fdd3326-be0a-4c70-bf81-07435dda05e3-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.640199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.640094    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.640199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.640139    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.641443 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.640212    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.641443 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.640261    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.641443 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.640301    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.743256 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.742153    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.743256 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.742263    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.743256 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.742317    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.743256 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.742373    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.743256 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.742411    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxwjx\" (UniqueName: \"kubernetes.io/projected/9fdd3326-be0a-4c70-bf81-07435dda05e3-kube-api-access-qxwjx\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.743256 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.742458    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.743256 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.742520    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.743256 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.742555    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fdd3326-be0a-4c70-bf81-07435dda05e3-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.743256 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.742614    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.743256 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.743084    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.743899 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.743371    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.743899 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.743622    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.747809 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.744253    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fdd3326-be0a-4c70-bf81-07435dda05e3-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.747809 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.744506    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.747809 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.746727    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.749862 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.748293    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.807454 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.807422    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.809643 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.809615    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxwjx\" (UniqueName: \"kubernetes.io/projected/9fdd3326-be0a-4c70-bf81-07435dda05e3-kube-api-access-qxwjx\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:19.819277 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.819242    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"]
Nov 04 02:27:19.824264 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.824238    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:19.930777 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.930728    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"]
Nov 04 02:27:19.944483 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.944428    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-envoy\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:19.944680 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.944502    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-workload-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:19.944680 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.944535    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istiod-ca-cert\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:19.944680 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.944568    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-workload-certs\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:19.944804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.944668    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-data\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:19.944804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.944738    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-credential-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:19.944886 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.944838    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-token\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:19.944886 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.944865    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8pmh\" (UniqueName: \"kubernetes.io/projected/7d3cf0be-0fae-4452-824e-2cf91e1232c2-kube-api-access-r8pmh\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:19.944969 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.944953    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-podinfo\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:19.956817 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:19.956782    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-1e4f1e-openshift-default-dockercfg-rnr9f\""
Nov 04 02:27:20.045577 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.045541    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-podinfo\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.045577 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.045590    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-envoy\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.045577 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.045624    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-workload-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.045577 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.045649    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istiod-ca-cert\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.046830 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.045682    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-workload-certs\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.046830 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.045729    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-data\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.046830 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.045810    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-credential-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.046830 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.045884    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-token\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.046830 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.045913    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8pmh\" (UniqueName: \"kubernetes.io/projected/7d3cf0be-0fae-4452-824e-2cf91e1232c2-kube-api-access-r8pmh\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.047362 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.047268    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-workload-certs\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.047490 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.047447    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-data\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.048025 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.047994    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-workload-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.048692 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.048668    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istiod-ca-cert\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.048941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.048917    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-credential-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.049869 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.049837    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-podinfo\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.049968 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.049876    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-envoy\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.072433 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.072391    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:20.112297 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.112254    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8pmh\" (UniqueName: \"kubernetes.io/projected/7d3cf0be-0fae-4452-824e-2cf91e1232c2-kube-api-access-r8pmh\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.115344 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.115314    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-token\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.137548 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.137510    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:20.211268 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.211222    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"]
Nov 04 02:27:20.218152 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.218124    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.273359 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.272267    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-6c403f-openshift-default-dockercfg-ml65s\""
Nov 04 02:27:20.286586 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.286528    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"]
Nov 04 02:27:20.348489 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.348378    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-envoy\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.348677 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.348532    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-credential-socket\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.348677 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.348573    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8tqd\" (UniqueName: \"kubernetes.io/projected/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-kube-api-access-f8tqd\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.348677 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.348605    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-workload-certs\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.348792 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.348731    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-podinfo\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.348792 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.348778    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istiod-ca-cert\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.348954 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.348884    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-workload-socket\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.348954 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.348923    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-token\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.349059 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.348975    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-data\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.450046 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.450001    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-workload-socket\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.450046 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.450051    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-token\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.450396 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.450083    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-data\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.450396 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.450110    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-envoy\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.450396 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.450227    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-credential-socket\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.450396 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.450258    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8tqd\" (UniqueName: \"kubernetes.io/projected/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-kube-api-access-f8tqd\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.450396 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.450291    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-workload-certs\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.450396 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.450325    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-podinfo\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.450759 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.450591    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-data\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.450759 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.450609    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-workload-socket\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.450759 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.450615    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istiod-ca-cert\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.450857 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.450777    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-credential-socket\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.450956 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.450926    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-workload-certs\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.451291 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.451273    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istiod-ca-cert\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.453387 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.453363    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-envoy\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.453627 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.453606    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-podinfo\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.466468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.466432    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"]
Nov 04 02:27:20.468598 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:27:20.468568    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fdd3326_be0a_4c70_bf81_07435dda05e3.slice/crio-78b23602cc9ba9dadc91b0457ee83ecfa7fe423df8ab28b109edd20eb254a658 WatchSource:0}: Error finding container 78b23602cc9ba9dadc91b0457ee83ecfa7fe423df8ab28b109edd20eb254a658: Status 404 returned error can't find the container with id 78b23602cc9ba9dadc91b0457ee83ecfa7fe423df8ab28b109edd20eb254a658
Nov 04 02:27:20.470906 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.470873    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:27:20.470975 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.470940    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:27:20.470975 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.470972    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:27:20.512147 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.512107    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-token\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.512325 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.512256    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8tqd\" (UniqueName: \"kubernetes.io/projected/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-kube-api-access-f8tqd\") pod \"e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") " pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.541364 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.541331    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:20.564691 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.564656    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"]
Nov 04 02:27:20.566868 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:27:20.566832    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3cf0be_0fae_4452_824e_2cf91e1232c2.slice/crio-11239ee7281a9a4eb2d494abf933a68ff790c7461b7ca5cf041919e69b1eb5a2 WatchSource:0}: Error finding container 11239ee7281a9a4eb2d494abf933a68ff790c7461b7ca5cf041919e69b1eb5a2: Status 404 returned error can't find the container with id 11239ee7281a9a4eb2d494abf933a68ff790c7461b7ca5cf041919e69b1eb5a2
Nov 04 02:27:20.569982 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.569941    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:27:20.570112 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.570042    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:27:20.570112 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.570094    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:27:20.646283 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.646068    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v" event={"ID":"9fdd3326-be0a-4c70-bf81-07435dda05e3","Type":"ContainerStarted","Data":"838a10784b1323d09b399c253cc903ff28f7417f6e3143ae19da5acffa7dea00"}
Nov 04 02:27:20.646283 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.646132    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v" event={"ID":"9fdd3326-be0a-4c70-bf81-07435dda05e3","Type":"ContainerStarted","Data":"78b23602cc9ba9dadc91b0457ee83ecfa7fe423df8ab28b109edd20eb254a658"}
Nov 04 02:27:20.648954 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.648922    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb" event={"ID":"7d3cf0be-0fae-4452-824e-2cf91e1232c2","Type":"ContainerStarted","Data":"11239ee7281a9a4eb2d494abf933a68ff790c7461b7ca5cf041919e69b1eb5a2"}
Nov 04 02:27:20.958557 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.958430    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v" podStartSLOduration=1.958405275 podStartE2EDuration="1.958405275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:20.77353177 +0000 UTC m=+674.378544769" watchObservedRunningTime="2026-11-04 02:27:20.958405275 +0000 UTC m=+674.563418273"
Nov 04 02:27:20.960711 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.960680    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"]
Nov 04 02:27:20.962990 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:27:20.962962    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5e1352_41be_436c_bd26_7ef9a0e7a85d.slice/crio-ab068fd94f26d7ce9b699e511ca99c6a539b3d2b7f0717589cfd4ea7c3edea3f WatchSource:0}: Error finding container ab068fd94f26d7ce9b699e511ca99c6a539b3d2b7f0717589cfd4ea7c3edea3f: Status 404 returned error can't find the container with id ab068fd94f26d7ce9b699e511ca99c6a539b3d2b7f0717589cfd4ea7c3edea3f
Nov 04 02:27:20.966332 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.966288    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:27:20.966411 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.966388    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:27:20.966453 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:20.966440    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:27:21.073889 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:21.073855    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:21.079238 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:21.079206    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:21.655884 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:21.655842    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm" event={"ID":"2e5e1352-41be-436c-bd26-7ef9a0e7a85d","Type":"ContainerStarted","Data":"ad5961bec1a656936b7698458d339bacece9bac61407b28afde89eb672c96e19"}
Nov 04 02:27:21.656392 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:21.655918    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm" event={"ID":"2e5e1352-41be-436c-bd26-7ef9a0e7a85d","Type":"ContainerStarted","Data":"ab068fd94f26d7ce9b699e511ca99c6a539b3d2b7f0717589cfd4ea7c3edea3f"}
Nov 04 02:27:21.657963 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:21.657931    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb" event={"ID":"7d3cf0be-0fae-4452-824e-2cf91e1232c2","Type":"ContainerStarted","Data":"33c7f9569bfb33e12cc627eb5309c14dcda87d56d7db7dc1da1efa7278e6400f"}
Nov 04 02:27:21.658294 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:21.658272    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:21.659286 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:21.659262    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:27:21.788568 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:21.788516    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm" podStartSLOduration=1.788500897 podStartE2EDuration="1.788500897s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:21.787628744 +0000 UTC m=+675.392641739" watchObservedRunningTime="2026-11-04 02:27:21.788500897 +0000 UTC m=+675.393513896"
Nov 04 02:27:22.047927 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.047849    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb" podStartSLOduration=3.04527558 podStartE2EDuration="3.04527558s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:21.912616863 +0000 UTC m=+675.517629863" watchObservedRunningTime="2026-11-04 02:27:22.04527558 +0000 UTC m=+675.650288606"
Nov 04 02:27:22.138784 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.138744    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:22.143914 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.143884    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:22.419748 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.419659    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"]
Nov 04 02:27:22.423597 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.423572    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.484505 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.484467    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"]
Nov 04 02:27:22.484716 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.484704    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-2ba6b8-openshift-default-dockercfg-n895s\""
Nov 04 02:27:22.542432 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.542399    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:22.548206 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.548148    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:22.578054 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.578010    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c869q\" (UniqueName: \"kubernetes.io/projected/d7e95e09-f96e-4635-abe4-390c3fb16b6a-kube-api-access-c869q\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.578333 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.578067    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-credential-socket\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.578333 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.578098    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istiod-ca-cert\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.579506 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.579471    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-envoy\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.579631 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.579602    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-token\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.579726 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.579710    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-workload-socket\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.579870 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.579849    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-workload-certs\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.579945 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.579907    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-data\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.580004 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.579980    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-podinfo\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.664554 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.664517    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:22.665070 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.664568    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:22.665339 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.665315    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:22.665446 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.665372    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:27:22.681686 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.681579    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-podinfo\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.681686 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.681664    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c869q\" (UniqueName: \"kubernetes.io/projected/d7e95e09-f96e-4635-abe4-390c3fb16b6a-kube-api-access-c869q\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.681930 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.681697    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-credential-socket\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.681930 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.681720    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istiod-ca-cert\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.681930 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.681760    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-envoy\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.681930 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.681796    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-token\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.681930 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.681887    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-workload-socket\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.682224 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.682159    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-workload-certs\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.682310 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.682256    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-data\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.682363 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.682313    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-workload-socket\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.682573 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.682508    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-workload-certs\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.682704 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.682672    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istiod-ca-cert\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.682791 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.682765    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-data\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.682883 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.682822    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-credential-socket\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.684310 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.684287    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-envoy\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.684562 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.684545    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-podinfo\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.743355 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.743322    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-token\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:22.743355 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:22.743346    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c869q\" (UniqueName: \"kubernetes.io/projected/d7e95e09-f96e-4635-abe4-390c3fb16b6a-kube-api-access-c869q\") pod \"e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") " pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:23.037160 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:23.037125    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:23.468624 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:23.468594    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"]
Nov 04 02:27:23.470492 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:27:23.470460    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7e95e09_f96e_4635_abe4_390c3fb16b6a.slice/crio-950a85c6b0472053165ed278449920bb6370e0b52c0083abdac944629e9b8729 WatchSource:0}: Error finding container 950a85c6b0472053165ed278449920bb6370e0b52c0083abdac944629e9b8729: Status 404 returned error can't find the container with id 950a85c6b0472053165ed278449920bb6370e0b52c0083abdac944629e9b8729
Nov 04 02:27:23.472892 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:23.472858    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:27:23.472991 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:23.472931    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:27:23.472991 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:23.472961    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:27:23.671576 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:23.671534    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2" event={"ID":"d7e95e09-f96e-4635-abe4-390c3fb16b6a","Type":"ContainerStarted","Data":"154ccfe24de71b145b60c2e40759e5a15d405c77a29201d7493a09036702a6a6"}
Nov 04 02:27:23.672041 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:23.671606    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2" event={"ID":"d7e95e09-f96e-4635-abe4-390c3fb16b6a","Type":"ContainerStarted","Data":"950a85c6b0472053165ed278449920bb6370e0b52c0083abdac944629e9b8729"}
Nov 04 02:27:23.796620 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:23.796558    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2" podStartSLOduration=1.796539154 podStartE2EDuration="1.796539154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:23.792494693 +0000 UTC m=+677.397507692" watchObservedRunningTime="2026-11-04 02:27:23.796539154 +0000 UTC m=+677.401552153"
Nov 04 02:27:24.038369 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:24.038325    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:24.043922 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:24.043889    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:24.677810 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:24.677778    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:24.678721 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:24.678696    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:27:27.633491 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.633449    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"]
Nov 04 02:27:27.637467 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.637440    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.731247 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.731210    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.731453 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.731396    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.731518 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.731451    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9af764ed-0a79-4623-baa7-2a48950c6541-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.731618 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.731593    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rst8c\" (UniqueName: \"kubernetes.io/projected/9af764ed-0a79-4623-baa7-2a48950c6541-kube-api-access-rst8c\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.731663 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.731642    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9af764ed-0a79-4623-baa7-2a48950c6541-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.731753 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.731723    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.731808 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.731794    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9af764ed-0a79-4623-baa7-2a48950c6541-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.731854 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.731840    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.731914 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.731899    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.744358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.744298    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"]
Nov 04 02:27:27.790261 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.790226    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-a18c43-openshift-default-dockercfg-4h4hv\""
Nov 04 02:27:27.833260 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.833213    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.833483 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.833289    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9af764ed-0a79-4623-baa7-2a48950c6541-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.833483 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.833341    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rst8c\" (UniqueName: \"kubernetes.io/projected/9af764ed-0a79-4623-baa7-2a48950c6541-kube-api-access-rst8c\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.833483 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.833365    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9af764ed-0a79-4623-baa7-2a48950c6541-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.833483 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.833398    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.833483 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.833443    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9af764ed-0a79-4623-baa7-2a48950c6541-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.833738 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.833577    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.833738 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.833624    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.833738 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.833678    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.833886 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.833745    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.833981 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.833953    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.834069 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.834046    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.834128 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.834084    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.834417 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.834389    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9af764ed-0a79-4623-baa7-2a48950c6541-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.835983 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.835955    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.836994 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.836967    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9af764ed-0a79-4623-baa7-2a48950c6541-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.895066 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.894995    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9af764ed-0a79-4623-baa7-2a48950c6541-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.895066 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.894994    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rst8c\" (UniqueName: \"kubernetes.io/projected/9af764ed-0a79-4623-baa7-2a48950c6541-kube-api-access-rst8c\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:27.952825 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:27.952540    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:28.388095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:28.388063    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"]
Nov 04 02:27:28.389485 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:27:28.389453    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9af764ed_0a79_4623_baa7_2a48950c6541.slice/crio-5d12b1f06afada22321ff75cc62111d87cca76488e5bd100071dc59eb9704e85 WatchSource:0}: Error finding container 5d12b1f06afada22321ff75cc62111d87cca76488e5bd100071dc59eb9704e85: Status 404 returned error can't find the container with id 5d12b1f06afada22321ff75cc62111d87cca76488e5bd100071dc59eb9704e85
Nov 04 02:27:28.391898 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:28.391869    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:27:28.391974 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:28.391935    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:27:28.391974 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:28.391966    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:27:28.732801 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:28.732683    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57" event={"ID":"9af764ed-0a79-4623-baa7-2a48950c6541","Type":"ContainerStarted","Data":"40846d7e7380e7b90a8836e22c9d023b0fc74b45ecb07899c7e81d6e0f7a1a23"}
Nov 04 02:27:28.732801 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:28.732773    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57" event={"ID":"9af764ed-0a79-4623-baa7-2a48950c6541","Type":"ContainerStarted","Data":"5d12b1f06afada22321ff75cc62111d87cca76488e5bd100071dc59eb9704e85"}
Nov 04 02:27:28.870768 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:28.870701    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57" podStartSLOduration=1.870678146 podStartE2EDuration="1.870678146s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:27:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:27:28.866517586 +0000 UTC m=+682.471530585" watchObservedRunningTime="2026-11-04 02:27:28.870678146 +0000 UTC m=+682.475691148"
Nov 04 02:27:28.952792 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:28.952756    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:29.959082 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:29.959040    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:30.751622 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:30.751590    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:30.752646 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:30.752625    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:27:40.614517 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:27:40.614465    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:27:49.887196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:49.886627    4548 generic.go:356] "Generic (PLEG): container finished" podID="2e5e1352-41be-436c-bd26-7ef9a0e7a85d" containerID="ad5961bec1a656936b7698458d339bacece9bac61407b28afde89eb672c96e19" exitCode=0
Nov 04 02:27:49.887196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:49.886683    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm" event={"ID":"2e5e1352-41be-436c-bd26-7ef9a0e7a85d","Type":"ContainerDied","Data":"ad5961bec1a656936b7698458d339bacece9bac61407b28afde89eb672c96e19"}
Nov 04 02:27:49.887196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:49.887151    4548 scope.go:122] "RemoveContainer" containerID="ad5961bec1a656936b7698458d339bacece9bac61407b28afde89eb672c96e19"
Nov 04 02:27:49.907917 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:49.907859    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:27:49.908081 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:49.907983    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:27:49.908081 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:49.908039    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:27:50.924680 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:50.924634    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm" event={"ID":"2e5e1352-41be-436c-bd26-7ef9a0e7a85d","Type":"ContainerStarted","Data":"63b87ae8b938d419966f75b56ff9a325d2365f4b6d8327472dc737a8ea2b9688"}
Nov 04 02:27:51.567200 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:51.560289    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:51.567200 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:51.560818    4548 patch_prober.go:29] interesting pod/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Nov 04 02:27:51.567200 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:51.560906    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm" podUID="2e5e1352-41be-436c-bd26-7ef9a0e7a85d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Nov 04 02:27:52.543714 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:52.543666    4548 patch_prober.go:29] interesting pod/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Nov 04 02:27:52.544391 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:52.544357    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm" podUID="2e5e1352-41be-436c-bd26-7ef9a0e7a85d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Nov 04 02:27:52.665894 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:52.665857    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:53.541750 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:53.541713    4548 patch_prober.go:29] interesting pod/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Nov 04 02:27:53.542022 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:53.541998    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm" podUID="2e5e1352-41be-436c-bd26-7ef9a0e7a85d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Nov 04 02:27:54.557123 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:54.557086    4548 patch_prober.go:29] interesting pod/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Nov 04 02:27:54.557821 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:54.557786    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm" podUID="2e5e1352-41be-436c-bd26-7ef9a0e7a85d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Nov 04 02:27:55.542144 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:55.542098    4548 patch_prober.go:29] interesting pod/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Nov 04 02:27:55.542381 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:55.542158    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm" podUID="2e5e1352-41be-436c-bd26-7ef9a0e7a85d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Nov 04 02:27:56.542546 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:56.542497    4548 patch_prober.go:29] interesting pod/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused" start-of-body=
Nov 04 02:27:56.542978 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:56.542574    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm" podUID="2e5e1352-41be-436c-bd26-7ef9a0e7a85d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.54:15021/healthz/ready\": dial tcp 10.133.0.54:15021: connect: connection refused"
Nov 04 02:27:57.547381 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:57.547347    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:27:57.548862 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:27:57.548837    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:28:00.022907 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:00.022861    4548 generic.go:356] "Generic (PLEG): container finished" podID="7d3cf0be-0fae-4452-824e-2cf91e1232c2" containerID="33c7f9569bfb33e12cc627eb5309c14dcda87d56d7db7dc1da1efa7278e6400f" exitCode=0
Nov 04 02:28:00.023518 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:00.022940    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb" event={"ID":"7d3cf0be-0fae-4452-824e-2cf91e1232c2","Type":"ContainerDied","Data":"33c7f9569bfb33e12cc627eb5309c14dcda87d56d7db7dc1da1efa7278e6400f"}
Nov 04 02:28:00.023518 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:00.023506    4548 scope.go:122] "RemoveContainer" containerID="33c7f9569bfb33e12cc627eb5309c14dcda87d56d7db7dc1da1efa7278e6400f"
Nov 04 02:28:00.024918 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:00.024886    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:28:00.024918 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:00.024906    4548 generic.go:356] "Generic (PLEG): container finished" podID="9fdd3326-be0a-4c70-bf81-07435dda05e3" containerID="838a10784b1323d09b399c253cc903ff28f7417f6e3143ae19da5acffa7dea00" exitCode=0
Nov 04 02:28:00.025090 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:00.024958    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:28:00.025090 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:00.024985    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v" event={"ID":"9fdd3326-be0a-4c70-bf81-07435dda05e3","Type":"ContainerDied","Data":"838a10784b1323d09b399c253cc903ff28f7417f6e3143ae19da5acffa7dea00"}
Nov 04 02:28:00.025090 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:00.024999    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:28:00.025457 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:00.025436    4548 scope.go:122] "RemoveContainer" containerID="838a10784b1323d09b399c253cc903ff28f7417f6e3143ae19da5acffa7dea00"
Nov 04 02:28:00.026728 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:00.026696    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:28:00.026835 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:00.026776    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:28:00.026835 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:00.026829    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:28:01.036766 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:01.036731    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb" event={"ID":"7d3cf0be-0fae-4452-824e-2cf91e1232c2","Type":"ContainerStarted","Data":"21e1229ccd97f7c82f28a795a94f912238aa5d18d0bd49091112603da37d65b3"}
Nov 04 02:28:01.047306 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:01.047268    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v" event={"ID":"9fdd3326-be0a-4c70-bf81-07435dda05e3","Type":"ContainerStarted","Data":"2d6729c125568a7627c6bcc112d76aef4c24fc9672c2aa38e20890ec31f6e4b8"}
Nov 04 02:28:01.084196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:01.083610    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:28:01.084196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:01.083747    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Nov 04 02:28:01.084196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:01.083805    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v" podUID="9fdd3326-be0a-4c70-bf81-07435dda05e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Nov 04 02:28:01.139640 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:01.139602    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:28:01.140104 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:01.140078    4548 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Nov 04 02:28:01.140339 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:01.140312    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb" podUID="7d3cf0be-0fae-4452-824e-2cf91e1232c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Nov 04 02:28:02.078198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:02.077616    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Nov 04 02:28:02.078198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:02.077686    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v" podUID="9fdd3326-be0a-4c70-bf81-07435dda05e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Nov 04 02:28:02.149192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:02.144283    4548 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Nov 04 02:28:02.149192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:02.144345    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb" podUID="7d3cf0be-0fae-4452-824e-2cf91e1232c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Nov 04 02:28:03.076197 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:03.073774    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Nov 04 02:28:03.076197 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:03.073870    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v" podUID="9fdd3326-be0a-4c70-bf81-07435dda05e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Nov 04 02:28:03.139069 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:03.139019    4548 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Nov 04 02:28:03.139613 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:03.139092    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb" podUID="7d3cf0be-0fae-4452-824e-2cf91e1232c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Nov 04 02:28:04.079824 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:04.079786    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Nov 04 02:28:04.080128 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:04.080094    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v" podUID="9fdd3326-be0a-4c70-bf81-07435dda05e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Nov 04 02:28:04.139478 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:04.139442    4548 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Nov 04 02:28:04.140098 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:04.140066    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb" podUID="7d3cf0be-0fae-4452-824e-2cf91e1232c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Nov 04 02:28:05.074327 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:05.074287    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Nov 04 02:28:05.074632 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:05.074604    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v" podUID="9fdd3326-be0a-4c70-bf81-07435dda05e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Nov 04 02:28:05.138154 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:05.138117    4548 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Nov 04 02:28:05.145859 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:05.145815    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb" podUID="7d3cf0be-0fae-4452-824e-2cf91e1232c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Nov 04 02:28:06.077707 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:06.077664    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused" start-of-body=
Nov 04 02:28:06.078021 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:06.077988    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v" podUID="9fdd3326-be0a-4c70-bf81-07435dda05e3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.52:15021/healthz/ready\": dial tcp 10.133.0.52:15021: connect: connection refused"
Nov 04 02:28:06.150350 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:06.150312    4548 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Nov 04 02:28:06.151017 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:06.150526    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb" podUID="7d3cf0be-0fae-4452-824e-2cf91e1232c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Nov 04 02:28:06.658222 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:06.658156    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:28:07.078528 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:07.078494    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:28:07.143678 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:07.143638    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:28:07.143959 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:07.143943    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:28:07.144885 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:07.144862    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:28:07.159316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:07.159279    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:28:10.616307 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:28:10.616224    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:28:11.193904 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:11.193871    4548 generic.go:356] "Generic (PLEG): container finished" podID="9af764ed-0a79-4623-baa7-2a48950c6541" containerID="40846d7e7380e7b90a8836e22c9d023b0fc74b45ecb07899c7e81d6e0f7a1a23" exitCode=0
Nov 04 02:28:11.193904 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:11.193910    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57" event={"ID":"9af764ed-0a79-4623-baa7-2a48950c6541","Type":"ContainerDied","Data":"40846d7e7380e7b90a8836e22c9d023b0fc74b45ecb07899c7e81d6e0f7a1a23"}
Nov 04 02:28:11.194360 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:11.194341    4548 scope.go:122] "RemoveContainer" containerID="40846d7e7380e7b90a8836e22c9d023b0fc74b45ecb07899c7e81d6e0f7a1a23"
Nov 04 02:28:11.195738 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:11.195707    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:28:11.195794 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:11.195778    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:28:11.195828 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:11.195811    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:28:12.229204 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:12.229123    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57" event={"ID":"9af764ed-0a79-4623-baa7-2a48950c6541","Type":"ContainerStarted","Data":"01aa70ddb633d91e79ccd263346394e3f0b9aa9021f0e68e7bf74f563d8707d2"}
Nov 04 02:28:12.953469 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:12.953432    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:28:12.954800 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:12.954778    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Nov 04 02:28:12.954878 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:12.954827    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57" podUID="9af764ed-0a79-4623-baa7-2a48950c6541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Nov 04 02:28:13.953617 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:13.953575    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Nov 04 02:28:13.954160 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:13.953655    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57" podUID="9af764ed-0a79-4623-baa7-2a48950c6541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Nov 04 02:28:14.953329 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:14.953290    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Nov 04 02:28:14.953561 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:14.953362    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57" podUID="9af764ed-0a79-4623-baa7-2a48950c6541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Nov 04 02:28:15.752099 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:15.752058    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:28:15.953192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:15.953133    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Nov 04 02:28:15.953467 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:15.953431    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57" podUID="9af764ed-0a79-4623-baa7-2a48950c6541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Nov 04 02:28:16.952916 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:16.952880    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Nov 04 02:28:16.953541 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:16.952935    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57" podUID="9af764ed-0a79-4623-baa7-2a48950c6541" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Nov 04 02:28:18.045221 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.044997    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:28:18.048595 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.048551    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:28:18.733786 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.733748    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"]
Nov 04 02:28:18.736408 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.736389    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:18.791138 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.790365    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-6c403f\"/\"kube-root-ca.crt\""
Nov 04 02:28:18.791138 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.790527    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-6c403f\"/\"simulator-w3-6c403f-kserve-self-signed-certs\""
Nov 04 02:28:18.792789 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.792723    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w3-6c403f\"/\"openshift-service-ca.crt\""
Nov 04 02:28:18.795499 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.795464    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"]
Nov 04 02:28:18.814657 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.814617    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-model-cache\") pod \"simulator-w3-6c403f-kserve-59556b7fb8-vw5c8\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") " pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:18.814884 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.814675    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-tmp-dir\") pod \"simulator-w3-6c403f-kserve-59556b7fb8-vw5c8\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") " pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:18.814884 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.814749    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-home\") pod \"simulator-w3-6c403f-kserve-59556b7fb8-vw5c8\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") " pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:18.814884 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.814771    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-dshm\") pod \"simulator-w3-6c403f-kserve-59556b7fb8-vw5c8\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") " pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:18.814884 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.814795    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq5f2\" (UniqueName: \"kubernetes.io/projected/e37c21b6-3bb6-441e-a559-012803d6ac6c-kube-api-access-jq5f2\") pod \"simulator-w3-6c403f-kserve-59556b7fb8-vw5c8\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") " pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:18.814884 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.814822    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e37c21b6-3bb6-441e-a559-012803d6ac6c-tls-certs\") pod \"simulator-w3-6c403f-kserve-59556b7fb8-vw5c8\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") " pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:18.840347 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.840302    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-6c403f\"/\"default-dockercfg-sj9g8\""
Nov 04 02:28:18.916236 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.916193    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-model-cache\") pod \"simulator-w3-6c403f-kserve-59556b7fb8-vw5c8\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") " pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:18.916448 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.916247    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-tmp-dir\") pod \"simulator-w3-6c403f-kserve-59556b7fb8-vw5c8\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") " pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:18.916448 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.916268    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-home\") pod \"simulator-w3-6c403f-kserve-59556b7fb8-vw5c8\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") " pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:18.916448 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.916301    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-dshm\") pod \"simulator-w3-6c403f-kserve-59556b7fb8-vw5c8\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") " pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:18.916448 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.916322    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq5f2\" (UniqueName: \"kubernetes.io/projected/e37c21b6-3bb6-441e-a559-012803d6ac6c-kube-api-access-jq5f2\") pod \"simulator-w3-6c403f-kserve-59556b7fb8-vw5c8\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") " pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:18.916448 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.916350    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e37c21b6-3bb6-441e-a559-012803d6ac6c-tls-certs\") pod \"simulator-w3-6c403f-kserve-59556b7fb8-vw5c8\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") " pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:18.916738 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.916714    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-model-cache\") pod \"simulator-w3-6c403f-kserve-59556b7fb8-vw5c8\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") " pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:18.916798 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.916760    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-tmp-dir\") pod \"simulator-w3-6c403f-kserve-59556b7fb8-vw5c8\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") " pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:18.916860 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.916827    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-home\") pod \"simulator-w3-6c403f-kserve-59556b7fb8-vw5c8\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") " pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:18.919048 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.919024    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-dshm\") pod \"simulator-w3-6c403f-kserve-59556b7fb8-vw5c8\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") " pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:18.919356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.919334    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e37c21b6-3bb6-441e-a559-012803d6ac6c-tls-certs\") pod \"simulator-w3-6c403f-kserve-59556b7fb8-vw5c8\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") " pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:18.978357 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:18.978317    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq5f2\" (UniqueName: \"kubernetes.io/projected/e37c21b6-3bb6-441e-a559-012803d6ac6c-kube-api-access-jq5f2\") pod \"simulator-w3-6c403f-kserve-59556b7fb8-vw5c8\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") " pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:19.048973 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:19.048886    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:19.441500 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:19.441472    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"]
Nov 04 02:28:19.443548 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:28:19.443518    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode37c21b6_3bb6_441e_a559_012803d6ac6c.slice/crio-efe86edf0b61e5998ebc52c34359bbb469b54db83e8081b406df083f27987d9c WatchSource:0}: Error finding container efe86edf0b61e5998ebc52c34359bbb469b54db83e8081b406df083f27987d9c: Status 404 returned error can't find the container with id efe86edf0b61e5998ebc52c34359bbb469b54db83e8081b406df083f27987d9c
Nov 04 02:28:20.299661 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:20.299630    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8" event={"ID":"e37c21b6-3bb6-441e-a559-012803d6ac6c","Type":"ContainerStarted","Data":"895ee3c12131633d7cd7a7746e4dd9560b14b0d5fa64d8d0da6e6af3ca04a573"}
Nov 04 02:28:20.300128 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:20.299670    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8" event={"ID":"e37c21b6-3bb6-441e-a559-012803d6ac6c","Type":"ContainerStarted","Data":"efe86edf0b61e5998ebc52c34359bbb469b54db83e8081b406df083f27987d9c"}
Nov 04 02:28:20.418360 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:20.418242    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8" podStartSLOduration=2.4182232089999998 podStartE2EDuration="2.418223209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:28:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:28:20.416873376 +0000 UTC m=+734.021886375" watchObservedRunningTime="2026-11-04 02:28:20.418223209 +0000 UTC m=+734.023236210"
Nov 04 02:28:21.049034 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:21.048996    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:21.307767 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:21.307667    4548 generic.go:356] "Generic (PLEG): container finished" podID="d7e95e09-f96e-4635-abe4-390c3fb16b6a" containerID="154ccfe24de71b145b60c2e40759e5a15d405c77a29201d7493a09036702a6a6" exitCode=0
Nov 04 02:28:21.307767 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:21.307743    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2" event={"ID":"d7e95e09-f96e-4635-abe4-390c3fb16b6a","Type":"ContainerDied","Data":"154ccfe24de71b145b60c2e40759e5a15d405c77a29201d7493a09036702a6a6"}
Nov 04 02:28:21.308228 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:21.308159    4548 scope.go:122] "RemoveContainer" containerID="154ccfe24de71b145b60c2e40759e5a15d405c77a29201d7493a09036702a6a6"
Nov 04 02:28:21.309606 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:21.309570    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:28:21.309696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:21.309642    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:28:21.309696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:21.309691    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:28:22.316669 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:22.316630    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2" event={"ID":"d7e95e09-f96e-4635-abe4-390c3fb16b6a","Type":"ContainerStarted","Data":"933aaa5c161baa6f6438081b90acb1fb2d5184bc270e3174bc0d17d2b2d2b174"}
Nov 04 02:28:23.037608 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:23.037560    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:28:23.038841 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:23.038811    4548 patch_prober.go:29] interesting pod/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Nov 04 02:28:23.038971 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:23.038868    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2" podUID="d7e95e09-f96e-4635-abe4-390c3fb16b6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Nov 04 02:28:24.037827 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:24.037785    4548 patch_prober.go:29] interesting pod/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Nov 04 02:28:24.038303 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:24.037860    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2" podUID="d7e95e09-f96e-4635-abe4-390c3fb16b6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Nov 04 02:28:24.678328 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:24.678286    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:28:25.037872 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:25.037831    4548 patch_prober.go:29] interesting pod/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Nov 04 02:28:25.038351 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:25.037889    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2" podUID="d7e95e09-f96e-4635-abe4-390c3fb16b6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Nov 04 02:28:26.038147 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:26.037792    4548 patch_prober.go:29] interesting pod/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Nov 04 02:28:26.038147 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:26.037855    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2" podUID="d7e95e09-f96e-4635-abe4-390c3fb16b6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Nov 04 02:28:27.037966 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:27.037934    4548 patch_prober.go:29] interesting pod/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Nov 04 02:28:27.038233 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:27.038211    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2" podUID="d7e95e09-f96e-4635-abe4-390c3fb16b6a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Nov 04 02:28:28.043303 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:28.043269    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:28:28.044347 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:28.044328    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:28:29.049263 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:29.049226    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:29.062427 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:29.062398    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:29.381269 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:29.381187    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:28:40.613345 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:28:40.613305    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:28:52.393221 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.393096    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"]
Nov 04 02:28:52.395915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.395876    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.466268 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.466230    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-home\") pod \"simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") " pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.466485 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.466296    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvwlz\" (UniqueName: \"kubernetes.io/projected/d2c71cff-3761-4b8a-8cc1-d14312051945-kube-api-access-rvwlz\") pod \"simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") " pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.466485 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.466408    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-model-cache\") pod \"simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") " pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.466605 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.466510    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-tmp-dir\") pod \"simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") " pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.466605 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.466547    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2c71cff-3761-4b8a-8cc1-d14312051945-tls-certs\") pod \"simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") " pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.466605 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.466595    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-dshm\") pod \"simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") " pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.499936 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.499898    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-a18c43\"/\"openshift-service-ca.crt\""
Nov 04 02:28:52.500248 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.499899    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-a18c43\"/\"kube-root-ca.crt\""
Nov 04 02:28:52.500361 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.499937    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-a18c43\"/\"simulator-w1-a18c43-kserve-self-signed-certs\""
Nov 04 02:28:52.500361 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.499937    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-a18c43\"/\"default-dockercfg-zbmrg\""
Nov 04 02:28:52.503128 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.503101    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"]
Nov 04 02:28:52.567585 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.567542    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-home\") pod \"simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") " pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.567798 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.567614    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvwlz\" (UniqueName: \"kubernetes.io/projected/d2c71cff-3761-4b8a-8cc1-d14312051945-kube-api-access-rvwlz\") pod \"simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") " pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.567798 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.567645    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-model-cache\") pod \"simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") " pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.567798 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.567673    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-tmp-dir\") pod \"simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") " pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.567798 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.567698    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2c71cff-3761-4b8a-8cc1-d14312051945-tls-certs\") pod \"simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") " pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.567798 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.567756    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-dshm\") pod \"simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") " pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.568113 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.568085    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-home\") pod \"simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") " pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.568206 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.568098    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-model-cache\") pod \"simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") " pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.568206 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.568151    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-tmp-dir\") pod \"simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") " pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.570327 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.570297    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-dshm\") pod \"simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") " pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.570605 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.570584    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2c71cff-3761-4b8a-8cc1-d14312051945-tls-certs\") pod \"simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") " pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.629327 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.629290    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvwlz\" (UniqueName: \"kubernetes.io/projected/d2c71cff-3761-4b8a-8cc1-d14312051945-kube-api-access-rvwlz\") pod \"simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") " pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:52.707468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:52.707375    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:28:53.088241 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:53.088211    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"]
Nov 04 02:28:53.090736 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:28:53.090708    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2c71cff_3761_4b8a_8cc1_d14312051945.slice/crio-710956d6a03663f062ccf18c2161731de4c4ca5638133c26884c1dd9f0a1d3fd WatchSource:0}: Error finding container 710956d6a03663f062ccf18c2161731de4c4ca5638133c26884c1dd9f0a1d3fd: Status 404 returned error can't find the container with id 710956d6a03663f062ccf18c2161731de4c4ca5638133c26884c1dd9f0a1d3fd
Nov 04 02:28:53.552861 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:53.552823    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz" event={"ID":"d2c71cff-3761-4b8a-8cc1-d14312051945","Type":"ContainerStarted","Data":"4d018e35bba4aa8402de58c9236ae49ac19711ba938680b5d6114ff4e7758f7a"}
Nov 04 02:28:53.553352 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:53.552879    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz" event={"ID":"d2c71cff-3761-4b8a-8cc1-d14312051945","Type":"ContainerStarted","Data":"710956d6a03663f062ccf18c2161731de4c4ca5638133c26884c1dd9f0a1d3fd"}
Nov 04 02:28:53.671735 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:53.671680    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz" podStartSLOduration=1.671664642 podStartE2EDuration="1.671664642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:28:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:28:53.670536796 +0000 UTC m=+767.275549794" watchObservedRunningTime="2026-11-04 02:28:53.671664642 +0000 UTC m=+767.276677639"
Nov 04 02:28:53.707949 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:28:53.707903    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:29:02.707700 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:02.707657    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:29:02.720698 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:02.720666    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:29:03.633226 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:03.633195    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:29:10.611881 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:29:10.611839    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:29:17.074004 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.073963    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"]
Nov 04 02:29:17.077314 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.077288    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.144343 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.144293    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-dshm\") pod \"premium-w3-6c403f-kserve-7677d7bd4f-zch4s\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") " pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.144548 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.144412    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-model-cache\") pod \"premium-w3-6c403f-kserve-7677d7bd4f-zch4s\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") " pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.144548 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.144442    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j88v7\" (UniqueName: \"kubernetes.io/projected/45e794f5-9772-4b3f-93e9-a968d32239cd-kube-api-access-j88v7\") pod \"premium-w3-6c403f-kserve-7677d7bd4f-zch4s\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") " pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.144629 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.144562    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-tmp-dir\") pod \"premium-w3-6c403f-kserve-7677d7bd4f-zch4s\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") " pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.144629 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.144609    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-home\") pod \"premium-w3-6c403f-kserve-7677d7bd4f-zch4s\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") " pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.144716 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.144628    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45e794f5-9772-4b3f-93e9-a968d32239cd-tls-certs\") pod \"premium-w3-6c403f-kserve-7677d7bd4f-zch4s\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") " pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.180349 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.180312    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w3-6c403f\"/\"premium-w3-6c403f-kserve-self-signed-certs\""
Nov 04 02:29:17.183183 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.183131    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"]
Nov 04 02:29:17.245504 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.245472    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-dshm\") pod \"premium-w3-6c403f-kserve-7677d7bd4f-zch4s\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") " pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.245504 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.245522    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-model-cache\") pod \"premium-w3-6c403f-kserve-7677d7bd4f-zch4s\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") " pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.245800 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.245540    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j88v7\" (UniqueName: \"kubernetes.io/projected/45e794f5-9772-4b3f-93e9-a968d32239cd-kube-api-access-j88v7\") pod \"premium-w3-6c403f-kserve-7677d7bd4f-zch4s\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") " pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.245800 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.245593    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-tmp-dir\") pod \"premium-w3-6c403f-kserve-7677d7bd4f-zch4s\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") " pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.245800 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.245642    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-home\") pod \"premium-w3-6c403f-kserve-7677d7bd4f-zch4s\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") " pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.245800 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.245785    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45e794f5-9772-4b3f-93e9-a968d32239cd-tls-certs\") pod \"premium-w3-6c403f-kserve-7677d7bd4f-zch4s\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") " pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.246079 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.246039    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-model-cache\") pod \"premium-w3-6c403f-kserve-7677d7bd4f-zch4s\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") " pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.246079 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.246067    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-tmp-dir\") pod \"premium-w3-6c403f-kserve-7677d7bd4f-zch4s\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") " pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.246279 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.246140    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-home\") pod \"premium-w3-6c403f-kserve-7677d7bd4f-zch4s\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") " pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.248107 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.248086    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-dshm\") pod \"premium-w3-6c403f-kserve-7677d7bd4f-zch4s\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") " pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.248468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.248450    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45e794f5-9772-4b3f-93e9-a968d32239cd-tls-certs\") pod \"premium-w3-6c403f-kserve-7677d7bd4f-zch4s\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") " pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.319471 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.319438    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j88v7\" (UniqueName: \"kubernetes.io/projected/45e794f5-9772-4b3f-93e9-a968d32239cd-kube-api-access-j88v7\") pod \"premium-w3-6c403f-kserve-7677d7bd4f-zch4s\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") " pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.388433 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.388330    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:17.772052 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:17.772022    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"]
Nov 04 02:29:17.773862 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:29:17.773830    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod45e794f5_9772_4b3f_93e9_a968d32239cd.slice/crio-289470ab0c67f5192bba05382d66cd5b6b87b989a08b86329c93b1321150bf64 WatchSource:0}: Error finding container 289470ab0c67f5192bba05382d66cd5b6b87b989a08b86329c93b1321150bf64: Status 404 returned error can't find the container with id 289470ab0c67f5192bba05382d66cd5b6b87b989a08b86329c93b1321150bf64
Nov 04 02:29:18.718089 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:18.718050    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s" event={"ID":"45e794f5-9772-4b3f-93e9-a968d32239cd","Type":"ContainerStarted","Data":"1d62733c24748155f043b8e1716e83f041f4ea83c08969ce41212f5c11304af9"}
Nov 04 02:29:18.718553 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:18.718101    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s" event={"ID":"45e794f5-9772-4b3f-93e9-a968d32239cd","Type":"ContainerStarted","Data":"289470ab0c67f5192bba05382d66cd5b6b87b989a08b86329c93b1321150bf64"}
Nov 04 02:29:18.838079 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:18.838023    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s" podStartSLOduration=1.838009478 podStartE2EDuration="1.838009478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:29:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:29:18.835907419 +0000 UTC m=+792.440920418" watchObservedRunningTime="2026-11-04 02:29:18.838009478 +0000 UTC m=+792.443022515"
Nov 04 02:29:19.389495 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:19.389447    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:27.388913 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:27.388865    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:27.402431 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:27.402396    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:27.794802 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:27.794771    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:29:32.684894 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.680319    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"]
Nov 04 02:29:32.686142 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.686111    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:32.723629 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.723590    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-tls-certs\") pod \"premium-w2-1e4f1e-kserve-5f794bc898-s4874\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") " pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:32.723813 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.723654    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-tmp-dir\") pod \"premium-w2-1e4f1e-kserve-5f794bc898-s4874\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") " pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:32.723813 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.723749    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-dshm\") pod \"premium-w2-1e4f1e-kserve-5f794bc898-s4874\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") " pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:32.723892 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.723846    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-model-cache\") pod \"premium-w2-1e4f1e-kserve-5f794bc898-s4874\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") " pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:32.723929 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.723888    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-home\") pod \"premium-w2-1e4f1e-kserve-5f794bc898-s4874\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") " pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:32.723929 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.723918    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2ts4\" (UniqueName: \"kubernetes.io/projected/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-kube-api-access-s2ts4\") pod \"premium-w2-1e4f1e-kserve-5f794bc898-s4874\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") " pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:32.738486 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.738446    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"]
Nov 04 02:29:32.785143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.785108    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-1e4f1e\"/\"openshift-service-ca.crt\""
Nov 04 02:29:32.785143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.785108    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-1e4f1e\"/\"default-dockercfg-r8j7p\""
Nov 04 02:29:32.785409 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.785229    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-1e4f1e\"/\"premium-w2-1e4f1e-kserve-self-signed-certs\""
Nov 04 02:29:32.789398 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.789359    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w2-1e4f1e\"/\"kube-root-ca.crt\""
Nov 04 02:29:32.827611 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.827533    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-tls-certs\") pod \"premium-w2-1e4f1e-kserve-5f794bc898-s4874\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") " pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:32.828743 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.828294    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-tmp-dir\") pod \"premium-w2-1e4f1e-kserve-5f794bc898-s4874\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") " pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:32.829486 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.829463    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-dshm\") pod \"premium-w2-1e4f1e-kserve-5f794bc898-s4874\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") " pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:32.829877 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.829859    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-model-cache\") pod \"premium-w2-1e4f1e-kserve-5f794bc898-s4874\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") " pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:32.830202 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.830182    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-home\") pod \"premium-w2-1e4f1e-kserve-5f794bc898-s4874\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") " pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:32.830452 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.830433    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2ts4\" (UniqueName: \"kubernetes.io/projected/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-kube-api-access-s2ts4\") pod \"premium-w2-1e4f1e-kserve-5f794bc898-s4874\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") " pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:32.833855 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.833829    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-tmp-dir\") pod \"premium-w2-1e4f1e-kserve-5f794bc898-s4874\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") " pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:32.838316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.838284    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-home\") pod \"premium-w2-1e4f1e-kserve-5f794bc898-s4874\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") " pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:32.838679 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.838604    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-model-cache\") pod \"premium-w2-1e4f1e-kserve-5f794bc898-s4874\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") " pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:32.842949 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.842903    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-tls-certs\") pod \"premium-w2-1e4f1e-kserve-5f794bc898-s4874\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") " pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:32.843651 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.843421    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-dshm\") pod \"premium-w2-1e4f1e-kserve-5f794bc898-s4874\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") " pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:32.892670 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:32.892635    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2ts4\" (UniqueName: \"kubernetes.io/projected/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-kube-api-access-s2ts4\") pod \"premium-w2-1e4f1e-kserve-5f794bc898-s4874\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") " pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:33.000875 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:33.000774    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:33.414500 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:33.414476    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"]
Nov 04 02:29:33.416929 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:29:33.416899    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a38c5ae_db84_40c1_bb28_e7f7e7842b4a.slice/crio-b2d00f1a586703c84a07a6cc21071f3c32c0d169ccae47d60eec504a8d493531 WatchSource:0}: Error finding container b2d00f1a586703c84a07a6cc21071f3c32c0d169ccae47d60eec504a8d493531: Status 404 returned error can't find the container with id b2d00f1a586703c84a07a6cc21071f3c32c0d169ccae47d60eec504a8d493531
Nov 04 02:29:33.846031 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:33.845990    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874" event={"ID":"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a","Type":"ContainerStarted","Data":"fa25256ad34b502006b026966d79aa65ec72ec9c90e92f823b57d83acfed95c1"}
Nov 04 02:29:33.846577 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:33.846044    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874" event={"ID":"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a","Type":"ContainerStarted","Data":"b2d00f1a586703c84a07a6cc21071f3c32c0d169ccae47d60eec504a8d493531"}
Nov 04 02:29:33.968032 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:33.967972    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874" podStartSLOduration=1.9679564790000001 podStartE2EDuration="1.967956479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:29:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:29:33.964994356 +0000 UTC m=+807.570007355" watchObservedRunningTime="2026-11-04 02:29:33.967956479 +0000 UTC m=+807.572969477"
Nov 04 02:29:34.001966 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:34.001929    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:40.613031 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:29:40.612990    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:29:43.001980 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:43.001936    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:43.015206 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:43.015158    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:29:43.924308 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:29:43.924274    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:30:00.174709 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.174673    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm"]
Nov 04 02:30:00.181643 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.181454    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4"]
Nov 04 02:30:00.182198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.182152    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm"
Nov 04 02:30:00.189522 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.189484    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4"
Nov 04 02:30:00.189736 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.189698    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp"]
Nov 04 02:30:00.195857 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.195570    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp"
Nov 04 02:30:00.224250 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.224216    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd"]
Nov 04 02:30:00.228244 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.228215    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd"
Nov 04 02:30:00.237145 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.237122    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:30:00.238409 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.238389    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:30:00.238506 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.238486    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:30:00.270289 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.269383    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/979e8367-67d1-47ba-9d7f-4e09f103b338-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd\" (UID: \"979e8367-67d1-47ba-9d7f-4e09f103b338\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd"
Nov 04 02:30:00.270289 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.269433    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/290af1e9-f6e3-4aff-bb15-a1d8cc74f321-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp\" (UID: \"290af1e9-f6e3-4aff-bb15-a1d8cc74f321\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp"
Nov 04 02:30:00.270289 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.269486    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjbpm\" (UniqueName: \"kubernetes.io/projected/290af1e9-f6e3-4aff-bb15-a1d8cc74f321-kube-api-access-wjbpm\") pod \"maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp\" (UID: \"290af1e9-f6e3-4aff-bb15-a1d8cc74f321\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp"
Nov 04 02:30:00.270289 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.269538    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqcqz\" (UniqueName: \"kubernetes.io/projected/979e8367-67d1-47ba-9d7f-4e09f103b338-kube-api-access-gqcqz\") pod \"maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd\" (UID: \"979e8367-67d1-47ba-9d7f-4e09f103b338\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd"
Nov 04 02:30:00.270289 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.269581    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f79d8da4-5f2c-4c98-8795-3354cc665ac6-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4\" (UID: \"f79d8da4-5f2c-4c98-8795-3354cc665ac6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4"
Nov 04 02:30:00.270289 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.269608    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gldvt\" (UniqueName: \"kubernetes.io/projected/f79d8da4-5f2c-4c98-8795-3354cc665ac6-kube-api-access-gldvt\") pod \"maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4\" (UID: \"f79d8da4-5f2c-4c98-8795-3354cc665ac6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4"
Nov 04 02:30:00.270289 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.269720    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04a4212a-4979-49c1-82a5-9ae939c6ef7c-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm\" (UID: \"04a4212a-4979-49c1-82a5-9ae939c6ef7c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm"
Nov 04 02:30:00.270289 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.269747    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bzsj\" (UniqueName: \"kubernetes.io/projected/04a4212a-4979-49c1-82a5-9ae939c6ef7c-kube-api-access-7bzsj\") pod \"maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm\" (UID: \"04a4212a-4979-49c1-82a5-9ae939c6ef7c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm"
Nov 04 02:30:00.276062 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.276017    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4"]
Nov 04 02:30:00.291898 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.291858    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm"]
Nov 04 02:30:00.296714 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.296678    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd"]
Nov 04 02:30:00.339816 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.339779    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp"]
Nov 04 02:30:00.370755 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.370712    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/979e8367-67d1-47ba-9d7f-4e09f103b338-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd\" (UID: \"979e8367-67d1-47ba-9d7f-4e09f103b338\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd"
Nov 04 02:30:00.371009 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.370987    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/290af1e9-f6e3-4aff-bb15-a1d8cc74f321-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp\" (UID: \"290af1e9-f6e3-4aff-bb15-a1d8cc74f321\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp"
Nov 04 02:30:00.371209 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.371053    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjbpm\" (UniqueName: \"kubernetes.io/projected/290af1e9-f6e3-4aff-bb15-a1d8cc74f321-kube-api-access-wjbpm\") pod \"maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp\" (UID: \"290af1e9-f6e3-4aff-bb15-a1d8cc74f321\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp"
Nov 04 02:30:00.371209 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.371112    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqcqz\" (UniqueName: \"kubernetes.io/projected/979e8367-67d1-47ba-9d7f-4e09f103b338-kube-api-access-gqcqz\") pod \"maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd\" (UID: \"979e8367-67d1-47ba-9d7f-4e09f103b338\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd"
Nov 04 02:30:00.371209 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.371160    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f79d8da4-5f2c-4c98-8795-3354cc665ac6-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4\" (UID: \"f79d8da4-5f2c-4c98-8795-3354cc665ac6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4"
Nov 04 02:30:00.371377 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.371218    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gldvt\" (UniqueName: \"kubernetes.io/projected/f79d8da4-5f2c-4c98-8795-3354cc665ac6-kube-api-access-gldvt\") pod \"maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4\" (UID: \"f79d8da4-5f2c-4c98-8795-3354cc665ac6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4"
Nov 04 02:30:00.371377 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.371352    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04a4212a-4979-49c1-82a5-9ae939c6ef7c-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm\" (UID: \"04a4212a-4979-49c1-82a5-9ae939c6ef7c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm"
Nov 04 02:30:00.371477 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.371385    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bzsj\" (UniqueName: \"kubernetes.io/projected/04a4212a-4979-49c1-82a5-9ae939c6ef7c-kube-api-access-7bzsj\") pod \"maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm\" (UID: \"04a4212a-4979-49c1-82a5-9ae939c6ef7c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm"
Nov 04 02:30:00.371661 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.371630    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/979e8367-67d1-47ba-9d7f-4e09f103b338-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd\" (UID: \"979e8367-67d1-47ba-9d7f-4e09f103b338\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd"
Nov 04 02:30:00.372354 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.372329    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f79d8da4-5f2c-4c98-8795-3354cc665ac6-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4\" (UID: \"f79d8da4-5f2c-4c98-8795-3354cc665ac6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4"
Nov 04 02:30:00.372479 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.372458    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04a4212a-4979-49c1-82a5-9ae939c6ef7c-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm\" (UID: \"04a4212a-4979-49c1-82a5-9ae939c6ef7c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm"
Nov 04 02:30:00.372659 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.372636    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/290af1e9-f6e3-4aff-bb15-a1d8cc74f321-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp\" (UID: \"290af1e9-f6e3-4aff-bb15-a1d8cc74f321\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp"
Nov 04 02:30:00.434002 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.433922    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqcqz\" (UniqueName: \"kubernetes.io/projected/979e8367-67d1-47ba-9d7f-4e09f103b338-kube-api-access-gqcqz\") pod \"maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd\" (UID: \"979e8367-67d1-47ba-9d7f-4e09f103b338\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd"
Nov 04 02:30:00.434002 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.433931    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bzsj\" (UniqueName: \"kubernetes.io/projected/04a4212a-4979-49c1-82a5-9ae939c6ef7c-kube-api-access-7bzsj\") pod \"maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm\" (UID: \"04a4212a-4979-49c1-82a5-9ae939c6ef7c\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm"
Nov 04 02:30:00.434233 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.434023    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjbpm\" (UniqueName: \"kubernetes.io/projected/290af1e9-f6e3-4aff-bb15-a1d8cc74f321-kube-api-access-wjbpm\") pod \"maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp\" (UID: \"290af1e9-f6e3-4aff-bb15-a1d8cc74f321\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp"
Nov 04 02:30:00.434278 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.434222    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gldvt\" (UniqueName: \"kubernetes.io/projected/f79d8da4-5f2c-4c98-8795-3354cc665ac6-kube-api-access-gldvt\") pod \"maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4\" (UID: \"f79d8da4-5f2c-4c98-8795-3354cc665ac6\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4"
Nov 04 02:30:00.507307 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.507255    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm"
Nov 04 02:30:00.516986 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.516954    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4"
Nov 04 02:30:00.524016 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.523987    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp"
Nov 04 02:30:00.541985 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.541946    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd"
Nov 04 02:30:00.912538 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.912510    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm"]
Nov 04 02:30:00.914323 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:30:00.914288    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04a4212a_4979_49c1_82a5_9ae939c6ef7c.slice/crio-c6b063d9f215acc85eb9428968759685dbab9d1859176ca262b8b00b608fd5f7 WatchSource:0}: Error finding container c6b063d9f215acc85eb9428968759685dbab9d1859176ca262b8b00b608fd5f7: Status 404 returned error can't find the container with id c6b063d9f215acc85eb9428968759685dbab9d1859176ca262b8b00b608fd5f7
Nov 04 02:30:00.959393 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.958995    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4"]
Nov 04 02:30:00.963642 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.963612    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp"]
Nov 04 02:30:00.973518 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:30:00.973491    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod290af1e9_f6e3_4aff_bb15_a1d8cc74f321.slice/crio-8000ae1ed91b3e5687ec3d9da6267eb784e290049627ce151e9eb7185108b608 WatchSource:0}: Error finding container 8000ae1ed91b3e5687ec3d9da6267eb784e290049627ce151e9eb7185108b608: Status 404 returned error can't find the container with id 8000ae1ed91b3e5687ec3d9da6267eb784e290049627ce151e9eb7185108b608
Nov 04 02:30:00.995446 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:00.995420    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd"]
Nov 04 02:30:00.997550 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:30:00.997522    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod979e8367_67d1_47ba_9d7f_4e09f103b338.slice/crio-4162bb5fd76151fd5ec67d97277fbfa874f7bdf64398ec3a5e9e68958464020c WatchSource:0}: Error finding container 4162bb5fd76151fd5ec67d97277fbfa874f7bdf64398ec3a5e9e68958464020c: Status 404 returned error can't find the container with id 4162bb5fd76151fd5ec67d97277fbfa874f7bdf64398ec3a5e9e68958464020c
Nov 04 02:30:01.023336 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:01.023294    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm" event={"ID":"04a4212a-4979-49c1-82a5-9ae939c6ef7c","Type":"ContainerStarted","Data":"c6b063d9f215acc85eb9428968759685dbab9d1859176ca262b8b00b608fd5f7"}
Nov 04 02:30:01.024713 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:01.024680    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4" event={"ID":"f79d8da4-5f2c-4c98-8795-3354cc665ac6","Type":"ContainerStarted","Data":"1e886a830b6400921b36530d9df67338ece0b8ae0d247187cd36f1be61517b84"}
Nov 04 02:30:01.025956 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:01.025926    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp" event={"ID":"290af1e9-f6e3-4aff-bb15-a1d8cc74f321","Type":"ContainerStarted","Data":"8000ae1ed91b3e5687ec3d9da6267eb784e290049627ce151e9eb7185108b608"}
Nov 04 02:30:01.027085 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:01.027061    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd" event={"ID":"979e8367-67d1-47ba-9d7f-4e09f103b338","Type":"ContainerStarted","Data":"4162bb5fd76151fd5ec67d97277fbfa874f7bdf64398ec3a5e9e68958464020c"}
Nov 04 02:30:07.075661 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:07.075570    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp" event={"ID":"290af1e9-f6e3-4aff-bb15-a1d8cc74f321","Type":"ContainerStarted","Data":"257fd29aeb51765b2d11dd81c5d511d4bd6a73930776ea3dbbb06075b2b7391c"}
Nov 04 02:30:07.077797 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:07.077753    4548 generic.go:356] "Generic (PLEG): container finished" podID="979e8367-67d1-47ba-9d7f-4e09f103b338" containerID="cd6f52c8483f92a7d639a277faaf5d893c099091e7f4a0f6e9d82b7e0b730691" exitCode=60
Nov 04 02:30:07.077958 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:07.077889    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd" event={"ID":"979e8367-67d1-47ba-9d7f-4e09f103b338","Type":"ContainerDied","Data":"cd6f52c8483f92a7d639a277faaf5d893c099091e7f4a0f6e9d82b7e0b730691"}
Nov 04 02:30:07.078188 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:07.078147    4548 scope.go:122] "RemoveContainer" containerID="cd6f52c8483f92a7d639a277faaf5d893c099091e7f4a0f6e9d82b7e0b730691"
Nov 04 02:30:07.080012 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:07.079934    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm" event={"ID":"04a4212a-4979-49c1-82a5-9ae939c6ef7c","Type":"ContainerStarted","Data":"3768eefdedbad46f9064ac8f9bda69eadce10a3be8f0ac38b9214b9b73106ca1"}
Nov 04 02:30:07.193817 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:07.193763    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp" podStartSLOduration=2.042631011 podStartE2EDuration="7.193747736s" totalImagesPullingTime="5.151116725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:30:07.191574058 +0000 UTC m=+840.796587054" watchObservedRunningTime="2026-11-04 02:30:07.193747736 +0000 UTC m=+840.798760734"
Nov 04 02:30:07.309201 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:07.309116    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm" podStartSLOduration=2.053837324 podStartE2EDuration="7.309097225s" totalImagesPullingTime="5.255259901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:30:07.307524006 +0000 UTC m=+840.912537005" watchObservedRunningTime="2026-11-04 02:30:07.309097225 +0000 UTC m=+840.914110263"
Nov 04 02:30:08.088392 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:08.088354    4548 generic.go:356] "Generic (PLEG): container finished" podID="979e8367-67d1-47ba-9d7f-4e09f103b338" containerID="d187ded8957824142545269de8c645d6bfe2371f1fe9487507ebd35df44a15b1" exitCode=60
Nov 04 02:30:08.088843 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:08.088433    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd" event={"ID":"979e8367-67d1-47ba-9d7f-4e09f103b338","Type":"ContainerDied","Data":"d187ded8957824142545269de8c645d6bfe2371f1fe9487507ebd35df44a15b1"}
Nov 04 02:30:08.088843 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:08.088494    4548 scope.go:122] "RemoveContainer" containerID="cd6f52c8483f92a7d639a277faaf5d893c099091e7f4a0f6e9d82b7e0b730691"
Nov 04 02:30:08.088843 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:08.088744    4548 scope.go:122] "RemoveContainer" containerID="d187ded8957824142545269de8c645d6bfe2371f1fe9487507ebd35df44a15b1"
Nov 04 02:30:08.089080 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:30:08.089061    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd_odh-ai-gateway-infra(979e8367-67d1-47ba-9d7f-4e09f103b338)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd" podUID="979e8367-67d1-47ba-9d7f-4e09f103b338"
Nov 04 02:30:08.090198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:08.090158    4548 generic.go:356] "Generic (PLEG): container finished" podID="04a4212a-4979-49c1-82a5-9ae939c6ef7c" containerID="3768eefdedbad46f9064ac8f9bda69eadce10a3be8f0ac38b9214b9b73106ca1" exitCode=60
Nov 04 02:30:08.090312 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:08.090200    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm" event={"ID":"04a4212a-4979-49c1-82a5-9ae939c6ef7c","Type":"ContainerDied","Data":"3768eefdedbad46f9064ac8f9bda69eadce10a3be8f0ac38b9214b9b73106ca1"}
Nov 04 02:30:08.090757 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:08.090521    4548 scope.go:122] "RemoveContainer" containerID="3768eefdedbad46f9064ac8f9bda69eadce10a3be8f0ac38b9214b9b73106ca1"
Nov 04 02:30:08.092093 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:08.092006    4548 generic.go:356] "Generic (PLEG): container finished" podID="290af1e9-f6e3-4aff-bb15-a1d8cc74f321" containerID="257fd29aeb51765b2d11dd81c5d511d4bd6a73930776ea3dbbb06075b2b7391c" exitCode=60
Nov 04 02:30:08.092093 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:08.092047    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp" event={"ID":"290af1e9-f6e3-4aff-bb15-a1d8cc74f321","Type":"ContainerDied","Data":"257fd29aeb51765b2d11dd81c5d511d4bd6a73930776ea3dbbb06075b2b7391c"}
Nov 04 02:30:08.092579 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:08.092339    4548 scope.go:122] "RemoveContainer" containerID="257fd29aeb51765b2d11dd81c5d511d4bd6a73930776ea3dbbb06075b2b7391c"
Nov 04 02:30:09.100201 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:09.100140    4548 generic.go:356] "Generic (PLEG): container finished" podID="290af1e9-f6e3-4aff-bb15-a1d8cc74f321" containerID="46dcbe8240bc751d2fbfe6e667b82a5b77f0cdbc983f7e1ce5d185d758a63c39" exitCode=60
Nov 04 02:30:09.100633 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:09.100201    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp" event={"ID":"290af1e9-f6e3-4aff-bb15-a1d8cc74f321","Type":"ContainerDied","Data":"46dcbe8240bc751d2fbfe6e667b82a5b77f0cdbc983f7e1ce5d185d758a63c39"}
Nov 04 02:30:09.100633 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:09.100270    4548 scope.go:122] "RemoveContainer" containerID="257fd29aeb51765b2d11dd81c5d511d4bd6a73930776ea3dbbb06075b2b7391c"
Nov 04 02:30:09.100633 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:09.100568    4548 scope.go:122] "RemoveContainer" containerID="46dcbe8240bc751d2fbfe6e667b82a5b77f0cdbc983f7e1ce5d185d758a63c39"
Nov 04 02:30:09.100912 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:30:09.100889    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp_odh-ai-gateway-infra(290af1e9-f6e3-4aff-bb15-a1d8cc74f321)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp" podUID="290af1e9-f6e3-4aff-bb15-a1d8cc74f321"
Nov 04 02:30:09.102477 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:09.102453    4548 scope.go:122] "RemoveContainer" containerID="d187ded8957824142545269de8c645d6bfe2371f1fe9487507ebd35df44a15b1"
Nov 04 02:30:09.102755 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:30:09.102736    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd_odh-ai-gateway-infra(979e8367-67d1-47ba-9d7f-4e09f103b338)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd" podUID="979e8367-67d1-47ba-9d7f-4e09f103b338"
Nov 04 02:30:09.104710 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:09.104682    4548 generic.go:356] "Generic (PLEG): container finished" podID="04a4212a-4979-49c1-82a5-9ae939c6ef7c" containerID="83afe2f113e7cb62202c3a9330e9479bf8fbc0752eb2195b61450dbcbac2e306" exitCode=60
Nov 04 02:30:09.104848 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:09.104760    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm" event={"ID":"04a4212a-4979-49c1-82a5-9ae939c6ef7c","Type":"ContainerDied","Data":"83afe2f113e7cb62202c3a9330e9479bf8fbc0752eb2195b61450dbcbac2e306"}
Nov 04 02:30:09.105254 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:09.105234    4548 scope.go:122] "RemoveContainer" containerID="83afe2f113e7cb62202c3a9330e9479bf8fbc0752eb2195b61450dbcbac2e306"
Nov 04 02:30:09.105579 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:30:09.105556    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm_odh-ai-gateway-infra(04a4212a-4979-49c1-82a5-9ae939c6ef7c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm" podUID="04a4212a-4979-49c1-82a5-9ae939c6ef7c"
Nov 04 02:30:09.113413 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:09.113385    4548 scope.go:122] "RemoveContainer" containerID="3768eefdedbad46f9064ac8f9bda69eadce10a3be8f0ac38b9214b9b73106ca1"
Nov 04 02:30:10.113119 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:10.113085    4548 scope.go:122] "RemoveContainer" containerID="83afe2f113e7cb62202c3a9330e9479bf8fbc0752eb2195b61450dbcbac2e306"
Nov 04 02:30:10.113651 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:30:10.113421    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm_odh-ai-gateway-infra(04a4212a-4979-49c1-82a5-9ae939c6ef7c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm" podUID="04a4212a-4979-49c1-82a5-9ae939c6ef7c"
Nov 04 02:30:10.115199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:10.115155    4548 scope.go:122] "RemoveContainer" containerID="46dcbe8240bc751d2fbfe6e667b82a5b77f0cdbc983f7e1ce5d185d758a63c39"
Nov 04 02:30:10.115454 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:30:10.115435    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp_odh-ai-gateway-infra(290af1e9-f6e3-4aff-bb15-a1d8cc74f321)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp" podUID="290af1e9-f6e3-4aff-bb15-a1d8cc74f321"
Nov 04 02:30:10.612412 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:30:10.612373    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:30:14.145147 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:14.145110    4548 generic.go:356] "Generic (PLEG): container finished" podID="f79d8da4-5f2c-4c98-8795-3354cc665ac6" containerID="5271db1975efe7033200b8b0fa0fdbc9dc0c47f6e9a831c26a4c014b722e1ef3" exitCode=60
Nov 04 02:30:14.145650 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:14.145203    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4" event={"ID":"f79d8da4-5f2c-4c98-8795-3354cc665ac6","Type":"ContainerDied","Data":"5271db1975efe7033200b8b0fa0fdbc9dc0c47f6e9a831c26a4c014b722e1ef3"}
Nov 04 02:30:14.145650 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:14.145506    4548 scope.go:122] "RemoveContainer" containerID="5271db1975efe7033200b8b0fa0fdbc9dc0c47f6e9a831c26a4c014b722e1ef3"
Nov 04 02:30:15.155758 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:15.155716    4548 generic.go:356] "Generic (PLEG): container finished" podID="f79d8da4-5f2c-4c98-8795-3354cc665ac6" containerID="f7113fb9c001a721f0da478171d2113abe97886701ef4467744518b2325e8e39" exitCode=60
Nov 04 02:30:15.156271 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:15.155798    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4" event={"ID":"f79d8da4-5f2c-4c98-8795-3354cc665ac6","Type":"ContainerDied","Data":"f7113fb9c001a721f0da478171d2113abe97886701ef4467744518b2325e8e39"}
Nov 04 02:30:15.156271 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:15.155876    4548 scope.go:122] "RemoveContainer" containerID="5271db1975efe7033200b8b0fa0fdbc9dc0c47f6e9a831c26a4c014b722e1ef3"
Nov 04 02:30:15.156271 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:15.156138    4548 scope.go:122] "RemoveContainer" containerID="f7113fb9c001a721f0da478171d2113abe97886701ef4467744518b2325e8e39"
Nov 04 02:30:15.156478 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:30:15.156456    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4_odh-ai-gateway-infra(f79d8da4-5f2c-4c98-8795-3354cc665ac6)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4" podUID="f79d8da4-5f2c-4c98-8795-3354cc665ac6"
Nov 04 02:30:16.165645 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:16.165600    4548 scope.go:122] "RemoveContainer" containerID="f7113fb9c001a721f0da478171d2113abe97886701ef4467744518b2325e8e39"
Nov 04 02:30:16.166136 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:30:16.165991    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4_odh-ai-gateway-infra(f79d8da4-5f2c-4c98-8795-3354cc665ac6)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4" podUID="f79d8da4-5f2c-4c98-8795-3354cc665ac6"
Nov 04 02:30:20.525182 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:20.525138    4548 scope.go:122] "RemoveContainer" containerID="83afe2f113e7cb62202c3a9330e9479bf8fbc0752eb2195b61450dbcbac2e306"
Nov 04 02:30:20.525617 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:20.525380    4548 scope.go:122] "RemoveContainer" containerID="d187ded8957824142545269de8c645d6bfe2371f1fe9487507ebd35df44a15b1"
Nov 04 02:30:21.200999 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:21.200960    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd" event={"ID":"979e8367-67d1-47ba-9d7f-4e09f103b338","Type":"ContainerStarted","Data":"bb333193b90e07e5ab45faf0085ee0945e5767237ba2ec9fccc7d17ff3521cea"}
Nov 04 02:30:21.203075 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:21.203043    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm" event={"ID":"04a4212a-4979-49c1-82a5-9ae939c6ef7c","Type":"ContainerStarted","Data":"da0a9fa86e3c2adfa8aeafd068b55a97a5f658e1dc3d2e6c974084e690a70b01"}
Nov 04 02:30:21.318102 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:21.318039    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd" podStartSLOduration=16.391484026 podStartE2EDuration="21.318025537s" totalImagesPullingTime="4.926541511s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:30:21.317075845 +0000 UTC m=+854.922088843" watchObservedRunningTime="2026-11-04 02:30:21.318025537 +0000 UTC m=+854.923038586"
Nov 04 02:30:21.517511 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:21.517480    4548 scope.go:122] "RemoveContainer" containerID="46dcbe8240bc751d2fbfe6e667b82a5b77f0cdbc983f7e1ce5d185d758a63c39"
Nov 04 02:30:22.106895 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.106846    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"]
Nov 04 02:30:22.111440 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.111409    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.164743 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.164347    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-2ba6b8\"/\"kube-root-ca.crt\""
Nov 04 02:30:22.164743 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.164410    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-2ba6b8\"/\"openshift-service-ca.crt\""
Nov 04 02:30:22.166621 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.166567    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"]
Nov 04 02:30:22.166865 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.166840    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-2ba6b8\"/\"default-dockercfg-qxp8p\""
Nov 04 02:30:22.189369 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.189328    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-model-cache\") pod \"premium-w0-2ba6b8-kserve-c6d479c85-56k5z\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") " pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.189568 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.189377    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-tmp-dir\") pod \"premium-w0-2ba6b8-kserve-c6d479c85-56k5z\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") " pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.189568 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.189500    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-dshm\") pod \"premium-w0-2ba6b8-kserve-c6d479c85-56k5z\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") " pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.189691 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.189577    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hg46x\" (UniqueName: \"kubernetes.io/projected/eda062bb-6f3f-44d9-aea9-2e58c7c22190-kube-api-access-hg46x\") pod \"premium-w0-2ba6b8-kserve-c6d479c85-56k5z\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") " pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.189744 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.189707    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-home\") pod \"premium-w0-2ba6b8-kserve-c6d479c85-56k5z\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") " pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.189901 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.189878    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eda062bb-6f3f-44d9-aea9-2e58c7c22190-tls-certs\") pod \"premium-w0-2ba6b8-kserve-c6d479c85-56k5z\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") " pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.211378 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.211342    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-2ba6b8\"/\"premium-w0-2ba6b8-kserve-self-signed-certs\""
Nov 04 02:30:22.219688 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.219645    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp" event={"ID":"290af1e9-f6e3-4aff-bb15-a1d8cc74f321","Type":"ContainerStarted","Data":"b045e770055552ef26477e6854e669a4679fcbaf20d4641363821ffa04f8a742"}
Nov 04 02:30:22.221767 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.221738    4548 generic.go:356] "Generic (PLEG): container finished" podID="979e8367-67d1-47ba-9d7f-4e09f103b338" containerID="bb333193b90e07e5ab45faf0085ee0945e5767237ba2ec9fccc7d17ff3521cea" exitCode=60
Nov 04 02:30:22.221953 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.221808    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd" event={"ID":"979e8367-67d1-47ba-9d7f-4e09f103b338","Type":"ContainerDied","Data":"bb333193b90e07e5ab45faf0085ee0945e5767237ba2ec9fccc7d17ff3521cea"}
Nov 04 02:30:22.221953 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.221888    4548 scope.go:122] "RemoveContainer" containerID="d187ded8957824142545269de8c645d6bfe2371f1fe9487507ebd35df44a15b1"
Nov 04 02:30:22.222258 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.222239    4548 scope.go:122] "RemoveContainer" containerID="bb333193b90e07e5ab45faf0085ee0945e5767237ba2ec9fccc7d17ff3521cea"
Nov 04 02:30:22.222575 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:30:22.222548    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd_odh-ai-gateway-infra(979e8367-67d1-47ba-9d7f-4e09f103b338)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd" podUID="979e8367-67d1-47ba-9d7f-4e09f103b338"
Nov 04 02:30:22.224079 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.224059    4548 generic.go:356] "Generic (PLEG): container finished" podID="04a4212a-4979-49c1-82a5-9ae939c6ef7c" containerID="da0a9fa86e3c2adfa8aeafd068b55a97a5f658e1dc3d2e6c974084e690a70b01" exitCode=60
Nov 04 02:30:22.224205 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.224124    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm" event={"ID":"04a4212a-4979-49c1-82a5-9ae939c6ef7c","Type":"ContainerDied","Data":"da0a9fa86e3c2adfa8aeafd068b55a97a5f658e1dc3d2e6c974084e690a70b01"}
Nov 04 02:30:22.224483 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.224467    4548 scope.go:122] "RemoveContainer" containerID="da0a9fa86e3c2adfa8aeafd068b55a97a5f658e1dc3d2e6c974084e690a70b01"
Nov 04 02:30:22.224728 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:30:22.224708    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm_odh-ai-gateway-infra(04a4212a-4979-49c1-82a5-9ae939c6ef7c)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm" podUID="04a4212a-4979-49c1-82a5-9ae939c6ef7c"
Nov 04 02:30:22.235113 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.235089    4548 scope.go:122] "RemoveContainer" containerID="83afe2f113e7cb62202c3a9330e9479bf8fbc0752eb2195b61450dbcbac2e306"
Nov 04 02:30:22.291472 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.291431    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eda062bb-6f3f-44d9-aea9-2e58c7c22190-tls-certs\") pod \"premium-w0-2ba6b8-kserve-c6d479c85-56k5z\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") " pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.291656 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.291511    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-model-cache\") pod \"premium-w0-2ba6b8-kserve-c6d479c85-56k5z\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") " pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.291656 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.291583    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-tmp-dir\") pod \"premium-w0-2ba6b8-kserve-c6d479c85-56k5z\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") " pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.291656 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.291622    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-dshm\") pod \"premium-w0-2ba6b8-kserve-c6d479c85-56k5z\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") " pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.291656 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.291651    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hg46x\" (UniqueName: \"kubernetes.io/projected/eda062bb-6f3f-44d9-aea9-2e58c7c22190-kube-api-access-hg46x\") pod \"premium-w0-2ba6b8-kserve-c6d479c85-56k5z\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") " pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.291944 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.291780    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-home\") pod \"premium-w0-2ba6b8-kserve-c6d479c85-56k5z\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") " pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.292077 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.292052    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-tmp-dir\") pod \"premium-w0-2ba6b8-kserve-c6d479c85-56k5z\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") " pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.292210 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.292101    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-home\") pod \"premium-w0-2ba6b8-kserve-c6d479c85-56k5z\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") " pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.292779 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.292732    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-model-cache\") pod \"premium-w0-2ba6b8-kserve-c6d479c85-56k5z\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") " pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.294620 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.294594    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-dshm\") pod \"premium-w0-2ba6b8-kserve-c6d479c85-56k5z\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") " pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.295046 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.295028    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eda062bb-6f3f-44d9-aea9-2e58c7c22190-tls-certs\") pod \"premium-w0-2ba6b8-kserve-c6d479c85-56k5z\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") " pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.328425 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.328385    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd"]
Nov 04 02:30:22.357776 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.357696    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hg46x\" (UniqueName: \"kubernetes.io/projected/eda062bb-6f3f-44d9-aea9-2e58c7c22190-kube-api-access-hg46x\") pod \"premium-w0-2ba6b8-kserve-c6d479c85-56k5z\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") " pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.424365 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.424329    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:22.444724 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.444674    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm"]
Nov 04 02:30:22.814187 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:22.814137    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"]
Nov 04 02:30:22.814495 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:30:22.814467    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeda062bb_6f3f_44d9_aea9_2e58c7c22190.slice/crio-20f8433be646f3fa3b5cd8aa9963a584abb06c3f0be373c8c81350e15254cffd WatchSource:0}: Error finding container 20f8433be646f3fa3b5cd8aa9963a584abb06c3f0be373c8c81350e15254cffd: Status 404 returned error can't find the container with id 20f8433be646f3fa3b5cd8aa9963a584abb06c3f0be373c8c81350e15254cffd
Nov 04 02:30:23.239124 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.239084    4548 generic.go:356] "Generic (PLEG): container finished" podID="290af1e9-f6e3-4aff-bb15-a1d8cc74f321" containerID="b045e770055552ef26477e6854e669a4679fcbaf20d4641363821ffa04f8a742" exitCode=60
Nov 04 02:30:23.239533 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.239153    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp" event={"ID":"290af1e9-f6e3-4aff-bb15-a1d8cc74f321","Type":"ContainerDied","Data":"b045e770055552ef26477e6854e669a4679fcbaf20d4641363821ffa04f8a742"}
Nov 04 02:30:23.239533 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.239231    4548 scope.go:122] "RemoveContainer" containerID="46dcbe8240bc751d2fbfe6e667b82a5b77f0cdbc983f7e1ce5d185d758a63c39"
Nov 04 02:30:23.239640 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.239624    4548 scope.go:122] "RemoveContainer" containerID="b045e770055552ef26477e6854e669a4679fcbaf20d4641363821ffa04f8a742"
Nov 04 02:30:23.239979 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:30:23.239946    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp_odh-ai-gateway-infra(290af1e9-f6e3-4aff-bb15-a1d8cc74f321)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp" podUID="290af1e9-f6e3-4aff-bb15-a1d8cc74f321"
Nov 04 02:30:23.243346 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.243323    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z" event={"ID":"eda062bb-6f3f-44d9-aea9-2e58c7c22190","Type":"ContainerStarted","Data":"d8223ac7138b66616e54c17b8e9f28d89f648e8fdfc2b04fc92a171ee9fa8900"}
Nov 04 02:30:23.243446 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.243362    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z" event={"ID":"eda062bb-6f3f-44d9-aea9-2e58c7c22190","Type":"ContainerStarted","Data":"20f8433be646f3fa3b5cd8aa9963a584abb06c3f0be373c8c81350e15254cffd"}
Nov 04 02:30:23.424597 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.424566    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm"
Nov 04 02:30:23.424758 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.424687    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:23.435371 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.435347    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd"
Nov 04 02:30:23.467726 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.467690    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp"]
Nov 04 02:30:23.504455 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.504358    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/979e8367-67d1-47ba-9d7f-4e09f103b338-kube-api-access-gqcqz\" (UniqueName: \"kubernetes.io/projected/979e8367-67d1-47ba-9d7f-4e09f103b338-kube-api-access-gqcqz\") pod \"979e8367-67d1-47ba-9d7f-4e09f103b338\" (UID: \"979e8367-67d1-47ba-9d7f-4e09f103b338\") "
Nov 04 02:30:23.504455 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.504400    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/979e8367-67d1-47ba-9d7f-4e09f103b338-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/979e8367-67d1-47ba-9d7f-4e09f103b338-maas-api-service-ca\") pod \"979e8367-67d1-47ba-9d7f-4e09f103b338\" (UID: \"979e8367-67d1-47ba-9d7f-4e09f103b338\") "
Nov 04 02:30:23.505320 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.504462    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/04a4212a-4979-49c1-82a5-9ae939c6ef7c-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04a4212a-4979-49c1-82a5-9ae939c6ef7c-maas-api-service-ca\") pod \"04a4212a-4979-49c1-82a5-9ae939c6ef7c\" (UID: \"04a4212a-4979-49c1-82a5-9ae939c6ef7c\") "
Nov 04 02:30:23.505320 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.504528    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/04a4212a-4979-49c1-82a5-9ae939c6ef7c-kube-api-access-7bzsj\" (UniqueName: \"kubernetes.io/projected/04a4212a-4979-49c1-82a5-9ae939c6ef7c-kube-api-access-7bzsj\") pod \"04a4212a-4979-49c1-82a5-9ae939c6ef7c\" (UID: \"04a4212a-4979-49c1-82a5-9ae939c6ef7c\") "
Nov 04 02:30:23.505320 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.504890    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/979e8367-67d1-47ba-9d7f-4e09f103b338-maas-api-service-ca" pod "979e8367-67d1-47ba-9d7f-4e09f103b338" (UID: "979e8367-67d1-47ba-9d7f-4e09f103b338"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:30:23.505320 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.504928    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/04a4212a-4979-49c1-82a5-9ae939c6ef7c-maas-api-service-ca" pod "04a4212a-4979-49c1-82a5-9ae939c6ef7c" (UID: "04a4212a-4979-49c1-82a5-9ae939c6ef7c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:30:23.505541 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.505414    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/04a4212a-4979-49c1-82a5-9ae939c6ef7c-maas-api-service-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:30:23.505541 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.505443    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/979e8367-67d1-47ba-9d7f-4e09f103b338-maas-api-service-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:30:23.507011 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.506989    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/979e8367-67d1-47ba-9d7f-4e09f103b338-kube-api-access-gqcqz" pod "979e8367-67d1-47ba-9d7f-4e09f103b338" (UID: "979e8367-67d1-47ba-9d7f-4e09f103b338"). InnerVolumeSpecName "kube-api-access-gqcqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:30:23.507480 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.507461    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04a4212a-4979-49c1-82a5-9ae939c6ef7c-kube-api-access-7bzsj" pod "04a4212a-4979-49c1-82a5-9ae939c6ef7c" (UID: "04a4212a-4979-49c1-82a5-9ae939c6ef7c"). InnerVolumeSpecName "kube-api-access-7bzsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:30:23.599349 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.599284    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z" podStartSLOduration=1.59926575 podStartE2EDuration="1.59926575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:30:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:30:23.597984335 +0000 UTC m=+857.202997334" watchObservedRunningTime="2026-11-04 02:30:23.59926575 +0000 UTC m=+857.204278749"
Nov 04 02:30:23.606682 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.606604    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bzsj\" (UniqueName: \"kubernetes.io/projected/04a4212a-4979-49c1-82a5-9ae939c6ef7c-kube-api-access-7bzsj\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:30:23.606682 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:23.606640    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqcqz\" (UniqueName: \"kubernetes.io/projected/979e8367-67d1-47ba-9d7f-4e09f103b338-kube-api-access-gqcqz\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:30:24.254075 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:24.254046    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd"
Nov 04 02:30:24.254516 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:24.254104    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd" event={"ID":"979e8367-67d1-47ba-9d7f-4e09f103b338","Type":"ContainerDied","Data":"4162bb5fd76151fd5ec67d97277fbfa874f7bdf64398ec3a5e9e68958464020c"}
Nov 04 02:30:24.254516 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:24.254256    4548 scope.go:122] "RemoveContainer" containerID="bb333193b90e07e5ab45faf0085ee0945e5767237ba2ec9fccc7d17ff3521cea"
Nov 04 02:30:24.255904 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:24.255880    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm"
Nov 04 02:30:24.256051 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:24.255906    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm" event={"ID":"04a4212a-4979-49c1-82a5-9ae939c6ef7c","Type":"ContainerDied","Data":"c6b063d9f215acc85eb9428968759685dbab9d1859176ca262b8b00b608fd5f7"}
Nov 04 02:30:24.269608 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:24.269573    4548 scope.go:122] "RemoveContainer" containerID="da0a9fa86e3c2adfa8aeafd068b55a97a5f658e1dc3d2e6c974084e690a70b01"
Nov 04 02:30:24.423730 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:24.423694    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp"
Nov 04 02:30:24.504337 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:24.503266    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd"]
Nov 04 02:30:24.504608 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:24.504584    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w0-2ba6b8-29895990-sdjqd"]
Nov 04 02:30:24.518233 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:24.518189    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/290af1e9-f6e3-4aff-bb15-a1d8cc74f321-kube-api-access-wjbpm\" (UniqueName: \"kubernetes.io/projected/290af1e9-f6e3-4aff-bb15-a1d8cc74f321-kube-api-access-wjbpm\") pod \"290af1e9-f6e3-4aff-bb15-a1d8cc74f321\" (UID: \"290af1e9-f6e3-4aff-bb15-a1d8cc74f321\") "
Nov 04 02:30:24.518447 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:24.518377    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/290af1e9-f6e3-4aff-bb15-a1d8cc74f321-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/290af1e9-f6e3-4aff-bb15-a1d8cc74f321-maas-api-service-ca\") pod \"290af1e9-f6e3-4aff-bb15-a1d8cc74f321\" (UID: \"290af1e9-f6e3-4aff-bb15-a1d8cc74f321\") "
Nov 04 02:30:24.519368 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:24.519328    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/290af1e9-f6e3-4aff-bb15-a1d8cc74f321-maas-api-service-ca" pod "290af1e9-f6e3-4aff-bb15-a1d8cc74f321" (UID: "290af1e9-f6e3-4aff-bb15-a1d8cc74f321"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:30:24.521937 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:24.521912    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/290af1e9-f6e3-4aff-bb15-a1d8cc74f321-kube-api-access-wjbpm" pod "290af1e9-f6e3-4aff-bb15-a1d8cc74f321" (UID: "290af1e9-f6e3-4aff-bb15-a1d8cc74f321"). InnerVolumeSpecName "kube-api-access-wjbpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:30:24.529977 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:24.529940    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="979e8367-67d1-47ba-9d7f-4e09f103b338" path="/var/lib/kubelet/pods/979e8367-67d1-47ba-9d7f-4e09f103b338/volumes"
Nov 04 02:30:24.614065 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:24.614003    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm"]
Nov 04 02:30:24.614065 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:24.614061    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w1-a18c43-29895990-lm5vm"]
Nov 04 02:30:24.619944 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:24.619878    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wjbpm\" (UniqueName: \"kubernetes.io/projected/290af1e9-f6e3-4aff-bb15-a1d8cc74f321-kube-api-access-wjbpm\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:30:24.619944 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:24.619917    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/290af1e9-f6e3-4aff-bb15-a1d8cc74f321-maas-api-service-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:30:25.267726 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:25.266194    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp" event={"ID":"290af1e9-f6e3-4aff-bb15-a1d8cc74f321","Type":"ContainerDied","Data":"8000ae1ed91b3e5687ec3d9da6267eb784e290049627ce151e9eb7185108b608"}
Nov 04 02:30:25.267726 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:25.266306    4548 scope.go:122] "RemoveContainer" containerID="b045e770055552ef26477e6854e669a4679fcbaf20d4641363821ffa04f8a742"
Nov 04 02:30:25.267726 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:25.266460    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp"
Nov 04 02:30:25.435919 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:25.435863    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp"]
Nov 04 02:30:25.485973 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:25.485936    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w4-ab53c1-29895990-jqsmp"]
Nov 04 02:30:25.516867 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:25.516835    4548 scope.go:122] "RemoveContainer" containerID="f7113fb9c001a721f0da478171d2113abe97886701ef4467744518b2325e8e39"
Nov 04 02:30:26.285708 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:26.285675    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4" event={"ID":"f79d8da4-5f2c-4c98-8795-3354cc665ac6","Type":"ContainerStarted","Data":"cf8dbf031d7281e65ce105ec051d7a6161640fa20611af06386592eec7186c04"}
Nov 04 02:30:26.403207 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:26.403129    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4" podStartSLOduration=14.484413842 podStartE2EDuration="26.403107373s" totalImagesPullingTime="11.918693531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:30:26.401266455 +0000 UTC m=+860.006279451" watchObservedRunningTime="2026-11-04 02:30:26.403107373 +0000 UTC m=+860.008120371"
Nov 04 02:30:26.526884 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:26.526833    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="04a4212a-4979-49c1-82a5-9ae939c6ef7c" path="/var/lib/kubelet/pods/04a4212a-4979-49c1-82a5-9ae939c6ef7c/volumes"
Nov 04 02:30:26.527389 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:26.527368    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="290af1e9-f6e3-4aff-bb15-a1d8cc74f321" path="/var/lib/kubelet/pods/290af1e9-f6e3-4aff-bb15-a1d8cc74f321/volumes"
Nov 04 02:30:27.296296 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:27.296263    4548 generic.go:356] "Generic (PLEG): container finished" podID="f79d8da4-5f2c-4c98-8795-3354cc665ac6" containerID="cf8dbf031d7281e65ce105ec051d7a6161640fa20611af06386592eec7186c04" exitCode=60
Nov 04 02:30:27.296839 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:27.296299    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4" event={"ID":"f79d8da4-5f2c-4c98-8795-3354cc665ac6","Type":"ContainerDied","Data":"cf8dbf031d7281e65ce105ec051d7a6161640fa20611af06386592eec7186c04"}
Nov 04 02:30:27.296839 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:27.296371    4548 scope.go:122] "RemoveContainer" containerID="f7113fb9c001a721f0da478171d2113abe97886701ef4467744518b2325e8e39"
Nov 04 02:30:27.296839 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:27.296723    4548 scope.go:122] "RemoveContainer" containerID="cf8dbf031d7281e65ce105ec051d7a6161640fa20611af06386592eec7186c04"
Nov 04 02:30:27.297044 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:30:27.297014    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4_odh-ai-gateway-infra(f79d8da4-5f2c-4c98-8795-3354cc665ac6)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4" podUID="f79d8da4-5f2c-4c98-8795-3354cc665ac6"
Nov 04 02:30:27.412217 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:27.412162    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4"]
Nov 04 02:30:28.472210 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:28.466559    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4"
Nov 04 02:30:28.602418 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:28.602328    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f79d8da4-5f2c-4c98-8795-3354cc665ac6-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f79d8da4-5f2c-4c98-8795-3354cc665ac6-maas-api-service-ca\") pod \"f79d8da4-5f2c-4c98-8795-3354cc665ac6\" (UID: \"f79d8da4-5f2c-4c98-8795-3354cc665ac6\") "
Nov 04 02:30:28.602612 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:28.602565    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f79d8da4-5f2c-4c98-8795-3354cc665ac6-kube-api-access-gldvt\" (UniqueName: \"kubernetes.io/projected/f79d8da4-5f2c-4c98-8795-3354cc665ac6-kube-api-access-gldvt\") pod \"f79d8da4-5f2c-4c98-8795-3354cc665ac6\" (UID: \"f79d8da4-5f2c-4c98-8795-3354cc665ac6\") "
Nov 04 02:30:28.602816 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:28.602785    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f79d8da4-5f2c-4c98-8795-3354cc665ac6-maas-api-service-ca" pod "f79d8da4-5f2c-4c98-8795-3354cc665ac6" (UID: "f79d8da4-5f2c-4c98-8795-3354cc665ac6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:30:28.603016 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:28.602995    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f79d8da4-5f2c-4c98-8795-3354cc665ac6-maas-api-service-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:30:28.605300 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:28.605270    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f79d8da4-5f2c-4c98-8795-3354cc665ac6-kube-api-access-gldvt" pod "f79d8da4-5f2c-4c98-8795-3354cc665ac6" (UID: "f79d8da4-5f2c-4c98-8795-3354cc665ac6"). InnerVolumeSpecName "kube-api-access-gldvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:30:28.704884 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:28.704829    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gldvt\" (UniqueName: \"kubernetes.io/projected/f79d8da4-5f2c-4c98-8795-3354cc665ac6-kube-api-access-gldvt\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:30:29.312470 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:29.312436    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4"
Nov 04 02:30:29.312470 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:29.312465    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4" event={"ID":"f79d8da4-5f2c-4c98-8795-3354cc665ac6","Type":"ContainerDied","Data":"1e886a830b6400921b36530d9df67338ece0b8ae0d247187cd36f1be61517b84"}
Nov 04 02:30:29.312718 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:29.312533    4548 scope.go:122] "RemoveContainer" containerID="cf8dbf031d7281e65ce105ec051d7a6161640fa20611af06386592eec7186c04"
Nov 04 02:30:29.478028 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:29.477992    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4"]
Nov 04 02:30:29.481961 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:29.481933    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-worker-w2-1e4f1e-29895990-rtwt4"]
Nov 04 02:30:30.523784 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:30.523749    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f79d8da4-5f2c-4c98-8795-3354cc665ac6" path="/var/lib/kubelet/pods/f79d8da4-5f2c-4c98-8795-3354cc665ac6/volumes"
Nov 04 02:30:32.425004 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:32.424971    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:32.437932 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:32.437900    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:33.350974 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:30:33.350932    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:30:40.650787 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:30:40.650744    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:31:06.697531 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:06.697500    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:31:06.699278 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:06.699253    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:31:10.612093 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:31:10.612052    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:31:13.906428 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906376    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"]
Nov 04 02:31:13.906847 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906837    4548 cpu_manager.go:414] "containerMap: removing container" podUID="979e8367-67d1-47ba-9d7f-4e09f103b338" containerName="cleanup"
Nov 04 02:31:13.906893 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906850    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="979e8367-67d1-47ba-9d7f-4e09f103b338" containerName="cleanup"
Nov 04 02:31:13.906893 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906863    4548 cpu_manager.go:414] "containerMap: removing container" podUID="290af1e9-f6e3-4aff-bb15-a1d8cc74f321" containerName="cleanup"
Nov 04 02:31:13.906893 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906868    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="290af1e9-f6e3-4aff-bb15-a1d8cc74f321" containerName="cleanup"
Nov 04 02:31:13.906893 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906878    4548 cpu_manager.go:414] "containerMap: removing container" podUID="f79d8da4-5f2c-4c98-8795-3354cc665ac6" containerName="cleanup"
Nov 04 02:31:13.906893 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906883    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f79d8da4-5f2c-4c98-8795-3354cc665ac6" containerName="cleanup"
Nov 04 02:31:13.906893 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906891    4548 cpu_manager.go:414] "containerMap: removing container" podUID="04a4212a-4979-49c1-82a5-9ae939c6ef7c" containerName="cleanup"
Nov 04 02:31:13.906893 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906895    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04a4212a-4979-49c1-82a5-9ae939c6ef7c" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906911    4548 cpu_manager.go:414] "containerMap: removing container" podUID="979e8367-67d1-47ba-9d7f-4e09f103b338" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906915    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="979e8367-67d1-47ba-9d7f-4e09f103b338" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906921    4548 cpu_manager.go:414] "containerMap: removing container" podUID="f79d8da4-5f2c-4c98-8795-3354cc665ac6" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906925    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f79d8da4-5f2c-4c98-8795-3354cc665ac6" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906932    4548 cpu_manager.go:414] "containerMap: removing container" podUID="04a4212a-4979-49c1-82a5-9ae939c6ef7c" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906936    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04a4212a-4979-49c1-82a5-9ae939c6ef7c" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906942    4548 cpu_manager.go:414] "containerMap: removing container" podUID="f79d8da4-5f2c-4c98-8795-3354cc665ac6" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906946    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f79d8da4-5f2c-4c98-8795-3354cc665ac6" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906953    4548 cpu_manager.go:414] "containerMap: removing container" podUID="04a4212a-4979-49c1-82a5-9ae939c6ef7c" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906958    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="04a4212a-4979-49c1-82a5-9ae939c6ef7c" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906985    4548 cpu_manager.go:414] "containerMap: removing container" podUID="979e8367-67d1-47ba-9d7f-4e09f103b338" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906989    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="979e8367-67d1-47ba-9d7f-4e09f103b338" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.906996    4548 cpu_manager.go:414] "containerMap: removing container" podUID="290af1e9-f6e3-4aff-bb15-a1d8cc74f321" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.907000    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="290af1e9-f6e3-4aff-bb15-a1d8cc74f321" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.907067    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="290af1e9-f6e3-4aff-bb15-a1d8cc74f321" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.907075    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="f79d8da4-5f2c-4c98-8795-3354cc665ac6" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.907082    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="04a4212a-4979-49c1-82a5-9ae939c6ef7c" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.907089    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="979e8367-67d1-47ba-9d7f-4e09f103b338" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.907095    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="f79d8da4-5f2c-4c98-8795-3354cc665ac6" containerName="cleanup"
Nov 04 02:31:13.907095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.907101    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="f79d8da4-5f2c-4c98-8795-3354cc665ac6" containerName="cleanup"
Nov 04 02:31:13.907697 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.907107    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="04a4212a-4979-49c1-82a5-9ae939c6ef7c" containerName="cleanup"
Nov 04 02:31:13.907697 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.907113    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="290af1e9-f6e3-4aff-bb15-a1d8cc74f321" containerName="cleanup"
Nov 04 02:31:13.907697 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.907119    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="290af1e9-f6e3-4aff-bb15-a1d8cc74f321" containerName="cleanup"
Nov 04 02:31:13.907697 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.907125    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="979e8367-67d1-47ba-9d7f-4e09f103b338" containerName="cleanup"
Nov 04 02:31:13.911898 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.911875    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:13.966037 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:13.965999    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"]
Nov 04 02:31:14.013653 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.013624    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w2-1e4f1e\"/\"distinct-w2-1e4f1e-kserve-self-signed-certs\""
Nov 04 02:31:14.040673 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.040592    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-tmp-dir\") pod \"distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.040875 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.040719    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-home\") pod \"distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.040875 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.040778    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-dshm\") pod \"distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.041071 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.041040    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpx78\" (UniqueName: \"kubernetes.io/projected/7bea1b32-d4ba-496c-b17d-b0b2d459010f-kube-api-access-cpx78\") pod \"distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.041202 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.041103    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-model-cache\") pod \"distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.041343 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.041319    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bea1b32-d4ba-496c-b17d-b0b2d459010f-tls-certs\") pod \"distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.142427 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.142381    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bea1b32-d4ba-496c-b17d-b0b2d459010f-tls-certs\") pod \"distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.142614 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.142449    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-tmp-dir\") pod \"distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.142614 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.142481    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-home\") pod \"distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.142614 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.142501    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-dshm\") pod \"distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.142614 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.142591    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cpx78\" (UniqueName: \"kubernetes.io/projected/7bea1b32-d4ba-496c-b17d-b0b2d459010f-kube-api-access-cpx78\") pod \"distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.142783 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.142619    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-model-cache\") pod \"distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.143001 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.142963    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-home\") pod \"distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.143102 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.143007    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-tmp-dir\") pod \"distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.143102 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.143049    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-model-cache\") pod \"distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.145036 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.145013    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-dshm\") pod \"distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.145323 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.145303    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bea1b32-d4ba-496c-b17d-b0b2d459010f-tls-certs\") pod \"distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.204596 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.204515    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpx78\" (UniqueName: \"kubernetes.io/projected/7bea1b32-d4ba-496c-b17d-b0b2d459010f-kube-api-access-cpx78\") pod \"distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") " pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.226360 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.226317    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:14.633090 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.633064    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"]
Nov 04 02:31:14.634965 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:31:14.634938    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7bea1b32_d4ba_496c_b17d_b0b2d459010f.slice/crio-90302b5d824ab72133092ca4911c9dc9c1003b76acfb24ea3f25d614d77e52d7 WatchSource:0}: Error finding container 90302b5d824ab72133092ca4911c9dc9c1003b76acfb24ea3f25d614d77e52d7: Status 404 returned error can't find the container with id 90302b5d824ab72133092ca4911c9dc9c1003b76acfb24ea3f25d614d77e52d7
Nov 04 02:31:14.647442 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:14.647401    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt" event={"ID":"7bea1b32-d4ba-496c-b17d-b0b2d459010f","Type":"ContainerStarted","Data":"90302b5d824ab72133092ca4911c9dc9c1003b76acfb24ea3f25d614d77e52d7"}
Nov 04 02:31:15.655322 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:15.655282    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt" event={"ID":"7bea1b32-d4ba-496c-b17d-b0b2d459010f","Type":"ContainerStarted","Data":"e1ac7b1c7be78b93aa162191dd04b8b391296ac20007bea5b60e9d6dc1041218"}
Nov 04 02:31:15.773957 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:15.773895    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt" podStartSLOduration=2.773878001 podStartE2EDuration="2.773878001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:31:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:31:15.772581066 +0000 UTC m=+909.377594058" watchObservedRunningTime="2026-11-04 02:31:15.773878001 +0000 UTC m=+909.378890999"
Nov 04 02:31:16.227284 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:16.227243    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:24.227268 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:24.227217    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:24.240360 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:24.240325    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:24.733257 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:24.733221    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:31:40.613381 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:31:40.613329    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:31:41.894792 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:41.894755    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"]
Nov 04 02:31:41.895330 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:41.895031    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff" podUID="3753909e-9a2a-4f55-978a-1974bfdbbbd1" containerName="istio-proxy" containerID="cri-o://5c7958995856cc8a861d84a971d7d0118eb9134d639c8895af2188749f8d9986" gracePeriod=30
Nov 04 02:31:47.162116 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.162088    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:31:47.237285 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.237165    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-token\" (UniqueName: \"kubernetes.io/projected/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-token\") pod \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") "
Nov 04 02:31:47.237285 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.237243    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-workload-socket\") pod \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") "
Nov 04 02:31:47.237536 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.237305    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-data\") pod \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") "
Nov 04 02:31:47.237536 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.237332    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-workload-certs\") pod \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") "
Nov 04 02:31:47.237536 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.237366    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istiod-ca-cert\") pod \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") "
Nov 04 02:31:47.237536 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.237391    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-credential-socket\") pod \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") "
Nov 04 02:31:47.237536 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.237469    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3753909e-9a2a-4f55-978a-1974bfdbbbd1-kube-api-access-f9rds\" (UniqueName: \"kubernetes.io/projected/3753909e-9a2a-4f55-978a-1974bfdbbbd1-kube-api-access-f9rds\") pod \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") "
Nov 04 02:31:47.237536 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.237534    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-podinfo\") pod \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") "
Nov 04 02:31:47.237835 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.237593    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-envoy\") pod \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\" (UID: \"3753909e-9a2a-4f55-978a-1974bfdbbbd1\") "
Nov 04 02:31:47.237835 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.237650    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-data" pod "3753909e-9a2a-4f55-978a-1974bfdbbbd1" (UID: "3753909e-9a2a-4f55-978a-1974bfdbbbd1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:31:47.237835 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.237680    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-workload-certs" pod "3753909e-9a2a-4f55-978a-1974bfdbbbd1" (UID: "3753909e-9a2a-4f55-978a-1974bfdbbbd1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:31:47.237835 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.237655    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-workload-socket" pod "3753909e-9a2a-4f55-978a-1974bfdbbbd1" (UID: "3753909e-9a2a-4f55-978a-1974bfdbbbd1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:31:47.237835 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.237738    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istiod-ca-cert" pod "3753909e-9a2a-4f55-978a-1974bfdbbbd1" (UID: "3753909e-9a2a-4f55-978a-1974bfdbbbd1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:31:47.237835 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.237803    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-credential-socket" pod "3753909e-9a2a-4f55-978a-1974bfdbbbd1" (UID: "3753909e-9a2a-4f55-978a-1974bfdbbbd1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:31:47.238127 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.238079    4548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-workload-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:47.238127 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.238103    4548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-data\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:47.238127 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.238116    4548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-workload-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:47.238290 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.238129    4548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istiod-ca-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:47.238290 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.238144    4548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-credential-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:47.240081 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.240056    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-envoy" pod "3753909e-9a2a-4f55-978a-1974bfdbbbd1" (UID: "3753909e-9a2a-4f55-978a-1974bfdbbbd1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:31:47.240081 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.240059    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3753909e-9a2a-4f55-978a-1974bfdbbbd1-kube-api-access-f9rds" pod "3753909e-9a2a-4f55-978a-1974bfdbbbd1" (UID: "3753909e-9a2a-4f55-978a-1974bfdbbbd1"). InnerVolumeSpecName "kube-api-access-f9rds". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:31:47.240365 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.240340    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-podinfo" pod "3753909e-9a2a-4f55-978a-1974bfdbbbd1" (UID: "3753909e-9a2a-4f55-978a-1974bfdbbbd1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:31:47.240419 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.240367    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-token" pod "3753909e-9a2a-4f55-978a-1974bfdbbbd1" (UID: "3753909e-9a2a-4f55-978a-1974bfdbbbd1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:31:47.339130 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.339084    4548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-envoy\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:47.339130 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.339126    4548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-token\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:47.339360 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.339145    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f9rds\" (UniqueName: \"kubernetes.io/projected/3753909e-9a2a-4f55-978a-1974bfdbbbd1-kube-api-access-f9rds\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:47.339360 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.339161    4548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3753909e-9a2a-4f55-978a-1974bfdbbbd1-istio-podinfo\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:31:47.886527 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.886483    4548 generic.go:356] "Generic (PLEG): container finished" podID="3753909e-9a2a-4f55-978a-1974bfdbbbd1" containerID="5c7958995856cc8a861d84a971d7d0118eb9134d639c8895af2188749f8d9986" exitCode=0
Nov 04 02:31:47.886753 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.886558    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff" event={"ID":"3753909e-9a2a-4f55-978a-1974bfdbbbd1","Type":"ContainerDied","Data":"5c7958995856cc8a861d84a971d7d0118eb9134d639c8895af2188749f8d9986"}
Nov 04 02:31:47.886753 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.886625    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"
Nov 04 02:31:47.886753 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.886668    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff" event={"ID":"3753909e-9a2a-4f55-978a-1974bfdbbbd1","Type":"ContainerDied","Data":"bd97d7b16b19ffdb66d31f30eeb450547dc4f935b4a4c91f81c3554c919b5c2b"}
Nov 04 02:31:47.886753 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.886700    4548 scope.go:122] "RemoveContainer" containerID="5c7958995856cc8a861d84a971d7d0118eb9134d639c8895af2188749f8d9986"
Nov 04 02:31:47.898101 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.898074    4548 scope.go:122] "RemoveContainer" containerID="46e98f05255e8e447e44341db26871348ce24229418d5442ec7e1be7446672c8"
Nov 04 02:31:47.908818 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.908791    4548 scope.go:122] "RemoveContainer" containerID="5c7958995856cc8a861d84a971d7d0118eb9134d639c8895af2188749f8d9986"
Nov 04 02:31:47.909198 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:31:47.909159    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c7958995856cc8a861d84a971d7d0118eb9134d639c8895af2188749f8d9986\": container with ID starting with 5c7958995856cc8a861d84a971d7d0118eb9134d639c8895af2188749f8d9986 not found: ID does not exist" containerID="5c7958995856cc8a861d84a971d7d0118eb9134d639c8895af2188749f8d9986"
Nov 04 02:31:47.909289 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.909210    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c7958995856cc8a861d84a971d7d0118eb9134d639c8895af2188749f8d9986"} err="failed to get container status \"5c7958995856cc8a861d84a971d7d0118eb9134d639c8895af2188749f8d9986\": rpc error: code = NotFound desc = could not find container \"5c7958995856cc8a861d84a971d7d0118eb9134d639c8895af2188749f8d9986\": container with ID starting with 5c7958995856cc8a861d84a971d7d0118eb9134d639c8895af2188749f8d9986 not found: ID does not exist"
Nov 04 02:31:47.909289 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.909229    4548 scope.go:122] "RemoveContainer" containerID="46e98f05255e8e447e44341db26871348ce24229418d5442ec7e1be7446672c8"
Nov 04 02:31:47.909582 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:31:47.909553    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46e98f05255e8e447e44341db26871348ce24229418d5442ec7e1be7446672c8\": container with ID starting with 46e98f05255e8e447e44341db26871348ce24229418d5442ec7e1be7446672c8 not found: ID does not exist" containerID="46e98f05255e8e447e44341db26871348ce24229418d5442ec7e1be7446672c8"
Nov 04 02:31:47.909637 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:47.909590    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46e98f05255e8e447e44341db26871348ce24229418d5442ec7e1be7446672c8"} err="failed to get container status \"46e98f05255e8e447e44341db26871348ce24229418d5442ec7e1be7446672c8\": rpc error: code = NotFound desc = could not find container \"46e98f05255e8e447e44341db26871348ce24229418d5442ec7e1be7446672c8\": container with ID starting with 46e98f05255e8e447e44341db26871348ce24229418d5442ec7e1be7446672c8 not found: ID does not exist"
Nov 04 02:31:48.053620 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:48.053585    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"]
Nov 04 02:31:48.103969 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:48.103927    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-b8qff"]
Nov 04 02:31:48.524431 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:48.524394    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3753909e-9a2a-4f55-978a-1974bfdbbbd1" path="/var/lib/kubelet/pods/3753909e-9a2a-4f55-978a-1974bfdbbbd1/volumes"
Nov 04 02:31:49.176614 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.176568    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"]
Nov 04 02:31:49.177105 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.177088    4548 cpu_manager.go:414] "containerMap: removing container" podUID="3753909e-9a2a-4f55-978a-1974bfdbbbd1" containerName="istio-proxy"
Nov 04 02:31:49.177209 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.177107    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3753909e-9a2a-4f55-978a-1974bfdbbbd1" containerName="istio-proxy"
Nov 04 02:31:49.177209 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.177127    4548 cpu_manager.go:414] "containerMap: removing container" podUID="3753909e-9a2a-4f55-978a-1974bfdbbbd1" containerName="istio-proxy"
Nov 04 02:31:49.177209 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.177134    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3753909e-9a2a-4f55-978a-1974bfdbbbd1" containerName="istio-proxy"
Nov 04 02:31:49.177209 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.177158    4548 cpu_manager.go:414] "containerMap: removing container" podUID="290af1e9-f6e3-4aff-bb15-a1d8cc74f321" containerName="cleanup"
Nov 04 02:31:49.177209 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.177164    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="290af1e9-f6e3-4aff-bb15-a1d8cc74f321" containerName="cleanup"
Nov 04 02:31:49.177374 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.177287    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="3753909e-9a2a-4f55-978a-1974bfdbbbd1" containerName="istio-proxy"
Nov 04 02:31:49.177374 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.177304    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="979e8367-67d1-47ba-9d7f-4e09f103b338" containerName="cleanup"
Nov 04 02:31:49.177374 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.177314    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="04a4212a-4979-49c1-82a5-9ae939c6ef7c" containerName="cleanup"
Nov 04 02:31:49.182208 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.182183    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.262098 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.262059    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-envoy\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.262562 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.262157    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-workload-certs\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.262562 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.262338    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b694e41-1176-4a62-a1eb-6451520b1ece-istiod-ca-cert\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.262562 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.262383    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-data\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.262562 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.262459    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-workload-socket\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.262562 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.262515    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dzfq\" (UniqueName: \"kubernetes.io/projected/4b694e41-1176-4a62-a1eb-6451520b1ece-kube-api-access-2dzfq\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.262562 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.262561    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-token\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.262956 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.262595    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-credential-socket\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.262956 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.262647    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-podinfo\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.276542 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.276487    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-a-493b10-openshift-default-dockercfg-9gnkf\""
Nov 04 02:31:49.292936 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.292899    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"]
Nov 04 02:31:49.381204 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.380773    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-data\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.381204 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.380857    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-workload-socket\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.381204 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.380908    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dzfq\" (UniqueName: \"kubernetes.io/projected/4b694e41-1176-4a62-a1eb-6451520b1ece-kube-api-access-2dzfq\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.381204 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.380952    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-token\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.381204 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.380978    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-credential-socket\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.381204 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.381016    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-podinfo\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.381204 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.381052    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-envoy\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.381204 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.381120    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-workload-certs\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.381204 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.381196    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b694e41-1176-4a62-a1eb-6451520b1ece-istiod-ca-cert\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.389206 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.381952    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b694e41-1176-4a62-a1eb-6451520b1ece-istiod-ca-cert\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.389206 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.388613    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-credential-socket\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.389206 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.388872    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-workload-socket\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.394203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.389682    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-workload-certs\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.408072 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.403244    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-data\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.411339 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.409637    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-podinfo\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.434224 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.425617    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-envoy\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.450752 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.450715    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-token\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.450934 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.450786    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dzfq\" (UniqueName: \"kubernetes.io/projected/4b694e41-1176-4a62-a1eb-6451520b1ece-kube-api-access-2dzfq\") pod \"e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") " pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.497100 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.497062    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:49.937381 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.937355    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"]
Nov 04 02:31:49.938306 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:31:49.938282    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b694e41_1176_4a62_a1eb_6451520b1ece.slice/crio-728ad13c9c7feb4746c1deeb098bbf16e0d2949ade2a4f3862449abf58901fc0 WatchSource:0}: Error finding container 728ad13c9c7feb4746c1deeb098bbf16e0d2949ade2a4f3862449abf58901fc0: Status 404 returned error can't find the container with id 728ad13c9c7feb4746c1deeb098bbf16e0d2949ade2a4f3862449abf58901fc0
Nov 04 02:31:49.940710 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.940674    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:31:49.940806 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.940742    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:31:49.940806 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:49.940771    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:31:50.910598 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:50.910557    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr" event={"ID":"4b694e41-1176-4a62-a1eb-6451520b1ece","Type":"ContainerStarted","Data":"58e3b2c28fc62c18716f92c7b229d910766441c57e33ebb81d6f29f4a5730cc0"}
Nov 04 02:31:50.910838 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:50.910642    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr" event={"ID":"4b694e41-1176-4a62-a1eb-6451520b1ece","Type":"ContainerStarted","Data":"728ad13c9c7feb4746c1deeb098bbf16e0d2949ade2a4f3862449abf58901fc0"}
Nov 04 02:31:51.033338 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:51.033281    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr" podStartSLOduration=2.033263332 podStartE2EDuration="2.033263332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:31:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:31:51.030864713 +0000 UTC m=+944.635877713" watchObservedRunningTime="2026-11-04 02:31:51.033263332 +0000 UTC m=+944.638276330"
Nov 04 02:31:51.497377 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:51.497334    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:51.503839 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:51.503806    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:51.917568 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:51.917533    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:51.918530 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:51.918509    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:31:59.784535 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:59.784494    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"]
Nov 04 02:31:59.785359 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:59.785341    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="3753909e-9a2a-4f55-978a-1974bfdbbbd1" containerName="istio-proxy"
Nov 04 02:31:59.789229 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:59.789203    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:31:59.843284 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:59.843250    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"]
Nov 04 02:31:59.890059 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:59.890014    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-a18c43\"/\"distinct-w1-a18c43-kserve-self-signed-certs\""
Nov 04 02:31:59.921194 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:59.920741    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-model-cache\") pod \"distinct-w1-a18c43-kserve-696b6789db-slj48\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:31:59.921194 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:59.920976    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b15e0b31-b783-428e-8507-55aad5e90711-tls-certs\") pod \"distinct-w1-a18c43-kserve-696b6789db-slj48\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:31:59.921194 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:59.921065    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-home\") pod \"distinct-w1-a18c43-kserve-696b6789db-slj48\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:31:59.921536 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:59.921284    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-dshm\") pod \"distinct-w1-a18c43-kserve-696b6789db-slj48\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:31:59.921536 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:59.921415    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wl4v\" (UniqueName: \"kubernetes.io/projected/b15e0b31-b783-428e-8507-55aad5e90711-kube-api-access-2wl4v\") pod \"distinct-w1-a18c43-kserve-696b6789db-slj48\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:31:59.921536 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:31:59.921486    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-tmp-dir\") pod \"distinct-w1-a18c43-kserve-696b6789db-slj48\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:32:00.022836 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:00.022794    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-tmp-dir\") pod \"distinct-w1-a18c43-kserve-696b6789db-slj48\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:32:00.023068 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:00.022868    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-model-cache\") pod \"distinct-w1-a18c43-kserve-696b6789db-slj48\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:32:00.023068 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:00.022908    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b15e0b31-b783-428e-8507-55aad5e90711-tls-certs\") pod \"distinct-w1-a18c43-kserve-696b6789db-slj48\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:32:00.023068 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:00.022931    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-home\") pod \"distinct-w1-a18c43-kserve-696b6789db-slj48\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:32:00.023068 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:00.023017    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-dshm\") pod \"distinct-w1-a18c43-kserve-696b6789db-slj48\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:32:00.023419 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:00.023113    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wl4v\" (UniqueName: \"kubernetes.io/projected/b15e0b31-b783-428e-8507-55aad5e90711-kube-api-access-2wl4v\") pod \"distinct-w1-a18c43-kserve-696b6789db-slj48\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:32:00.023419 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:00.023324    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-tmp-dir\") pod \"distinct-w1-a18c43-kserve-696b6789db-slj48\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:32:00.023419 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:00.023373    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-model-cache\") pod \"distinct-w1-a18c43-kserve-696b6789db-slj48\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:32:00.023419 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:00.023409    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-home\") pod \"distinct-w1-a18c43-kserve-696b6789db-slj48\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:32:00.025573 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:00.025547    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-dshm\") pod \"distinct-w1-a18c43-kserve-696b6789db-slj48\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:32:00.025797 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:00.025771    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b15e0b31-b783-428e-8507-55aad5e90711-tls-certs\") pod \"distinct-w1-a18c43-kserve-696b6789db-slj48\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:32:00.088231 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:00.088115    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wl4v\" (UniqueName: \"kubernetes.io/projected/b15e0b31-b783-428e-8507-55aad5e90711-kube-api-access-2wl4v\") pod \"distinct-w1-a18c43-kserve-696b6789db-slj48\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") " pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:32:00.104075 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:00.104034    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:32:00.508430 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:00.508399    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"]
Nov 04 02:32:00.510868 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:32:00.510835    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb15e0b31_b783_428e_8507_55aad5e90711.slice/crio-76880f4e2ca88cbd510bc81455d292922d706a2bc0f145c2193f72f6d094c127 WatchSource:0}: Error finding container 76880f4e2ca88cbd510bc81455d292922d706a2bc0f145c2193f72f6d094c127: Status 404 returned error can't find the container with id 76880f4e2ca88cbd510bc81455d292922d706a2bc0f145c2193f72f6d094c127
Nov 04 02:32:00.988593 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:00.988548    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48" event={"ID":"b15e0b31-b783-428e-8507-55aad5e90711","Type":"ContainerStarted","Data":"5be5b8150b9b445afbd30a757854c30e900d3ce187635c5cee0a6397b78a28fd"}
Nov 04 02:32:00.989019 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:00.988601    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48" event={"ID":"b15e0b31-b783-428e-8507-55aad5e90711","Type":"ContainerStarted","Data":"76880f4e2ca88cbd510bc81455d292922d706a2bc0f145c2193f72f6d094c127"}
Nov 04 02:32:01.105147 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:01.105109    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:32:01.107977 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:01.107921    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48" podStartSLOduration=2.107902582 podStartE2EDuration="2.107902582s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:31:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:32:01.105595817 +0000 UTC m=+954.710608819" watchObservedRunningTime="2026-11-04 02:32:01.107902582 +0000 UTC m=+954.712915579"
Nov 04 02:32:10.105047 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:10.105002    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:32:10.118596 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:10.118556    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:32:10.612843 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:32:10.612805    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:32:11.062835 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:11.062799    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:32:13.051735 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.051693    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"]
Nov 04 02:32:13.057277 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.057253    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.114127 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.114087    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"]
Nov 04 02:32:13.158478 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.158443    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-ab53c1\"/\"kube-root-ca.crt\""
Nov 04 02:32:13.160024 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.159994    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-ab53c1\"/\"default-dockercfg-z9nv6\""
Nov 04 02:32:13.160024 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.159994    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-ab53c1\"/\"openshift-service-ca.crt\""
Nov 04 02:32:13.160327 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.160102    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-ab53c1\"/\"distinct-w4-ab53c1-kserve-self-signed-certs\""
Nov 04 02:32:13.174509 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.174453    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-model-cache\") pod \"distinct-w4-ab53c1-kserve-74d8965cfd-wm667\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.174731 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.174541    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-tls-certs\") pod \"distinct-w4-ab53c1-kserve-74d8965cfd-wm667\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.174804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.174773    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-dshm\") pod \"distinct-w4-ab53c1-kserve-74d8965cfd-wm667\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.174873 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.174835    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7gpc\" (UniqueName: \"kubernetes.io/projected/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-kube-api-access-k7gpc\") pod \"distinct-w4-ab53c1-kserve-74d8965cfd-wm667\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.174973 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.174948    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-home\") pod \"distinct-w4-ab53c1-kserve-74d8965cfd-wm667\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.175045 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.175006    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-tmp-dir\") pod \"distinct-w4-ab53c1-kserve-74d8965cfd-wm667\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.276958 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.276906    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-dshm\") pod \"distinct-w4-ab53c1-kserve-74d8965cfd-wm667\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.277216 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.276996    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7gpc\" (UniqueName: \"kubernetes.io/projected/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-kube-api-access-k7gpc\") pod \"distinct-w4-ab53c1-kserve-74d8965cfd-wm667\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.277216 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.277044    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-home\") pod \"distinct-w4-ab53c1-kserve-74d8965cfd-wm667\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.277357 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.277274    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-tmp-dir\") pod \"distinct-w4-ab53c1-kserve-74d8965cfd-wm667\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.277357 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.277339    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-model-cache\") pod \"distinct-w4-ab53c1-kserve-74d8965cfd-wm667\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.277484 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.277389    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-tls-certs\") pod \"distinct-w4-ab53c1-kserve-74d8965cfd-wm667\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.277809 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.277783    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-tmp-dir\") pod \"distinct-w4-ab53c1-kserve-74d8965cfd-wm667\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.277948 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.277800    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-model-cache\") pod \"distinct-w4-ab53c1-kserve-74d8965cfd-wm667\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.278226 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.278203    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-home\") pod \"distinct-w4-ab53c1-kserve-74d8965cfd-wm667\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.280212 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.280187    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-dshm\") pod \"distinct-w4-ab53c1-kserve-74d8965cfd-wm667\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.280476 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.280449    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-tls-certs\") pod \"distinct-w4-ab53c1-kserve-74d8965cfd-wm667\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.338784 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.338695    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7gpc\" (UniqueName: \"kubernetes.io/projected/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-kube-api-access-k7gpc\") pod \"distinct-w4-ab53c1-kserve-74d8965cfd-wm667\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") " pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.373615 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.373570    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:13.804646 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:32:13.804612    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc8160852_d3fd_4f93_b7f3_aa0e0f0bd905.slice/crio-bc13f9dd6e56abc00225a30e39956a5a99b50a3146c19a0ec4dcc703203516f2 WatchSource:0}: Error finding container bc13f9dd6e56abc00225a30e39956a5a99b50a3146c19a0ec4dcc703203516f2: Status 404 returned error can't find the container with id bc13f9dd6e56abc00225a30e39956a5a99b50a3146c19a0ec4dcc703203516f2
Nov 04 02:32:13.805321 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:13.805294    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"]
Nov 04 02:32:14.013708 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.013662    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"]
Nov 04 02:32:14.017556 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.017529    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.086259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.085894    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"]
Nov 04 02:32:14.116161 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.116117    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667" event={"ID":"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905","Type":"ContainerStarted","Data":"a4af5d5aa4a0e6479860931e16774ba538a509ce8945013ad19090e085650778"}
Nov 04 02:32:14.116400 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.116203    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667" event={"ID":"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905","Type":"ContainerStarted","Data":"bc13f9dd6e56abc00225a30e39956a5a99b50a3146c19a0ec4dcc703203516f2"}
Nov 04 02:32:14.117139 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.117118    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-a-31626a-openshift-default-dockercfg-wnxqq\""
Nov 04 02:32:14.191798 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.191763    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-workload-certs\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.192018 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.191834    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-token\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.192018 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.191897    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ws7z9\" (UniqueName: \"kubernetes.io/projected/be003f9f-9a96-47b9-b603-c2698b09a2a0-kube-api-access-ws7z9\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.192018 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.191927    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-podinfo\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.192018 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.191952    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-data\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.192263 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.192030    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-envoy\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.192263 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.192099    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-credential-socket\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.192263 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.192248    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-workload-socket\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.192414 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.192299    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be003f9f-9a96-47b9-b603-c2698b09a2a0-istiod-ca-cert\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.284918 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.284865    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667" podStartSLOduration=1.284844908 podStartE2EDuration="1.284844908s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:32:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:32:14.283700823 +0000 UTC m=+967.888713822" watchObservedRunningTime="2026-11-04 02:32:14.284844908 +0000 UTC m=+967.889857905"
Nov 04 02:32:14.293219 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.293159    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be003f9f-9a96-47b9-b603-c2698b09a2a0-istiod-ca-cert\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.293417 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.293319    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-workload-certs\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.293417 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.293390    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-token\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.293561 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.293527    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ws7z9\" (UniqueName: \"kubernetes.io/projected/be003f9f-9a96-47b9-b603-c2698b09a2a0-kube-api-access-ws7z9\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.293625 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.293586    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-podinfo\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.293686 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.293625    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-data\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.293686 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.293665    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-envoy\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.293786 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.293692    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-credential-socket\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.293786 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.293754    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-workload-certs\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.293786 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.293765    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-workload-socket\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.294028 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.294008    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be003f9f-9a96-47b9-b603-c2698b09a2a0-istiod-ca-cert\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.294091 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.294023    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-data\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.294147 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.294105    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-credential-socket\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.294286 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.294266    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-workload-socket\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.296661 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.296634    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-envoy\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.296777 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.296756    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-podinfo\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.355051 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.354975    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-token\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.355237 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.355123    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ws7z9\" (UniqueName: \"kubernetes.io/projected/be003f9f-9a96-47b9-b603-c2698b09a2a0-kube-api-access-ws7z9\") pod \"e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") " pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:14.374356 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.374314    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:14.632077 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:14.631972    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:15.106013 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:15.105985    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"]
Nov 04 02:32:15.107869 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:32:15.107839    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe003f9f_9a96_47b9_b603_c2698b09a2a0.slice/crio-5dd3ad052e41536945112933591c37cd28497ba5e6fd2f28893f301439000d8d WatchSource:0}: Error finding container 5dd3ad052e41536945112933591c37cd28497ba5e6fd2f28893f301439000d8d: Status 404 returned error can't find the container with id 5dd3ad052e41536945112933591c37cd28497ba5e6fd2f28893f301439000d8d
Nov 04 02:32:15.110528 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:15.110491    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:32:15.110667 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:15.110564    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:32:15.110667 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:15.110599    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:32:15.135399 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:15.135358    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d" event={"ID":"be003f9f-9a96-47b9-b603-c2698b09a2a0","Type":"ContainerStarted","Data":"5dd3ad052e41536945112933591c37cd28497ba5e6fd2f28893f301439000d8d"}
Nov 04 02:32:16.143667 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:16.143626    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d" event={"ID":"be003f9f-9a96-47b9-b603-c2698b09a2a0","Type":"ContainerStarted","Data":"fa03dd3f7af23021eb4e748626cf8bedba5195876b9273df4369e32fa48dae34"}
Nov 04 02:32:16.366935 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:16.366873    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d" podStartSLOduration=3.366853677 podStartE2EDuration="3.366853677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:32:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:32:16.314589572 +0000 UTC m=+969.919602590" watchObservedRunningTime="2026-11-04 02:32:16.366853677 +0000 UTC m=+969.971866757"
Nov 04 02:32:16.633209 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:16.633161    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:16.639092 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:16.639062    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:17.150468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:17.150436    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:17.151694 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:17.151668    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:32:23.373875 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:23.373831    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:23.387948 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:23.387914    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:24.224160 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:24.224132    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:32:40.613097 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:32:40.613056    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:32:52.657233 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:52.656494    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": read tcp 10.133.0.2:42464->10.133.0.67:15021: read: connection reset by peer" start-of-body=
Nov 04 02:32:52.657233 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:52.656574    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr" podUID="4b694e41-1176-4a62-a1eb-6451520b1ece" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": read tcp 10.133.0.2:42464->10.133.0.67:15021: read: connection reset by peer"
Nov 04 02:32:53.442752 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:53.442717    4548 generic.go:356] "Generic (PLEG): container finished" podID="4b694e41-1176-4a62-a1eb-6451520b1ece" containerID="58e3b2c28fc62c18716f92c7b229d910766441c57e33ebb81d6f29f4a5730cc0" exitCode=0
Nov 04 02:32:53.442943 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:53.442756    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr" event={"ID":"4b694e41-1176-4a62-a1eb-6451520b1ece","Type":"ContainerDied","Data":"58e3b2c28fc62c18716f92c7b229d910766441c57e33ebb81d6f29f4a5730cc0"}
Nov 04 02:32:53.443228 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:53.443207    4548 scope.go:122] "RemoveContainer" containerID="58e3b2c28fc62c18716f92c7b229d910766441c57e33ebb81d6f29f4a5730cc0"
Nov 04 02:32:53.444793 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:53.444762    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:32:53.444867 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:53.444837    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:32:53.444903 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:53.444870    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:32:54.452002 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:54.451961    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr" event={"ID":"4b694e41-1176-4a62-a1eb-6451520b1ece","Type":"ContainerStarted","Data":"ed290b86713aef36855ba6b858ebf962722394f6ddd12342c04fe746eba290ac"}
Nov 04 02:32:54.497945 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:54.497908    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:32:54.498188 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:54.498131    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 02:32:54.498276 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:54.498218    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr" podUID="4b694e41-1176-4a62-a1eb-6451520b1ece" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 02:32:55.497591 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:55.497552    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 02:32:55.498060 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:55.497624    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr" podUID="4b694e41-1176-4a62-a1eb-6451520b1ece" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 02:32:56.498362 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:56.498319    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 02:32:56.498815 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:56.498381    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr" podUID="4b694e41-1176-4a62-a1eb-6451520b1ece" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 02:32:57.497971 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:57.497930    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 02:32:57.498244 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:57.498007    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr" podUID="4b694e41-1176-4a62-a1eb-6451520b1ece" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 02:32:58.497840 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:58.497799    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 02:32:58.498309 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:58.497872    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr" podUID="4b694e41-1176-4a62-a1eb-6451520b1ece" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 02:32:59.497808 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:59.497770    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Nov 04 02:32:59.498048 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:32:59.497838    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr" podUID="4b694e41-1176-4a62-a1eb-6451520b1ece" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Nov 04 02:33:00.504704 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:00.504670    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:33:00.506806 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:00.506780    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:33:00.508147 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:00.508122    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:33:02.885610 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:02.885569    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"]
Nov 04 02:33:02.889469 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:02.889443    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:02.942551 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:02.942508    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-a-80b404-openshift-default-dockercfg-rpgsp\""
Nov 04 02:33:02.995748 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:02.995706    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"]
Nov 04 02:33:03.003623 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.003584    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-credential-socket\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.003623 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.003627    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-workload-certs\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.003917 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.003652    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-envoy\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.003917 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.003751    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-podinfo\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.003917 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.003850    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-workload-socket\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.004074 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.003980    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl8zz\" (UniqueName: \"kubernetes.io/projected/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-kube-api-access-pl8zz\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.004131 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.004070    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-token\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.004210 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.004141    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istiod-ca-cert\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.004363 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.004335    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-data\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.109925 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.109877    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-workload-socket\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.110115 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.109961    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl8zz\" (UniqueName: \"kubernetes.io/projected/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-kube-api-access-pl8zz\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.110115 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.110034    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-token\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.110115 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.110102    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istiod-ca-cert\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.110295 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.110251    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-data\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.110334 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.110321    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-credential-socket\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.110368 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.110349    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-workload-certs\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.110413 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.110376    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-envoy\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.110413 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.110401    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-podinfo\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.111707 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.111669    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istiod-ca-cert\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.111962 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.111939    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-workload-socket\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.118663 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.112853    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-data\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.118663 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.113113    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-credential-socket\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.118663 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.113415    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-workload-certs\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.118663 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.113634    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-podinfo\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.119755 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.119728    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-envoy\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.179571 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.179488    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-token\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.179790 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.179765    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl8zz\" (UniqueName: \"kubernetes.io/projected/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-kube-api-access-pl8zz\") pod \"e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") " pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.204088 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.204047    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:03.645603 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.645572    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"]
Nov 04 02:33:03.646514 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:33:03.646486    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podede38477_3c2a_4aa8_8f7d_dadfd75bdfa6.slice/crio-b7f15936b46995aa05d2a455bdff8769b3fb288356050e101d9cc403f671a8ca WatchSource:0}: Error finding container b7f15936b46995aa05d2a455bdff8769b3fb288356050e101d9cc403f671a8ca: Status 404 returned error can't find the container with id b7f15936b46995aa05d2a455bdff8769b3fb288356050e101d9cc403f671a8ca
Nov 04 02:33:03.649015 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.648980    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:33:03.649085 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.649055    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:33:03.649121 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:03.649082    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:33:04.549495 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:04.549455    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd" event={"ID":"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6","Type":"ContainerStarted","Data":"14646dc3bf7c708df4b510f5a26d5c9db4b2ec8092c11872257095fc89a4ff5b"}
Nov 04 02:33:04.550005 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:04.549515    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd" event={"ID":"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6","Type":"ContainerStarted","Data":"b7f15936b46995aa05d2a455bdff8769b3fb288356050e101d9cc403f671a8ca"}
Nov 04 02:33:04.722163 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:04.722107    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd" podStartSLOduration=2.722090332 podStartE2EDuration="2.722090332s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:33:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:33:04.720076879 +0000 UTC m=+1018.325089904" watchObservedRunningTime="2026-11-04 02:33:04.722090332 +0000 UTC m=+1018.327103329"
Nov 04 02:33:05.205329 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:05.205291    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:05.211425 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:05.211396    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:05.556681 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:05.556648    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:05.557773 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:05.557752    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:33:10.612083 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:33:10.612046    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:33:20.398038 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.397954    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"]
Nov 04 02:33:20.402968 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.402936    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.502660 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.502620    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"]
Nov 04 02:33:20.519112 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.519064    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-credential-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.519353 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.519233    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-envoy\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.519353 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.519293    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4vxm\" (UniqueName: \"kubernetes.io/projected/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-kube-api-access-w4vxm\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.519490 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.519410    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-data\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.519490 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.519442    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-workload-certs\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.519490 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.519482    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-token\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.519662 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.519502    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istiod-ca-cert\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.519725 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.519676    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-workload-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.519725 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.519715    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-podinfo\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.621387 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.621338    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istiod-ca-cert\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.621605 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.621431    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-workload-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.621605 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.621456    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-podinfo\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.621605 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.621501    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-credential-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.621605 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.621577    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-envoy\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.621605 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.621599    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4vxm\" (UniqueName: \"kubernetes.io/projected/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-kube-api-access-w4vxm\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.621891 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.621640    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-data\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.621891 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.621671    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-workload-certs\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.621891 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.621718    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-token\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.622052 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.621914    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-workload-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.622052 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.621990    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-credential-socket\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.622240 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.622215    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-data\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.622319 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.622237    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istiod-ca-cert\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.622319 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.622273    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-workload-certs\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.624154 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.624122    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-envoy\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.624300 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.624260    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-podinfo\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.698554 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.698232    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4vxm\" (UniqueName: \"kubernetes.io/projected/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-kube-api-access-w4vxm\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.698554 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.698455    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-token\") pod \"e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") " pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:20.717158 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:20.717122    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:21.198112 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:21.198083    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"]
Nov 04 02:33:21.199713 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:33:21.199686    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fa0bc0c_e89d_4af3_9212_ca64152dd1b9.slice/crio-82e14eecff7a64b33318a1f62aa9f6ef7d427bca0692b9a7610e92f64f087217 WatchSource:0}: Error finding container 82e14eecff7a64b33318a1f62aa9f6ef7d427bca0692b9a7610e92f64f087217: Status 404 returned error can't find the container with id 82e14eecff7a64b33318a1f62aa9f6ef7d427bca0692b9a7610e92f64f087217
Nov 04 02:33:21.203249 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:21.203207    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:33:21.203337 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:21.203301    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:33:21.203377 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:21.203346    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:33:21.684400 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:21.684355    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w" event={"ID":"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9","Type":"ContainerStarted","Data":"5dcb8a7b3d3114b263550a8008109c00c0346e0301f8d41721cc56a8dee64e96"}
Nov 04 02:33:21.684927 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:21.684431    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w" event={"ID":"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9","Type":"ContainerStarted","Data":"82e14eecff7a64b33318a1f62aa9f6ef7d427bca0692b9a7610e92f64f087217"}
Nov 04 02:33:21.717871 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:21.717836    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:21.810617 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:21.810547    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w" podStartSLOduration=1.810516386 podStartE2EDuration="1.810516386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:33:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:33:21.808957807 +0000 UTC m=+1035.413970807" watchObservedRunningTime="2026-11-04 02:33:21.810516386 +0000 UTC m=+1035.415529385"
Nov 04 02:33:22.720259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:22.720218    4548 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 02:33:22.720663 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:22.720282    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w" podUID="9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 02:33:23.718224 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:23.718184    4548 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 02:33:23.718438 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:23.718252    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w" podUID="9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 02:33:24.728257 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:24.728221    4548 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 02:33:24.728844 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:24.728812    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w" podUID="9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 02:33:25.718266 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:25.718066    4548 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 02:33:25.718266 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:25.718190    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w" podUID="9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 02:33:26.718489 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:26.718400    4548 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 02:33:26.718489 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:26.718468    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w" podUID="9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 02:33:26.752909 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:26.752878    4548 generic.go:356] "Generic (PLEG): container finished" podID="be003f9f-9a96-47b9-b603-c2698b09a2a0" containerID="fa03dd3f7af23021eb4e748626cf8bedba5195876b9273df4369e32fa48dae34" exitCode=0
Nov 04 02:33:26.753089 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:26.752962    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d" event={"ID":"be003f9f-9a96-47b9-b603-c2698b09a2a0","Type":"ContainerDied","Data":"fa03dd3f7af23021eb4e748626cf8bedba5195876b9273df4369e32fa48dae34"}
Nov 04 02:33:26.753452 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:26.753437    4548 scope.go:122] "RemoveContainer" containerID="fa03dd3f7af23021eb4e748626cf8bedba5195876b9273df4369e32fa48dae34"
Nov 04 02:33:26.755098 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:26.755064    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:33:26.755184 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:26.755146    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:33:26.755226 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:26.755198    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:33:27.717803 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:27.717770    4548 patch_prober.go:29] interesting pod/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused" start-of-body=
Nov 04 02:33:27.718017 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:27.717832    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w" podUID="9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.72:15021/healthz/ready\": dial tcp 10.133.0.72:15021: connect: connection refused"
Nov 04 02:33:27.790855 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:27.790043    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d" event={"ID":"be003f9f-9a96-47b9-b603-c2698b09a2a0","Type":"ContainerStarted","Data":"49cf7faa519e843741d49c913e7ba5cff7138e147d4fac41cbcb0e9ec2319827"}
Nov 04 02:33:28.632683 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:28.632626    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:33:28.634982 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:28.634945    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Nov 04 02:33:28.635213 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:28.635006    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d" podUID="be003f9f-9a96-47b9-b603-c2698b09a2a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Nov 04 02:33:29.312055 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:29.312002    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:29.312604 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:29.312447    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:29.313529 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:29.313501    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:33:29.633358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:29.633265    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Nov 04 02:33:29.633553 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:29.633380    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d" podUID="be003f9f-9a96-47b9-b603-c2698b09a2a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Nov 04 02:33:30.634140 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:30.634101    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Nov 04 02:33:30.634608 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:30.634204    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d" podUID="be003f9f-9a96-47b9-b603-c2698b09a2a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Nov 04 02:33:31.633627 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:31.633592    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Nov 04 02:33:31.633817 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:31.633653    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d" podUID="be003f9f-9a96-47b9-b603-c2698b09a2a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Nov 04 02:33:32.151259 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:32.151219    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:33:32.633986 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:32.633950    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused" start-of-body=
Nov 04 02:33:32.634213 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:32.634035    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d" podUID="be003f9f-9a96-47b9-b603-c2698b09a2a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.70:15021/healthz/ready\": dial tcp 10.133.0.70:15021: connect: connection refused"
Nov 04 02:33:33.638729 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:33.638691    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:33:33.640067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:33.640042    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:33:40.611904 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:33:40.611859    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:33:45.554934 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.554896    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"]
Nov 04 02:33:45.558857 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.558835    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.596554 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.596513    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.596758 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.596594    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.596818 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.596780    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.596863 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.596832    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.596911 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.596890    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.597005 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.596982    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.597074 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.597057    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2hht\" (UniqueName: \"kubernetes.io/projected/79d6d61c-e0cd-4b22-8ae7-212908d5249d-kube-api-access-c2hht\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.597163 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.597140    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.597225 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.597194    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.668065 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.668025    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"]
Nov 04 02:33:45.698945 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.698905    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.699121 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.699020    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.699121 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.699097    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.699341 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.699300    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.699475 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.699419    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.699581 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.699497    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.699581 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.699569    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2hht\" (UniqueName: \"kubernetes.io/projected/79d6d61c-e0cd-4b22-8ae7-212908d5249d-kube-api-access-c2hht\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.699765 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.699588    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.699765 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.699624    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.699765 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.699653    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.699765 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.699727    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.699974 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.699774    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.700019 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.699999    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.700156 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.700138    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.702339 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.702305    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.702513 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.702490    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.762281 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.762242    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.762546 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.762526    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2hht\" (UniqueName: \"kubernetes.io/projected/79d6d61c-e0cd-4b22-8ae7-212908d5249d-kube-api-access-c2hht\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:45.872813 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:45.872668    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:46.315461 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:46.315438    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"]
Nov 04 02:33:46.318640 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:33:46.318604    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79d6d61c_e0cd_4b22_8ae7_212908d5249d.slice/crio-9bb06ae948a6a3cf201d0fc2ab7fb5f3936ff6c9c0fec9985e8fafeac2ad642e WatchSource:0}: Error finding container 9bb06ae948a6a3cf201d0fc2ab7fb5f3936ff6c9c0fec9985e8fafeac2ad642e: Status 404 returned error can't find the container with id 9bb06ae948a6a3cf201d0fc2ab7fb5f3936ff6c9c0fec9985e8fafeac2ad642e
Nov 04 02:33:46.321112 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:46.321074    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:33:46.321230 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:46.321200    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:33:46.321278 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:46.321233    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:33:46.929160 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:46.929118    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj" event={"ID":"79d6d61c-e0cd-4b22-8ae7-212908d5249d","Type":"ContainerStarted","Data":"bb9d44bd5269e46b54c2c079d7a6faae5703ceaace5a85b5f0ccc40f3f6eadfd"}
Nov 04 02:33:46.929673 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:46.929207    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj" event={"ID":"79d6d61c-e0cd-4b22-8ae7-212908d5249d","Type":"ContainerStarted","Data":"9bb06ae948a6a3cf201d0fc2ab7fb5f3936ff6c9c0fec9985e8fafeac2ad642e"}
Nov 04 02:33:47.154023 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:47.153962    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj" podStartSLOduration=2.153944934 podStartE2EDuration="2.153944934s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:33:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:33:47.102879184 +0000 UTC m=+1060.707892181" watchObservedRunningTime="2026-11-04 02:33:47.153944934 +0000 UTC m=+1060.758957932"
Nov 04 02:33:47.883196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:47.882239    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:47.885407 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:47.885363    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 04 02:33:47.885602 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:47.885451    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj" podUID="79d6d61c-e0cd-4b22-8ae7-212908d5249d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 04 02:33:48.877693 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:48.877643    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 04 02:33:48.878458 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:48.878418    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj" podUID="79d6d61c-e0cd-4b22-8ae7-212908d5249d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 04 02:33:49.874698 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:49.874652    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 04 02:33:49.875006 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:49.874972    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj" podUID="79d6d61c-e0cd-4b22-8ae7-212908d5249d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 04 02:33:50.885787 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:50.885744    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 04 02:33:50.886379 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:50.885808    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj" podUID="79d6d61c-e0cd-4b22-8ae7-212908d5249d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 04 02:33:51.874644 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:51.874594    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 04 02:33:51.874968 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:51.874935    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj" podUID="79d6d61c-e0cd-4b22-8ae7-212908d5249d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 04 02:33:52.873564 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:52.873507    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused" start-of-body=
Nov 04 02:33:52.874251 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:52.874213    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj" podUID="79d6d61c-e0cd-4b22-8ae7-212908d5249d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.73:15021/healthz/ready\": dial tcp 10.133.0.73:15021: connect: connection refused"
Nov 04 02:33:54.169621 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:54.169588    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:54.170909 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:54.170873    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:54.178862 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:54.178834    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:33:58.829457 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:58.829425    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"]
Nov 04 02:33:58.833587 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:58.833563    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:58.886999 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:58.886928    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-b-d501fd-openshift-default-dockercfg-cv2fz\""
Nov 04 02:33:58.941449 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:58.941412    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"]
Nov 04 02:33:58.943239 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:58.943208    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-data\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:58.943424 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:58.943264    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-podinfo\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:58.943424 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:58.943326    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-workload-certs\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:58.943547 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:58.943454    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-envoy\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:58.943547 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:58.943493    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-credential-socket\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:58.943658 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:58.943584    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fw22w\" (UniqueName: \"kubernetes.io/projected/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-kube-api-access-fw22w\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:58.943714 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:58.943660    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-token\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:58.943714 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:58.943705    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-workload-socket\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:58.943818 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:58.943725    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istiod-ca-cert\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.045388 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.045331    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fw22w\" (UniqueName: \"kubernetes.io/projected/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-kube-api-access-fw22w\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.045600 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.045456    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-token\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.045600 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.045537    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-workload-socket\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.045600 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.045583    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istiod-ca-cert\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.045758 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.045715    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-data\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.045815 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.045783    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-podinfo\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.045869 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.045826    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-workload-certs\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.045927 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.045915    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-envoy\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.045979 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.045949    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-credential-socket\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.046558 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.046535    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-credential-socket\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.047325 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.047283    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-workload-certs\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.048284 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.047522    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-data\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.048462 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.047588    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-workload-socket\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.048578 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.048155    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istiod-ca-cert\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.049917 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.049896    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-podinfo\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.050379 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.050361    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-envoy\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.108508 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.108424    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-token\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.109428 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.109291    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fw22w\" (UniqueName: \"kubernetes.io/projected/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-kube-api-access-fw22w\") pod \"e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") " pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.149414 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.149364    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:33:59.629664 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.629630    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"]
Nov 04 02:33:59.630616 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:33:59.630587    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5f00213_c2d0_4e55_ac63_8d35d6a33a9c.slice/crio-4ba7582dfcb9f59c00fa53d094911b1ede6cb58827e4725a5e8f785add543ab5 WatchSource:0}: Error finding container 4ba7582dfcb9f59c00fa53d094911b1ede6cb58827e4725a5e8f785add543ab5: Status 404 returned error can't find the container with id 4ba7582dfcb9f59c00fa53d094911b1ede6cb58827e4725a5e8f785add543ab5
Nov 04 02:33:59.633559 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.633515    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:33:59.633654 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.633599    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:33:59.633654 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:33:59.633634    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:34:00.059206 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:00.058478    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9" event={"ID":"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c","Type":"ContainerStarted","Data":"8723899f124bacc79d04ea3509734cc06351a30646bdc11c8953e89959f6c23b"}
Nov 04 02:34:00.059206 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:00.058543    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9" event={"ID":"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c","Type":"ContainerStarted","Data":"4ba7582dfcb9f59c00fa53d094911b1ede6cb58827e4725a5e8f785add543ab5"}
Nov 04 02:34:00.149908 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:00.149870    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:34:00.156809 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:00.156779    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:34:00.180895 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:00.180840    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9" podStartSLOduration=2.180826378 podStartE2EDuration="2.180826378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:33:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:00.179996958 +0000 UTC m=+1073.785009956" watchObservedRunningTime="2026-11-04 02:34:00.180826378 +0000 UTC m=+1073.785839375"
Nov 04 02:34:01.065554 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:01.065510    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:34:01.066803 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:01.066780    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:34:10.613414 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:34:10.613378    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:34:13.126629 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.126582    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"]
Nov 04 02:34:13.132680 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.132640    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.228999 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.228957    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"]
Nov 04 02:34:13.262196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.254314    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23147413-4835-469c-8d48-a9e14776d20c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.262196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.255387    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23147413-4835-469c-8d48-a9e14776d20c-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.262196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.255504    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23147413-4835-469c-8d48-a9e14776d20c-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.262196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.255541    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msfbr\" (UniqueName: \"kubernetes.io/projected/23147413-4835-469c-8d48-a9e14776d20c-kube-api-access-msfbr\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.262196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.255579    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23147413-4835-469c-8d48-a9e14776d20c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.262196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.255645    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23147413-4835-469c-8d48-a9e14776d20c-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.262196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.255703    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23147413-4835-469c-8d48-a9e14776d20c-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.262196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.255737    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23147413-4835-469c-8d48-a9e14776d20c-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.262196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.255774    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23147413-4835-469c-8d48-a9e14776d20c-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.359203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.358761    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23147413-4835-469c-8d48-a9e14776d20c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.359203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.358838    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23147413-4835-469c-8d48-a9e14776d20c-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.359203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.358936    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23147413-4835-469c-8d48-a9e14776d20c-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.359203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.358969    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msfbr\" (UniqueName: \"kubernetes.io/projected/23147413-4835-469c-8d48-a9e14776d20c-kube-api-access-msfbr\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.359203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.359006    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23147413-4835-469c-8d48-a9e14776d20c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.359203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.359064    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23147413-4835-469c-8d48-a9e14776d20c-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.359203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.359117    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23147413-4835-469c-8d48-a9e14776d20c-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.359203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.359149    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23147413-4835-469c-8d48-a9e14776d20c-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.359203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.359205    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23147413-4835-469c-8d48-a9e14776d20c-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.359793 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.359663    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23147413-4835-469c-8d48-a9e14776d20c-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.385273 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.360294    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23147413-4835-469c-8d48-a9e14776d20c-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.385273 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.360537    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23147413-4835-469c-8d48-a9e14776d20c-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.385273 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.360765    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23147413-4835-469c-8d48-a9e14776d20c-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.385273 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.363119    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23147413-4835-469c-8d48-a9e14776d20c-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.385273 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.382112    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23147413-4835-469c-8d48-a9e14776d20c-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.393700 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.389543    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23147413-4835-469c-8d48-a9e14776d20c-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.448201 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.447926    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msfbr\" (UniqueName: \"kubernetes.io/projected/23147413-4835-469c-8d48-a9e14776d20c-kube-api-access-msfbr\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.448407 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.448362    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23147413-4835-469c-8d48-a9e14776d20c-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-fm8nm\" (UID: \"23147413-4835-469c-8d48-a9e14776d20c\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:13.570630 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:13.570578    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:14.027656 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:14.027624    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"]
Nov 04 02:34:14.028605 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:34:14.028571    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23147413_4835_469c_8d48_a9e14776d20c.slice/crio-1889d87a1ac97c3d66018c3874554a135d560629281923f7289f4e7fd696da4e WatchSource:0}: Error finding container 1889d87a1ac97c3d66018c3874554a135d560629281923f7289f4e7fd696da4e: Status 404 returned error can't find the container with id 1889d87a1ac97c3d66018c3874554a135d560629281923f7289f4e7fd696da4e
Nov 04 02:34:14.032396 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:14.032352    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:34:14.032499 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:14.032451    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:34:14.032538 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:14.032494    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:34:14.278257 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:14.275784    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm" event={"ID":"23147413-4835-469c-8d48-a9e14776d20c","Type":"ContainerStarted","Data":"9097de8e7a1879cd74dfdbe27379e095538f0857b10ea101730b7c1d5e4edc9c"}
Nov 04 02:34:14.278257 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:14.275860    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm" event={"ID":"23147413-4835-469c-8d48-a9e14776d20c","Type":"ContainerStarted","Data":"1889d87a1ac97c3d66018c3874554a135d560629281923f7289f4e7fd696da4e"}
Nov 04 02:34:14.575414 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:14.575308    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:15.579724 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:15.579304    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-fm8nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:34:15.579724 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:15.579393    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm" podUID="23147413-4835-469c-8d48-a9e14776d20c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 04 02:34:16.579215 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:16.574663    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-fm8nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:34:16.579215 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:16.574745    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm" podUID="23147413-4835-469c-8d48-a9e14776d20c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 04 02:34:17.586197 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:17.582601    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-fm8nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:34:17.586197 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:17.582684    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm" podUID="23147413-4835-469c-8d48-a9e14776d20c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 04 02:34:18.581198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:18.572624    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-fm8nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:34:18.581198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:18.572707    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm" podUID="23147413-4835-469c-8d48-a9e14776d20c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 04 02:34:19.578198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:19.577814    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-fm8nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:34:19.578198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:19.577882    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm" podUID="23147413-4835-469c-8d48-a9e14776d20c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 04 02:34:20.407662 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.407600    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm" podStartSLOduration=7.407582788 podStartE2EDuration="7.407582788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:14.407931876 +0000 UTC m=+1088.012944892" watchObservedRunningTime="2026-11-04 02:34:20.407582788 +0000 UTC m=+1094.012595786"
Nov 04 02:34:20.410104 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.410076    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"]
Nov 04 02:34:20.414545 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.414525    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.484199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.476887    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.484199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.476987    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.484199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.477040    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.484199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.477124    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5wrp\" (UniqueName: \"kubernetes.io/projected/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-kube-api-access-f5wrp\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.484199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.477188    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.484199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.477274    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.484199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.477314    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.484199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.477387    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.484199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.477419    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.572872 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.571944    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-fm8nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:34:20.572872 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.572283    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm" podUID="23147413-4835-469c-8d48-a9e14776d20c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 04 02:34:20.579031 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.578988    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.579694 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.579654    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.579847 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.579726    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.579847 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.579824    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5wrp\" (UniqueName: \"kubernetes.io/projected/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-kube-api-access-f5wrp\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.579960 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.579894    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.580017 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.579961    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.580017 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.580002    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.580113 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.580067    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.580184 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.580114    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.581793 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.580668    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.581793 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.581282    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.581793 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.581526    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.581793 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.581759    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.582076 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.582060    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.584694 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.584662    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.585133 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.585112    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.632758 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.631918    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"]
Nov 04 02:34:20.643219 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.642376    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.643219 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.642387    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5wrp\" (UniqueName: \"kubernetes.io/projected/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-kube-api-access-f5wrp\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:20.730747 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:20.730525    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:21.196418 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:21.196379    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"]
Nov 04 02:34:21.197385 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:34:21.197331    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3ddabe8_3942_4edc_9bc5_3d3a8da8dd32.slice/crio-43354c37f206f8711b4eac1785dd8dd19f5ff124e06f8ff95d03c64ffa17b3fe WatchSource:0}: Error finding container 43354c37f206f8711b4eac1785dd8dd19f5ff124e06f8ff95d03c64ffa17b3fe: Status 404 returned error can't find the container with id 43354c37f206f8711b4eac1785dd8dd19f5ff124e06f8ff95d03c64ffa17b3fe
Nov 04 02:34:21.201638 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:21.201586    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:34:21.201752 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:21.201693    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:34:21.201800 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:21.201748    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:34:21.482717 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:21.482613    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2" event={"ID":"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32","Type":"ContainerStarted","Data":"4619c4ceaf5c665bee9d278f6e251a8898dab1ed5a8431020f121107d2cda04f"}
Nov 04 02:34:21.482717 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:21.482685    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2" event={"ID":"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32","Type":"ContainerStarted","Data":"43354c37f206f8711b4eac1785dd8dd19f5ff124e06f8ff95d03c64ffa17b3fe"}
Nov 04 02:34:21.571748 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:21.571699    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-fm8nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:34:21.571976 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:21.571776    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm" podUID="23147413-4835-469c-8d48-a9e14776d20c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 04 02:34:21.599274 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:21.599191    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 02:34:21.600522 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:21.599439    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd" podUID="ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:34:21.610240 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:21.607976    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2" podStartSLOduration=1.607957316 podStartE2EDuration="1.607957316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:21.607842175 +0000 UTC m=+1095.212855175" watchObservedRunningTime="2026-11-04 02:34:21.607957316 +0000 UTC m=+1095.212970317"
Nov 04 02:34:21.731388 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:21.731341    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:22.587196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:22.586833    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-fm8nm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused" start-of-body=
Nov 04 02:34:22.587196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:22.586915    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm" podUID="23147413-4835-469c-8d48-a9e14776d20c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.75:15021/healthz/ready\": dial tcp 10.133.0.75:15021: connect: connection refused"
Nov 04 02:34:22.733641 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:22.733609    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 04 02:34:22.734089 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:22.734062    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2" podUID="b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 04 02:34:23.732461 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:23.731820    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 04 02:34:23.732461 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:23.731886    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2" podUID="b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 04 02:34:24.530729 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:24.530695    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:24.531224 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:24.531200    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:24.532624 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:24.532603    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-fm8nm"
Nov 04 02:34:24.731300 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:24.731257    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 04 02:34:24.731482 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:24.731342    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2" podUID="b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 04 02:34:24.764215 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:24.760206    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462"]
Nov 04 02:34:24.803101 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:24.801424    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462"
Nov 04 02:34:24.819901 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:24.818559    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462"]
Nov 04 02:34:24.854716 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:24.854684    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:34:24.855064 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:24.855044    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 02:34:24.855300 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:24.855202    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:34:24.855464 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:24.855383    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:34:24.887633 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:24.887587    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ed658b59-6b9d-45eb-b5d8-80f40d574e60-maas-api-xks-ca\") pod \"maas-api-revoke-sub-21e2b100-kl462\" (UID: \"ed658b59-6b9d-45eb-b5d8-80f40d574e60\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462"
Nov 04 02:34:24.888122 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:24.888099    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wsvl\" (UniqueName: \"kubernetes.io/projected/ed658b59-6b9d-45eb-b5d8-80f40d574e60-kube-api-access-6wsvl\") pod \"maas-api-revoke-sub-21e2b100-kl462\" (UID: \"ed658b59-6b9d-45eb-b5d8-80f40d574e60\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462"
Nov 04 02:34:24.888407 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:24.888385    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ed658b59-6b9d-45eb-b5d8-80f40d574e60-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-21e2b100-kl462\" (UID: \"ed658b59-6b9d-45eb-b5d8-80f40d574e60\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462"
Nov 04 02:34:24.991199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:24.991064    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wsvl\" (UniqueName: \"kubernetes.io/projected/ed658b59-6b9d-45eb-b5d8-80f40d574e60-kube-api-access-6wsvl\") pod \"maas-api-revoke-sub-21e2b100-kl462\" (UID: \"ed658b59-6b9d-45eb-b5d8-80f40d574e60\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462"
Nov 04 02:34:24.991199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:24.991198    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ed658b59-6b9d-45eb-b5d8-80f40d574e60-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-21e2b100-kl462\" (UID: \"ed658b59-6b9d-45eb-b5d8-80f40d574e60\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462"
Nov 04 02:34:24.991491 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:24.991323    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ed658b59-6b9d-45eb-b5d8-80f40d574e60-maas-api-xks-ca\") pod \"maas-api-revoke-sub-21e2b100-kl462\" (UID: \"ed658b59-6b9d-45eb-b5d8-80f40d574e60\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462"
Nov 04 02:34:25.026060 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:25.026023    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ed658b59-6b9d-45eb-b5d8-80f40d574e60-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-21e2b100-kl462\" (UID: \"ed658b59-6b9d-45eb-b5d8-80f40d574e60\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462"
Nov 04 02:34:25.052786 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:25.052539    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ed658b59-6b9d-45eb-b5d8-80f40d574e60-maas-api-xks-ca\") pod \"maas-api-revoke-sub-21e2b100-kl462\" (UID: \"ed658b59-6b9d-45eb-b5d8-80f40d574e60\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462"
Nov 04 02:34:25.121528 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:25.121442    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wsvl\" (UniqueName: \"kubernetes.io/projected/ed658b59-6b9d-45eb-b5d8-80f40d574e60-kube-api-access-6wsvl\") pod \"maas-api-revoke-sub-21e2b100-kl462\" (UID: \"ed658b59-6b9d-45eb-b5d8-80f40d574e60\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462"
Nov 04 02:34:25.125688 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:25.125391    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462"
Nov 04 02:34:25.737141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:25.736647    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 04 02:34:25.737141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:25.736714    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2" podUID="b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 04 02:34:26.010025 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:26.009981    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462"]
Nov 04 02:34:26.731828 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:26.731789    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 04 02:34:26.732067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:26.731851    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2" podUID="b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 04 02:34:26.823290 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:26.822549    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462" event={"ID":"ed658b59-6b9d-45eb-b5d8-80f40d574e60","Type":"ContainerStarted","Data":"e29e9b9c9cf978dfc935ad08dfa8a6ce903f4f6368133a62db57dd825563158b"}
Nov 04 02:34:26.823290 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:26.822612    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462" event={"ID":"ed658b59-6b9d-45eb-b5d8-80f40d574e60","Type":"ContainerStarted","Data":"ec443b27e2af71d2f86c33f573bd703a91cde8ff2e6b9991e2114a4b6fdad403"}
Nov 04 02:34:26.825666 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:26.825639    4548 generic.go:356] "Generic (PLEG): container finished" podID="ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" containerID="14646dc3bf7c708df4b510f5a26d5c9db4b2ec8092c11872257095fc89a4ff5b" exitCode=0
Nov 04 02:34:26.825914 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:26.825709    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd" event={"ID":"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6","Type":"ContainerDied","Data":"14646dc3bf7c708df4b510f5a26d5c9db4b2ec8092c11872257095fc89a4ff5b"}
Nov 04 02:34:26.826422 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:26.826398    4548 scope.go:122] "RemoveContainer" containerID="14646dc3bf7c708df4b510f5a26d5c9db4b2ec8092c11872257095fc89a4ff5b"
Nov 04 02:34:26.828323 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:26.828283    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:34:26.828455 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:26.828389    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:34:26.828455 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:26.828440    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:34:27.088199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:27.087461    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462" podStartSLOduration=3.087436864 podStartE2EDuration="3.087436864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:26.950389617 +0000 UTC m=+1100.555402620" watchObservedRunningTime="2026-11-04 02:34:27.087436864 +0000 UTC m=+1100.692449865"
Nov 04 02:34:27.731661 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:27.731621    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 04 02:34:27.731862 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:27.731679    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2" podUID="b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 04 02:34:27.835002 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:27.834965    4548 generic.go:356] "Generic (PLEG): container finished" podID="ed658b59-6b9d-45eb-b5d8-80f40d574e60" containerID="e29e9b9c9cf978dfc935ad08dfa8a6ce903f4f6368133a62db57dd825563158b" exitCode=0
Nov 04 02:34:27.835486 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:27.835061    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462" event={"ID":"ed658b59-6b9d-45eb-b5d8-80f40d574e60","Type":"ContainerDied","Data":"e29e9b9c9cf978dfc935ad08dfa8a6ce903f4f6368133a62db57dd825563158b"}
Nov 04 02:34:27.837510 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:27.837484    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd" event={"ID":"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6","Type":"ContainerStarted","Data":"98f7d8ecbeb06601663ba4b2c214c8830224c407f2dfdb985ffd339a28425029"}
Nov 04 02:34:28.221219 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.220644    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:34:28.221219 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.220770    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 02:34:28.221219 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.220816    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd" podUID="ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 02:34:28.240512 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.240475    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"]
Nov 04 02:34:28.244723 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.244695    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.337506 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.336938    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.337506 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.337009    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.337506 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.337082    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.337506 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.337116    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.337506 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.337187    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.337506 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.337274    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j48zz\" (UniqueName: \"kubernetes.io/projected/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-kube-api-access-j48zz\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.337506 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.337352    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.337506 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.337394    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.338906 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.337519    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.420783 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.418132    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"]
Nov 04 02:34:28.438674 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.438640    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.438898 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.438682    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.438898 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.438753    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.438898 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.438787    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.438898 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.438830    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.438898 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.438854    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.438898 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.438885    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.439097 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.438925    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j48zz\" (UniqueName: \"kubernetes.io/projected/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-kube-api-access-j48zz\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.439097 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.438969    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.439548 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.439523    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.439885 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.439859    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.439988 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.439971    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.440117 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.440095    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.440450 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.440428    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.442309 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.442287    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.444254 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.444230    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.505251 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.504309    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.506208 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.506150    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j48zz\" (UniqueName: \"kubernetes.io/projected/0f11c2f4-cf3d-4a32-af0d-2eb177b7264d-kube-api-access-j48zz\") pod \"maas-default-gateway-openshift-default-fd4b99879-q7hnw\" (UID: \"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.576526 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.570458    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:28.733195 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.731477    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused" start-of-body=
Nov 04 02:34:28.733195 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:28.731535    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2" podUID="b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.76:15021/healthz/ready\": dial tcp 10.133.0.76:15021: connect: connection refused"
Nov 04 02:34:29.125485 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.125450    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"]
Nov 04 02:34:29.140384 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.138212    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:34:29.140384 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.138314    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:34:29.140384 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.138366    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:34:29.151211 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.150933    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462"
Nov 04 02:34:29.213856 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.213822    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 02:34:29.214056 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.213869    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd" podUID="ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 02:34:29.333832 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.333794    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ed658b59-6b9d-45eb-b5d8-80f40d574e60-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ed658b59-6b9d-45eb-b5d8-80f40d574e60-maas-api-xks-ca\") pod \"ed658b59-6b9d-45eb-b5d8-80f40d574e60\" (UID: \"ed658b59-6b9d-45eb-b5d8-80f40d574e60\") "
Nov 04 02:34:29.334003 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.333949    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ed658b59-6b9d-45eb-b5d8-80f40d574e60-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ed658b59-6b9d-45eb-b5d8-80f40d574e60-maas-api-openshift-ca\") pod \"ed658b59-6b9d-45eb-b5d8-80f40d574e60\" (UID: \"ed658b59-6b9d-45eb-b5d8-80f40d574e60\") "
Nov 04 02:34:29.334101 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.334072    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ed658b59-6b9d-45eb-b5d8-80f40d574e60-kube-api-access-6wsvl\" (UniqueName: \"kubernetes.io/projected/ed658b59-6b9d-45eb-b5d8-80f40d574e60-kube-api-access-6wsvl\") pod \"ed658b59-6b9d-45eb-b5d8-80f40d574e60\" (UID: \"ed658b59-6b9d-45eb-b5d8-80f40d574e60\") "
Nov 04 02:34:29.343868 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.343825    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed658b59-6b9d-45eb-b5d8-80f40d574e60-maas-api-openshift-ca" pod "ed658b59-6b9d-45eb-b5d8-80f40d574e60" (UID: "ed658b59-6b9d-45eb-b5d8-80f40d574e60"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:34:29.358808 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.358758    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed658b59-6b9d-45eb-b5d8-80f40d574e60-kube-api-access-6wsvl" pod "ed658b59-6b9d-45eb-b5d8-80f40d574e60" (UID: "ed658b59-6b9d-45eb-b5d8-80f40d574e60"). InnerVolumeSpecName "kube-api-access-6wsvl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:34:29.412753 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.372257    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed658b59-6b9d-45eb-b5d8-80f40d574e60-maas-api-xks-ca" pod "ed658b59-6b9d-45eb-b5d8-80f40d574e60" (UID: "ed658b59-6b9d-45eb-b5d8-80f40d574e60"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:34:29.443561 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.443234    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wsvl\" (UniqueName: \"kubernetes.io/projected/ed658b59-6b9d-45eb-b5d8-80f40d574e60-kube-api-access-6wsvl\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:34:29.443825 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.443804    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ed658b59-6b9d-45eb-b5d8-80f40d574e60-maas-api-xks-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:34:29.443918 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.443906    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ed658b59-6b9d-45eb-b5d8-80f40d574e60-maas-api-openshift-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:34:29.735936 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.735857    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:29.736321 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.736291    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:29.737088 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.737072    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:34:29.858850 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.858808    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462" event={"ID":"ed658b59-6b9d-45eb-b5d8-80f40d574e60","Type":"ContainerDied","Data":"ec443b27e2af71d2f86c33f573bd703a91cde8ff2e6b9991e2114a4b6fdad403"}
Nov 04 02:34:29.858850 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.858837    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462"
Nov 04 02:34:29.859122 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.858871    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ec443b27e2af71d2f86c33f573bd703a91cde8ff2e6b9991e2114a4b6fdad403"
Nov 04 02:34:29.894197 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.893225    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw" event={"ID":"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d","Type":"ContainerStarted","Data":"6e232c3b6483befe5b1aa0e955460188a035c20af93e4291f54177689402df58"}
Nov 04 02:34:29.894197 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:29.893292    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw" event={"ID":"0f11c2f4-cf3d-4a32-af0d-2eb177b7264d","Type":"ContainerStarted","Data":"eb21cfd6aa901ba3777fdac8e0c9ae1472097bd98bc8b3b53f32f7a41e3427c3"}
Nov 04 02:34:30.225051 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:30.220962    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw" podStartSLOduration=2.220938783 podStartE2EDuration="2.220938783s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:30.189590149 +0000 UTC m=+1103.794603150" watchObservedRunningTime="2026-11-04 02:34:30.220938783 +0000 UTC m=+1103.825951782"
Nov 04 02:34:30.225646 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:30.222309    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 02:34:30.225646 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:30.225292    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd" podUID="ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 02:34:30.591197 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:30.573414    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:30.591197 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:30.575333    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-q7hnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Nov 04 02:34:30.591197 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:30.575401    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw" podUID="0f11c2f4-cf3d-4a32-af0d-2eb177b7264d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Nov 04 02:34:31.209203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:31.208702    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 02:34:31.209203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:31.208780    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd" podUID="ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 02:34:31.579199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:31.577631    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-q7hnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Nov 04 02:34:31.579199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:31.577698    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw" podUID="0f11c2f4-cf3d-4a32-af0d-2eb177b7264d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Nov 04 02:34:32.207198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:32.206766    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 02:34:32.207198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:32.206830    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd" podUID="ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 02:34:32.579198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:32.573767    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-q7hnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Nov 04 02:34:32.579198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:32.573901    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw" podUID="0f11c2f4-cf3d-4a32-af0d-2eb177b7264d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Nov 04 02:34:33.214882 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:33.214844    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Nov 04 02:34:33.215234 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:33.215200    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd" podUID="ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Nov 04 02:34:33.574123 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:33.573634    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-q7hnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Nov 04 02:34:33.574123 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:33.573710    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw" podUID="0f11c2f4-cf3d-4a32-af0d-2eb177b7264d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Nov 04 02:34:34.209597 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:34.209562    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:34:34.210016 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:34.209895    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:34:34.210642 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:34.210624    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:34:34.576160 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:34.575646    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-q7hnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Nov 04 02:34:34.576160 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:34.575719    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw" podUID="0f11c2f4-cf3d-4a32-af0d-2eb177b7264d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Nov 04 02:34:35.583198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:35.574629    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-q7hnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Nov 04 02:34:35.583198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:35.574698    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw" podUID="0f11c2f4-cf3d-4a32-af0d-2eb177b7264d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Nov 04 02:34:36.571627 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:36.571582    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-q7hnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Nov 04 02:34:36.571829 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:36.571658    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw" podUID="0f11c2f4-cf3d-4a32-af0d-2eb177b7264d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Nov 04 02:34:37.571433 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:37.571390    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-q7hnw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused" start-of-body=
Nov 04 02:34:37.571892 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:37.571481    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw" podUID="0f11c2f4-cf3d-4a32-af0d-2eb177b7264d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": dial tcp 10.133.0.78:15021: connect: connection refused"
Nov 04 02:34:38.905539 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:38.905507    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:38.906055 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:38.905993    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:38.906952 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:38.906929    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw"
Nov 04 02:34:40.613701 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:34:40.613652    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:34:40.660564 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.660522    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7"]
Nov 04 02:34:40.661319 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.661300    4548 cpu_manager.go:414] "containerMap: removing container" podUID="ed658b59-6b9d-45eb-b5d8-80f40d574e60" containerName="revoke-keys"
Nov 04 02:34:40.661319 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.661320    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ed658b59-6b9d-45eb-b5d8-80f40d574e60" containerName="revoke-keys"
Nov 04 02:34:40.661510 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.661498    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="ed658b59-6b9d-45eb-b5d8-80f40d574e60" containerName="revoke-keys"
Nov 04 02:34:40.666639 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.666613    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7"
Nov 04 02:34:40.718281 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.718243    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7"]
Nov 04 02:34:40.763633 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.763602    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:34:40.763633 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.763602    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 02:34:40.763922 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.763659    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:34:40.763922 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.763694    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:34:40.763922 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.763884    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwsfc\" (UniqueName: \"kubernetes.io/projected/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-kube-api-access-bwsfc\") pod \"maas-api-revoke-sub-b9ae9dd1-kv5w7\" (UID: \"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7"
Nov 04 02:34:40.764045 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.763972    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b9ae9dd1-kv5w7\" (UID: \"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7"
Nov 04 02:34:40.764230 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.764210    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b9ae9dd1-kv5w7\" (UID: \"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7"
Nov 04 02:34:40.865725 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.865619    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b9ae9dd1-kv5w7\" (UID: \"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7"
Nov 04 02:34:40.865927 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.865774    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b9ae9dd1-kv5w7\" (UID: \"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7"
Nov 04 02:34:40.865991 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.865939    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwsfc\" (UniqueName: \"kubernetes.io/projected/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-kube-api-access-bwsfc\") pod \"maas-api-revoke-sub-b9ae9dd1-kv5w7\" (UID: \"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7"
Nov 04 02:34:40.866562 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.866524    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b9ae9dd1-kv5w7\" (UID: \"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7"
Nov 04 02:34:40.868411 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.868369    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b9ae9dd1-kv5w7\" (UID: \"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7"
Nov 04 02:34:40.928606 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.928574    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwsfc\" (UniqueName: \"kubernetes.io/projected/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-kube-api-access-bwsfc\") pod \"maas-api-revoke-sub-b9ae9dd1-kv5w7\" (UID: \"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7"
Nov 04 02:34:40.980900 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:40.980847    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7"
Nov 04 02:34:41.370296 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:41.370266    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7"]
Nov 04 02:34:41.371495 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:34:41.371466    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ac59d70_ef3e_47cc_b78d_ca2cda1e6900.slice/crio-6c69f928d4570a57ad4dfc5f2cf0658f574bc654871b3e78c6d50621d372e678 WatchSource:0}: Error finding container 6c69f928d4570a57ad4dfc5f2cf0658f574bc654871b3e78c6d50621d372e678: Status 404 returned error can't find the container with id 6c69f928d4570a57ad4dfc5f2cf0658f574bc654871b3e78c6d50621d372e678
Nov 04 02:34:41.997793 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:41.997694    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7" event={"ID":"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900","Type":"ContainerStarted","Data":"26b725cb6c79bea755724f0244024fa16ec9f4b7460817449c14025e286027d8"}
Nov 04 02:34:41.998238 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:41.997796    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7" event={"ID":"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900","Type":"ContainerStarted","Data":"6c69f928d4570a57ad4dfc5f2cf0658f574bc654871b3e78c6d50621d372e678"}
Nov 04 02:34:42.118258 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:42.118191    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7" podStartSLOduration=2.118148269 podStartE2EDuration="2.118148269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:42.114150258 +0000 UTC m=+1115.719163258" watchObservedRunningTime="2026-11-04 02:34:42.118148269 +0000 UTC m=+1115.723161268"
Nov 04 02:34:43.006955 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:43.006919    4548 generic.go:356] "Generic (PLEG): container finished" podID="8ac59d70-ef3e-47cc-b78d-ca2cda1e6900" containerID="26b725cb6c79bea755724f0244024fa16ec9f4b7460817449c14025e286027d8" exitCode=0
Nov 04 02:34:43.007496 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:43.006989    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7" event={"ID":"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900","Type":"ContainerDied","Data":"26b725cb6c79bea755724f0244024fa16ec9f4b7460817449c14025e286027d8"}
Nov 04 02:34:44.186181 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:44.186127    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7"
Nov 04 02:34:44.310757 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:44.310720    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-maas-api-openshift-ca\") pod \"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900\" (UID: \"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900\") "
Nov 04 02:34:44.310960 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:44.310851    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-kube-api-access-bwsfc\" (UniqueName: \"kubernetes.io/projected/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-kube-api-access-bwsfc\") pod \"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900\" (UID: \"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900\") "
Nov 04 02:34:44.310960 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:44.310947    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-maas-api-xks-ca\") pod \"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900\" (UID: \"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900\") "
Nov 04 02:34:44.311183 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:44.311136    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-maas-api-openshift-ca" pod "8ac59d70-ef3e-47cc-b78d-ca2cda1e6900" (UID: "8ac59d70-ef3e-47cc-b78d-ca2cda1e6900"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:34:44.311542 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:44.311516    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-maas-api-openshift-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:34:44.313868 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:44.313836    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-maas-api-xks-ca" pod "8ac59d70-ef3e-47cc-b78d-ca2cda1e6900" (UID: "8ac59d70-ef3e-47cc-b78d-ca2cda1e6900"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:34:44.313991 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:44.313954    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-kube-api-access-bwsfc" pod "8ac59d70-ef3e-47cc-b78d-ca2cda1e6900" (UID: "8ac59d70-ef3e-47cc-b78d-ca2cda1e6900"). InnerVolumeSpecName "kube-api-access-bwsfc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:34:44.413064 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:44.413027    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwsfc\" (UniqueName: \"kubernetes.io/projected/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-kube-api-access-bwsfc\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:34:44.413064 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:44.413064    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900-maas-api-xks-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:34:44.957095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:44.957058    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"]
Nov 04 02:34:45.007926 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:45.007883    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"]
Nov 04 02:34:45.023397 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:45.023363    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7"
Nov 04 02:34:45.023397 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:45.023384    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7" event={"ID":"8ac59d70-ef3e-47cc-b78d-ca2cda1e6900","Type":"ContainerDied","Data":"6c69f928d4570a57ad4dfc5f2cf0658f574bc654871b3e78c6d50621d372e678"}
Nov 04 02:34:45.023596 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:45.023453    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c69f928d4570a57ad4dfc5f2cf0658f574bc654871b3e78c6d50621d372e678"
Nov 04 02:34:54.952205 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:54.950371    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-q7hnw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 02:34:54.952205 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:54.950447    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-q7hnw" podUID="0f11c2f4-cf3d-4a32-af0d-2eb177b7264d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:34:56.904950 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:56.904909    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"]
Nov 04 02:34:56.905528 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:56.905482    4548 cpu_manager.go:414] "containerMap: removing container" podUID="8ac59d70-ef3e-47cc-b78d-ca2cda1e6900" containerName="revoke-keys"
Nov 04 02:34:56.905528 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:56.905497    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8ac59d70-ef3e-47cc-b78d-ca2cda1e6900" containerName="revoke-keys"
Nov 04 02:34:56.905636 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:56.905606    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="8ac59d70-ef3e-47cc-b78d-ca2cda1e6900" containerName="revoke-keys"
Nov 04 02:34:56.910486 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:56.910457    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:56.963338 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:56.963290    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-extmod-b-3353a6-openshift-default-dockercfg-sgvmg\""
Nov 04 02:34:57.009408 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.009361    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-envoy\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.009605 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.009437    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-workload-socket\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.009605 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.009501    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-469c2\" (UniqueName: \"kubernetes.io/projected/765164d9-fde8-43e6-bd5d-527b9bd69a23-kube-api-access-469c2\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.009839 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.009804    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-credential-socket\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.009935 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.009900    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-podinfo\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.009983 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.009933    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-token\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.009983 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.009954    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-workload-certs\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.010050 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.009996    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-data\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.010092 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.010054    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/765164d9-fde8-43e6-bd5d-527b9bd69a23-istiod-ca-cert\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.019902 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.019868    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"]
Nov 04 02:34:57.126198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.117560    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-credential-socket\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.126198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.117656    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-podinfo\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.126198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.117696    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-token\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.126198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.117728    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-workload-certs\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.126198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.117784    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-data\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.126198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.117871    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/765164d9-fde8-43e6-bd5d-527b9bd69a23-istiod-ca-cert\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.126198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.117969    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-envoy\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.126198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.118013    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-workload-socket\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.126198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.118078    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-469c2\" (UniqueName: \"kubernetes.io/projected/765164d9-fde8-43e6-bd5d-527b9bd69a23-kube-api-access-469c2\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.126198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.119139    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-credential-socket\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.126198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.120013    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-data\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.126198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.125902    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-workload-socket\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.126198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.126147    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-workload-certs\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.127019 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.126708    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/765164d9-fde8-43e6-bd5d-527b9bd69a23-istiod-ca-cert\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.151304 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.141526    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-envoy\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.164618 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.154749    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-podinfo\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.201627 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.200359    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-469c2\" (UniqueName: \"kubernetes.io/projected/765164d9-fde8-43e6-bd5d-527b9bd69a23-kube-api-access-469c2\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.208192 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.207086    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-token\") pod \"e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") " pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.230419 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.228945    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:57.726460 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.726423    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"]
Nov 04 02:34:57.727637 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:34:57.727597    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod765164d9_fde8_43e6_bd5d_527b9bd69a23.slice/crio-44a05aa9041adb7f83574fbf4b8986e8a6fc74ba23a2f57c6b4a7746542dc55c WatchSource:0}: Error finding container 44a05aa9041adb7f83574fbf4b8986e8a6fc74ba23a2f57c6b4a7746542dc55c: Status 404 returned error can't find the container with id 44a05aa9041adb7f83574fbf4b8986e8a6fc74ba23a2f57c6b4a7746542dc55c
Nov 04 02:34:57.730433 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.730393    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:34:57.730547 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.730482    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:34:57.730547 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:57.730528    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:34:58.197625 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.197586    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5"]
Nov 04 02:34:58.201848 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.201825    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5"
Nov 04 02:34:58.255103 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.255075    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:34:58.255830 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.255537    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t" event={"ID":"765164d9-fde8-43e6-bd5d-527b9bd69a23","Type":"ContainerStarted","Data":"315a2e4a441b117ad00e0eb07c1b6753ad74567fa6c6d28d74dd9952cda2e393"}
Nov 04 02:34:58.256034 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.256011    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t" event={"ID":"765164d9-fde8-43e6-bd5d-527b9bd69a23","Type":"ContainerStarted","Data":"44a05aa9041adb7f83574fbf4b8986e8a6fc74ba23a2f57c6b4a7746542dc55c"}
Nov 04 02:34:58.257654 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.257623    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5"]
Nov 04 02:34:58.302296 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.302262    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:34:58.337740 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.333848    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:34:58.337740 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.333829    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 02:34:58.338093 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.337765    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/07899954-050f-4a17-8a6c-1f92ffee92b5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-cf9c3306-64kh5\" (UID: \"07899954-050f-4a17-8a6c-1f92ffee92b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5"
Nov 04 02:34:58.338093 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.338031    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/07899954-050f-4a17-8a6c-1f92ffee92b5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-cf9c3306-64kh5\" (UID: \"07899954-050f-4a17-8a6c-1f92ffee92b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5"
Nov 04 02:34:58.338264 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.338229    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sknzz\" (UniqueName: \"kubernetes.io/projected/07899954-050f-4a17-8a6c-1f92ffee92b5-kube-api-access-sknzz\") pod \"maas-api-revoke-sub-cf9c3306-64kh5\" (UID: \"07899954-050f-4a17-8a6c-1f92ffee92b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5"
Nov 04 02:34:58.443747 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.442248    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/07899954-050f-4a17-8a6c-1f92ffee92b5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-cf9c3306-64kh5\" (UID: \"07899954-050f-4a17-8a6c-1f92ffee92b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5"
Nov 04 02:34:58.443747 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.442373    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sknzz\" (UniqueName: \"kubernetes.io/projected/07899954-050f-4a17-8a6c-1f92ffee92b5-kube-api-access-sknzz\") pod \"maas-api-revoke-sub-cf9c3306-64kh5\" (UID: \"07899954-050f-4a17-8a6c-1f92ffee92b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5"
Nov 04 02:34:58.443747 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.442507    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/07899954-050f-4a17-8a6c-1f92ffee92b5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-cf9c3306-64kh5\" (UID: \"07899954-050f-4a17-8a6c-1f92ffee92b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5"
Nov 04 02:34:58.444278 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.444202    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t" podStartSLOduration=2.444158372 podStartE2EDuration="2.444158372s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:34:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:34:58.438020916 +0000 UTC m=+1132.043033919" watchObservedRunningTime="2026-11-04 02:34:58.444158372 +0000 UTC m=+1132.049171370"
Nov 04 02:34:58.445157 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.445123    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/07899954-050f-4a17-8a6c-1f92ffee92b5-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-cf9c3306-64kh5\" (UID: \"07899954-050f-4a17-8a6c-1f92ffee92b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5"
Nov 04 02:34:58.448555 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.448463    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/07899954-050f-4a17-8a6c-1f92ffee92b5-maas-api-xks-ca\") pod \"maas-api-revoke-sub-cf9c3306-64kh5\" (UID: \"07899954-050f-4a17-8a6c-1f92ffee92b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5"
Nov 04 02:34:58.510052 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.510011    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sknzz\" (UniqueName: \"kubernetes.io/projected/07899954-050f-4a17-8a6c-1f92ffee92b5-kube-api-access-sknzz\") pod \"maas-api-revoke-sub-cf9c3306-64kh5\" (UID: \"07899954-050f-4a17-8a6c-1f92ffee92b5\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5"
Nov 04 02:34:58.523293 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.523264    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5"
Nov 04 02:34:58.960444 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:58.960406    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5"]
Nov 04 02:34:58.964718 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:34:58.964680    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07899954_050f_4a17_8a6c_1f92ffee92b5.slice/crio-dcf635d594f20d8b638dcc5c8540e281c6ccc21dd4378b61d48f86cac6688e0e WatchSource:0}: Error finding container dcf635d594f20d8b638dcc5c8540e281c6ccc21dd4378b61d48f86cac6688e0e: Status 404 returned error can't find the container with id dcf635d594f20d8b638dcc5c8540e281c6ccc21dd4378b61d48f86cac6688e0e
Nov 04 02:34:59.230646 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:59.230552    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:59.247193 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:59.246535    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:59.293105 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:59.293066    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5" event={"ID":"07899954-050f-4a17-8a6c-1f92ffee92b5","Type":"ContainerStarted","Data":"dcf635d594f20d8b638dcc5c8540e281c6ccc21dd4378b61d48f86cac6688e0e"}
Nov 04 02:34:59.298206 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:59.293399    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:59.308236 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:59.301451    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:34:59.979111 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:34:59.979069    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48" podUID="b15e0b31-b783-428e-8507-55aad5e90711" containerName="main" containerID="cri-o://5be5b8150b9b445afbd30a757854c30e900d3ce187635c5cee0a6397b78a28fd" gracePeriod=45
Nov 04 02:35:00.037384 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.037324    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz" podUID="d2c71cff-3761-4b8a-8cc1-d14312051945" containerName="main" containerID="cri-o://4d018e35bba4aa8402de58c9236ae49ac19711ba938680b5d6114ff4e7758f7a" gracePeriod=45
Nov 04 02:35:00.052261 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.052151    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48" podUID="b15e0b31-b783-428e-8507-55aad5e90711" containerName="main" probeResult="failure" output="Get \"https://10.133.0.68:8000/ready\": dial tcp 10.133.0.68:8000: connect: connection refused"
Nov 04 02:35:00.308952 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.308915    4548 generic.go:356] "Generic (PLEG): container finished" podID="d2c71cff-3761-4b8a-8cc1-d14312051945" containerID="4d018e35bba4aa8402de58c9236ae49ac19711ba938680b5d6114ff4e7758f7a" exitCode=0
Nov 04 02:35:00.309522 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.309040    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz" event={"ID":"d2c71cff-3761-4b8a-8cc1-d14312051945","Type":"ContainerDied","Data":"4d018e35bba4aa8402de58c9236ae49ac19711ba938680b5d6114ff4e7758f7a"}
Nov 04 02:35:00.311332 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.311295    4548 generic.go:356] "Generic (PLEG): container finished" podID="b15e0b31-b783-428e-8507-55aad5e90711" containerID="5be5b8150b9b445afbd30a757854c30e900d3ce187635c5cee0a6397b78a28fd" exitCode=0
Nov 04 02:35:00.311573 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.311554    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48" event={"ID":"b15e0b31-b783-428e-8507-55aad5e90711","Type":"ContainerDied","Data":"5be5b8150b9b445afbd30a757854c30e900d3ce187635c5cee0a6397b78a28fd"}
Nov 04 02:35:00.313630 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.313597    4548 generic.go:356] "Generic (PLEG): container finished" podID="07899954-050f-4a17-8a6c-1f92ffee92b5" containerID="d8a6fdefd0e49f8275fd7401d1037cec78d3db17b6d2d2878039c7577445b43d" exitCode=0
Nov 04 02:35:00.314976 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.314847    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5" event={"ID":"07899954-050f-4a17-8a6c-1f92ffee92b5","Type":"ContainerDied","Data":"d8a6fdefd0e49f8275fd7401d1037cec78d3db17b6d2d2878039c7577445b43d"}
Nov 04 02:35:00.373393 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.373273    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:35:00.383105 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.383071    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:35:00.394481 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.394441    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/b15e0b31-b783-428e-8507-55aad5e90711-tls-certs\" (UniqueName: \"kubernetes.io/secret/b15e0b31-b783-428e-8507-55aad5e90711-tls-certs\") pod \"b15e0b31-b783-428e-8507-55aad5e90711\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") "
Nov 04 02:35:00.394897 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.394553    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b15e0b31-b783-428e-8507-55aad5e90711-kube-api-access-2wl4v\" (UniqueName: \"kubernetes.io/projected/b15e0b31-b783-428e-8507-55aad5e90711-kube-api-access-2wl4v\") pod \"b15e0b31-b783-428e-8507-55aad5e90711\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") "
Nov 04 02:35:00.394897 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.394617    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-tmp-dir\") pod \"b15e0b31-b783-428e-8507-55aad5e90711\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") "
Nov 04 02:35:00.394897 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.394644    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-dshm\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-dshm\") pod \"b15e0b31-b783-428e-8507-55aad5e90711\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") "
Nov 04 02:35:00.394897 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.394716    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-home\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-home\") pod \"b15e0b31-b783-428e-8507-55aad5e90711\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") "
Nov 04 02:35:00.394897 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.394784    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-model-cache\") pod \"b15e0b31-b783-428e-8507-55aad5e90711\" (UID: \"b15e0b31-b783-428e-8507-55aad5e90711\") "
Nov 04 02:35:00.396156 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.395224    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-home" pod "b15e0b31-b783-428e-8507-55aad5e90711" (UID: "b15e0b31-b783-428e-8507-55aad5e90711"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:00.396156 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.395434    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-tmp-dir" pod "b15e0b31-b783-428e-8507-55aad5e90711" (UID: "b15e0b31-b783-428e-8507-55aad5e90711"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:00.396156 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.395527    4548 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-tmp-dir\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.396156 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.395550    4548 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-home\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.396156 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.395912    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-model-cache" pod "b15e0b31-b783-428e-8507-55aad5e90711" (UID: "b15e0b31-b783-428e-8507-55aad5e90711"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:00.399915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.398471    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b15e0b31-b783-428e-8507-55aad5e90711-tls-certs" pod "b15e0b31-b783-428e-8507-55aad5e90711" (UID: "b15e0b31-b783-428e-8507-55aad5e90711"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:35:00.399915 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.398728    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-dshm" pod "b15e0b31-b783-428e-8507-55aad5e90711" (UID: "b15e0b31-b783-428e-8507-55aad5e90711"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:00.410503 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.410333    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b15e0b31-b783-428e-8507-55aad5e90711-kube-api-access-2wl4v" pod "b15e0b31-b783-428e-8507-55aad5e90711" (UID: "b15e0b31-b783-428e-8507-55aad5e90711"). InnerVolumeSpecName "kube-api-access-2wl4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:00.496527 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.496487    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d2c71cff-3761-4b8a-8cc1-d14312051945-kube-api-access-rvwlz\" (UniqueName: \"kubernetes.io/projected/d2c71cff-3761-4b8a-8cc1-d14312051945-kube-api-access-rvwlz\") pod \"d2c71cff-3761-4b8a-8cc1-d14312051945\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") "
Nov 04 02:35:00.496738 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.496559    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d2c71cff-3761-4b8a-8cc1-d14312051945-tls-certs\" (UniqueName: \"kubernetes.io/secret/d2c71cff-3761-4b8a-8cc1-d14312051945-tls-certs\") pod \"d2c71cff-3761-4b8a-8cc1-d14312051945\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") "
Nov 04 02:35:00.497748 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.496902    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-dshm\") pod \"d2c71cff-3761-4b8a-8cc1-d14312051945\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") "
Nov 04 02:35:00.497748 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.496971    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-home\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-home\") pod \"d2c71cff-3761-4b8a-8cc1-d14312051945\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") "
Nov 04 02:35:00.497748 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.497034    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-model-cache\") pod \"d2c71cff-3761-4b8a-8cc1-d14312051945\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") "
Nov 04 02:35:00.497748 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.497125    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-tmp-dir\") pod \"d2c71cff-3761-4b8a-8cc1-d14312051945\" (UID: \"d2c71cff-3761-4b8a-8cc1-d14312051945\") "
Nov 04 02:35:00.497748 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.497498    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-model-cache" pod "d2c71cff-3761-4b8a-8cc1-d14312051945" (UID: "d2c71cff-3761-4b8a-8cc1-d14312051945"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:00.498143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.497763    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-home" pod "d2c71cff-3761-4b8a-8cc1-d14312051945" (UID: "d2c71cff-3761-4b8a-8cc1-d14312051945"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:00.498143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.497907    4548 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b15e0b31-b783-428e-8507-55aad5e90711-tls-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.498143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.497926    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wl4v\" (UniqueName: \"kubernetes.io/projected/b15e0b31-b783-428e-8507-55aad5e90711-kube-api-access-2wl4v\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.498143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.497946    4548 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-dshm\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.498143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.497960    4548 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-home\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.498143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.497972    4548 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-model-cache\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.498143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.497986    4548 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b15e0b31-b783-428e-8507-55aad5e90711-model-cache\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.498628 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.498592    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-tmp-dir" pod "d2c71cff-3761-4b8a-8cc1-d14312051945" (UID: "d2c71cff-3761-4b8a-8cc1-d14312051945"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:00.500728 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.500672    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-dshm" pod "d2c71cff-3761-4b8a-8cc1-d14312051945" (UID: "d2c71cff-3761-4b8a-8cc1-d14312051945"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:00.502436 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.501648    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2c71cff-3761-4b8a-8cc1-d14312051945-kube-api-access-rvwlz" pod "d2c71cff-3761-4b8a-8cc1-d14312051945" (UID: "d2c71cff-3761-4b8a-8cc1-d14312051945"). InnerVolumeSpecName "kube-api-access-rvwlz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:00.502436 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.501914    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2c71cff-3761-4b8a-8cc1-d14312051945-tls-certs" pod "d2c71cff-3761-4b8a-8cc1-d14312051945" (UID: "d2c71cff-3761-4b8a-8cc1-d14312051945"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:35:00.599764 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.599161    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvwlz\" (UniqueName: \"kubernetes.io/projected/d2c71cff-3761-4b8a-8cc1-d14312051945-kube-api-access-rvwlz\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.599764 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.599224    4548 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2c71cff-3761-4b8a-8cc1-d14312051945-tls-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.599764 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.599233    4548 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-dshm\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:00.599764 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:00.599241    4548 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2c71cff-3761-4b8a-8cc1-d14312051945-tmp-dir\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:01.323576 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.323541    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"
Nov 04 02:35:01.323576 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.323554    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48" event={"ID":"b15e0b31-b783-428e-8507-55aad5e90711","Type":"ContainerDied","Data":"76880f4e2ca88cbd510bc81455d292922d706a2bc0f145c2193f72f6d094c127"}
Nov 04 02:35:01.324217 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.323622    4548 scope.go:122] "RemoveContainer" containerID="5be5b8150b9b445afbd30a757854c30e900d3ce187635c5cee0a6397b78a28fd"
Nov 04 02:35:01.325638 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.325601    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz" event={"ID":"d2c71cff-3761-4b8a-8cc1-d14312051945","Type":"ContainerDied","Data":"710956d6a03663f062ccf18c2161731de4c4ca5638133c26884c1dd9f0a1d3fd"}
Nov 04 02:35:01.326106 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.325793    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"
Nov 04 02:35:01.335935 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.335913    4548 scope.go:122] "RemoveContainer" containerID="4d018e35bba4aa8402de58c9236ae49ac19711ba938680b5d6114ff4e7758f7a"
Nov 04 02:35:01.518268 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.504327    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"]
Nov 04 02:35:01.543747 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.543714    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/distinct-w1-a18c43-kserve-696b6789db-slj48"]
Nov 04 02:35:01.594063 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.594033    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5"
Nov 04 02:35:01.630943 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.630903    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"]
Nov 04 02:35:01.632183 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.632127    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07899954-050f-4a17-8a6c-1f92ffee92b5-kube-api-access-sknzz\" (UniqueName: \"kubernetes.io/projected/07899954-050f-4a17-8a6c-1f92ffee92b5-kube-api-access-sknzz\") pod \"07899954-050f-4a17-8a6c-1f92ffee92b5\" (UID: \"07899954-050f-4a17-8a6c-1f92ffee92b5\") "
Nov 04 02:35:01.632318 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.632226    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/07899954-050f-4a17-8a6c-1f92ffee92b5-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/07899954-050f-4a17-8a6c-1f92ffee92b5-maas-api-openshift-ca\") pod \"07899954-050f-4a17-8a6c-1f92ffee92b5\" (UID: \"07899954-050f-4a17-8a6c-1f92ffee92b5\") "
Nov 04 02:35:01.632498 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.632484    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/07899954-050f-4a17-8a6c-1f92ffee92b5-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/07899954-050f-4a17-8a6c-1f92ffee92b5-maas-api-xks-ca\") pod \"07899954-050f-4a17-8a6c-1f92ffee92b5\" (UID: \"07899954-050f-4a17-8a6c-1f92ffee92b5\") "
Nov 04 02:35:01.632618 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.632586    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07899954-050f-4a17-8a6c-1f92ffee92b5-maas-api-openshift-ca" pod "07899954-050f-4a17-8a6c-1f92ffee92b5" (UID: "07899954-050f-4a17-8a6c-1f92ffee92b5"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:35:01.633028 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.633008    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/07899954-050f-4a17-8a6c-1f92ffee92b5-maas-api-openshift-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:01.634770 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.634742    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07899954-050f-4a17-8a6c-1f92ffee92b5-kube-api-access-sknzz" pod "07899954-050f-4a17-8a6c-1f92ffee92b5" (UID: "07899954-050f-4a17-8a6c-1f92ffee92b5"). InnerVolumeSpecName "kube-api-access-sknzz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:01.635050 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.635020    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07899954-050f-4a17-8a6c-1f92ffee92b5-maas-api-xks-ca" pod "07899954-050f-4a17-8a6c-1f92ffee92b5" (UID: "07899954-050f-4a17-8a6c-1f92ffee92b5"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:35:01.638235 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.638214    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-a18c43/simulator-w1-a18c43-kserve-7db5f8c9cd-n82tz"]
Nov 04 02:35:01.739307 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.739268    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/07899954-050f-4a17-8a6c-1f92ffee92b5-maas-api-xks-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:01.739571 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:01.739553    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sknzz\" (UniqueName: \"kubernetes.io/projected/07899954-050f-4a17-8a6c-1f92ffee92b5-kube-api-access-sknzz\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:02.335762 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:02.335733    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5"
Nov 04 02:35:02.335762 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:02.335755    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5" event={"ID":"07899954-050f-4a17-8a6c-1f92ffee92b5","Type":"ContainerDied","Data":"dcf635d594f20d8b638dcc5c8540e281c6ccc21dd4378b61d48f86cac6688e0e"}
Nov 04 02:35:02.336355 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:02.335814    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcf635d594f20d8b638dcc5c8540e281c6ccc21dd4378b61d48f86cac6688e0e"
Nov 04 02:35:02.551953 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:02.551915    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b15e0b31-b783-428e-8507-55aad5e90711" path="/var/lib/kubelet/pods/b15e0b31-b783-428e-8507-55aad5e90711/volumes"
Nov 04 02:35:02.553500 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:02.553470    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d2c71cff-3761-4b8a-8cc1-d14312051945" path="/var/lib/kubelet/pods/d2c71cff-3761-4b8a-8cc1-d14312051945/volumes"
Nov 04 02:35:10.612381 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:35:10.612342    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:35:13.588908 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.588854    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"]
Nov 04 02:35:13.589482 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.589403    4548 cpu_manager.go:414] "containerMap: removing container" podUID="b15e0b31-b783-428e-8507-55aad5e90711" containerName="main"
Nov 04 02:35:13.589482 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.589415    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b15e0b31-b783-428e-8507-55aad5e90711" containerName="main"
Nov 04 02:35:13.589482 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.589427    4548 cpu_manager.go:414] "containerMap: removing container" podUID="07899954-050f-4a17-8a6c-1f92ffee92b5" containerName="revoke-keys"
Nov 04 02:35:13.589482 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.589432    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07899954-050f-4a17-8a6c-1f92ffee92b5" containerName="revoke-keys"
Nov 04 02:35:13.589482 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.589452    4548 cpu_manager.go:414] "containerMap: removing container" podUID="d2c71cff-3761-4b8a-8cc1-d14312051945" containerName="main"
Nov 04 02:35:13.589482 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.589458    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d2c71cff-3761-4b8a-8cc1-d14312051945" containerName="main"
Nov 04 02:35:13.589804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.589552    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="d2c71cff-3761-4b8a-8cc1-d14312051945" containerName="main"
Nov 04 02:35:13.589804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.589566    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="b15e0b31-b783-428e-8507-55aad5e90711" containerName="main"
Nov 04 02:35:13.589804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.589572    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="07899954-050f-4a17-8a6c-1f92ffee92b5" containerName="revoke-keys"
Nov 04 02:35:13.594769 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.594740    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.692319 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.692263    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81770132-1880-4850-8c83-ac484d671ba5-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.692319 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.692318    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81770132-1880-4850-8c83-ac484d671ba5-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.692587 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.692425    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81770132-1880-4850-8c83-ac484d671ba5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.692587 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.692490    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81770132-1880-4850-8c83-ac484d671ba5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.692587 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.692564    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81770132-1880-4850-8c83-ac484d671ba5-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.692747 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.692626    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81770132-1880-4850-8c83-ac484d671ba5-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.692747 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.692730    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81770132-1880-4850-8c83-ac484d671ba5-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.692851 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.692796    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81770132-1880-4850-8c83-ac484d671ba5-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.692851 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.692831    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cz8rh\" (UniqueName: \"kubernetes.io/projected/81770132-1880-4850-8c83-ac484d671ba5-kube-api-access-cz8rh\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.718308 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.718268    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"]
Nov 04 02:35:13.793988 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.793940    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81770132-1880-4850-8c83-ac484d671ba5-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.794186 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.794006    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cz8rh\" (UniqueName: \"kubernetes.io/projected/81770132-1880-4850-8c83-ac484d671ba5-kube-api-access-cz8rh\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.794186 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.794100    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81770132-1880-4850-8c83-ac484d671ba5-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.794186 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.794127    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81770132-1880-4850-8c83-ac484d671ba5-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.794186 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.794157    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81770132-1880-4850-8c83-ac484d671ba5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.794469 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.794443    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81770132-1880-4850-8c83-ac484d671ba5-istio-data\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.794668 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.794640    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81770132-1880-4850-8c83-ac484d671ba5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.795146 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.795127    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81770132-1880-4850-8c83-ac484d671ba5-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.795396 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.795378    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81770132-1880-4850-8c83-ac484d671ba5-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.795610 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.795596    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81770132-1880-4850-8c83-ac484d671ba5-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.795877 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.795227    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81770132-1880-4850-8c83-ac484d671ba5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.796018 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.795643    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81770132-1880-4850-8c83-ac484d671ba5-workload-certs\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.796136 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.794873    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81770132-1880-4850-8c83-ac484d671ba5-credential-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.796292 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.796028    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81770132-1880-4850-8c83-ac484d671ba5-workload-socket\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.799339 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.799306    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81770132-1880-4850-8c83-ac484d671ba5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.805964 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.805929    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81770132-1880-4850-8c83-ac484d671ba5-istio-envoy\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.855652 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.855581    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81770132-1880-4850-8c83-ac484d671ba5-istio-token\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.855794 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.855707    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cz8rh\" (UniqueName: \"kubernetes.io/projected/81770132-1880-4850-8c83-ac484d671ba5-kube-api-access-cz8rh\") pod \"maas-default-gateway-openshift-default-fd4b99879-8qbmc\" (UID: \"81770132-1880-4850-8c83-ac484d671ba5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:13.910105 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:13.910056    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:14.354533 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:14.354499    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"]
Nov 04 02:35:14.355505 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:35:14.355476    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81770132_1880_4850_8c83_ac484d671ba5.slice/crio-cb9474030d248ce4aa9ac18a0ca3b27d5d7f88ba38f548d30f3b7ae39448e3bc WatchSource:0}: Error finding container cb9474030d248ce4aa9ac18a0ca3b27d5d7f88ba38f548d30f3b7ae39448e3bc: Status 404 returned error can't find the container with id cb9474030d248ce4aa9ac18a0ca3b27d5d7f88ba38f548d30f3b7ae39448e3bc
Nov 04 02:35:14.358150 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:14.358112    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:35:14.358269 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:14.358219    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:35:14.358269 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:14.358252    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:35:14.432770 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:14.432728    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc" event={"ID":"81770132-1880-4850-8c83-ac484d671ba5","Type":"ContainerStarted","Data":"cb9474030d248ce4aa9ac18a0ca3b27d5d7f88ba38f548d30f3b7ae39448e3bc"}
Nov 04 02:35:15.461230 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:15.460140    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc" event={"ID":"81770132-1880-4850-8c83-ac484d671ba5","Type":"ContainerStarted","Data":"b49c9e3763ececf4f99ed18013fa77eb5b8a6d079a6c5b5fb4e242b003b28d2b"}
Nov 04 02:35:15.641839 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:15.641778    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc" podStartSLOduration=2.641761889 podStartE2EDuration="2.641761889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:35:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:35:15.636817538 +0000 UTC m=+1149.241830535" watchObservedRunningTime="2026-11-04 02:35:15.641761889 +0000 UTC m=+1149.246774966"
Nov 04 02:35:15.910557 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:15.910515    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:15.912568 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:15.912537    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-8qbmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Nov 04 02:35:15.912726 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:15.912591    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc" podUID="81770132-1880-4850-8c83-ac484d671ba5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Nov 04 02:35:16.910609 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:16.910552    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-8qbmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Nov 04 02:35:16.911069 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:16.910630    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc" podUID="81770132-1880-4850-8c83-ac484d671ba5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Nov 04 02:35:17.927196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:17.926570    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-8qbmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Nov 04 02:35:17.927196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:17.926691    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc" podUID="81770132-1880-4850-8c83-ac484d671ba5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Nov 04 02:35:18.911224 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:18.910640    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-8qbmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Nov 04 02:35:18.911224 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:18.910707    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc" podUID="81770132-1880-4850-8c83-ac484d671ba5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Nov 04 02:35:19.913695 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:19.913650    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-8qbmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Nov 04 02:35:19.914386 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:19.914346    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc" podUID="81770132-1880-4850-8c83-ac484d671ba5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Nov 04 02:35:20.910644 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:20.910605    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-8qbmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Nov 04 02:35:20.910952 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:20.910922    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc" podUID="81770132-1880-4850-8c83-ac484d671ba5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Nov 04 02:35:21.910912 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:21.910863    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-8qbmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Nov 04 02:35:21.911532 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:21.910955    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc" podUID="81770132-1880-4850-8c83-ac484d671ba5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Nov 04 02:35:22.911630 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:22.911580    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-8qbmc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused" start-of-body=
Nov 04 02:35:22.912102 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:22.911665    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc" podUID="81770132-1880-4850-8c83-ac484d671ba5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.82:15021/healthz/ready\": dial tcp 10.133.0.82:15021: connect: connection refused"
Nov 04 02:35:24.766428 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:24.766390    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:24.766976 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:24.766835    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:24.767888 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:24.767861    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-8qbmc"
Nov 04 02:35:27.678950 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:27.678907    4548 generic.go:356] "Generic (PLEG): container finished" podID="a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" containerID="8723899f124bacc79d04ea3509734cc06351a30646bdc11c8953e89959f6c23b" exitCode=0
Nov 04 02:35:27.679445 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:27.678972    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9" event={"ID":"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c","Type":"ContainerDied","Data":"8723899f124bacc79d04ea3509734cc06351a30646bdc11c8953e89959f6c23b"}
Nov 04 02:35:27.679491 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:27.679457    4548 scope.go:122] "RemoveContainer" containerID="8723899f124bacc79d04ea3509734cc06351a30646bdc11c8953e89959f6c23b"
Nov 04 02:35:27.681047 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:27.681017    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:35:27.681106 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:27.681090    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:35:27.681158 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:27.681123    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:35:28.697980 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:28.697944    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9" event={"ID":"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c","Type":"ContainerStarted","Data":"9f9c83a6434ad07845e0fb400ac96c976d04ed53859cfb1ea49178885e0cda39"}
Nov 04 02:35:29.149655 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:29.149614    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:35:29.151006 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:29.150976    4548 patch_prober.go:29] interesting pod/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 04 02:35:29.151071 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:29.151035    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9" podUID="a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 04 02:35:30.150335 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:30.150292    4548 patch_prober.go:29] interesting pod/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 04 02:35:30.151054 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:30.150370    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9" podUID="a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 04 02:35:31.084195 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.083992    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:35:31.150664 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.150614    4548 patch_prober.go:29] interesting pod/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 04 02:35:31.151102 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.150709    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9" podUID="a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 04 02:35:31.433689 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.433599    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"]
Nov 04 02:35:31.437888 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.437865    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.514609 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.514573    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.514793 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.514627    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.514838 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.514785    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.514838 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.514832    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f604ec4-bd49-48ca-b077-690ad4d6af61-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.514924 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.514897    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.514964 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.514926    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.514964 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.514942    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69bdz\" (UniqueName: \"kubernetes.io/projected/8f604ec4-bd49-48ca-b077-690ad4d6af61-kube-api-access-69bdz\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.515067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.515055    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.515102 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.515084    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.548505 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.548464    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"]
Nov 04 02:35:31.616455 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.616404    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.616689 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.616476    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.616689 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.616585    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.616817 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.616690    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.617281 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.616885    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.617281 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.616943    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f604ec4-bd49-48ca-b077-690ad4d6af61-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.617281 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.616981    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.617281 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.617006    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.617281 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.617029    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69bdz\" (UniqueName: \"kubernetes.io/projected/8f604ec4-bd49-48ca-b077-690ad4d6af61-kube-api-access-69bdz\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.617281 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.617041    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-credential-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.617736 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.617718    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-workload-socket\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.617835 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.617814    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-data\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.617835 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.617829    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-workload-certs\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.618257 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.618207    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f604ec4-bd49-48ca-b077-690ad4d6af61-istiod-ca-cert\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.619444 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.619425    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-envoy\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.620391 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.620371    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-podinfo\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.688459 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.688374    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-token\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.688941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.688917    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69bdz\" (UniqueName: \"kubernetes.io/projected/8f604ec4-bd49-48ca-b077-690ad4d6af61-kube-api-access-69bdz\") pod \"e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") " pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:31.752670 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:31.752634    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:32.150164 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:32.150125    4548 patch_prober.go:29] interesting pod/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 04 02:35:32.150367 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:32.150221    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9" podUID="a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 04 02:35:32.254430 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:35:32.254394    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f604ec4_bd49_48ca_b077_690ad4d6af61.slice/crio-861ab05e4b1b21f9c749b833dc93f09374b6fd19f7fce91fab786d3caceae06f WatchSource:0}: Error finding container 861ab05e4b1b21f9c749b833dc93f09374b6fd19f7fce91fab786d3caceae06f: Status 404 returned error can't find the container with id 861ab05e4b1b21f9c749b833dc93f09374b6fd19f7fce91fab786d3caceae06f
Nov 04 02:35:32.255003 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:32.254562    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"]
Nov 04 02:35:32.257138 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:32.257105    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:35:32.257236 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:32.257223    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:35:32.257277 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:32.257261    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:35:32.730034 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:32.730000    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv" event={"ID":"8f604ec4-bd49-48ca-b077-690ad4d6af61","Type":"ContainerStarted","Data":"ce33fbd92edd836d2d1083dbd1f12ac4c3b042cef28fab7d8842411e67c0c7c3"}
Nov 04 02:35:32.730325 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:32.730308    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv" event={"ID":"8f604ec4-bd49-48ca-b077-690ad4d6af61","Type":"ContainerStarted","Data":"861ab05e4b1b21f9c749b833dc93f09374b6fd19f7fce91fab786d3caceae06f"}
Nov 04 02:35:32.753049 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:32.753016    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:32.876660 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:32.876580    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv" podStartSLOduration=1.8765541639999999 podStartE2EDuration="1.876554164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:35:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:35:32.859210112 +0000 UTC m=+1166.464223107" watchObservedRunningTime="2026-11-04 02:35:32.876554164 +0000 UTC m=+1166.481567182"
Nov 04 02:35:33.150401 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:33.150360    4548 patch_prober.go:29] interesting pod/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 04 02:35:33.150602 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:33.150449    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9" podUID="a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 04 02:35:33.754500 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:33.754459    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Nov 04 02:35:33.755029 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:33.754521    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv" podUID="8f604ec4-bd49-48ca-b077-690ad4d6af61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Nov 04 02:35:34.150039 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:34.149996    4548 patch_prober.go:29] interesting pod/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused" start-of-body=
Nov 04 02:35:34.150252 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:34.150058    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9" podUID="a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.74:15021/healthz/ready\": dial tcp 10.133.0.74:15021: connect: connection refused"
Nov 04 02:35:34.753863 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:34.753824    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Nov 04 02:35:34.754072 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:34.753890    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv" podUID="8f604ec4-bd49-48ca-b077-690ad4d6af61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Nov 04 02:35:35.155061 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:35.155028    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:35:35.156390 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:35.156369    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:35:35.753598 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:35.753568    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Nov 04 02:35:35.753789 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:35.753621    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv" podUID="8f604ec4-bd49-48ca-b077-690ad4d6af61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Nov 04 02:35:36.754027 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:36.753988    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Nov 04 02:35:36.754495 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:36.754067    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv" podUID="8f604ec4-bd49-48ca-b077-690ad4d6af61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Nov 04 02:35:37.753159 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:37.753122    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Nov 04 02:35:37.753401 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:37.753208    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv" podUID="8f604ec4-bd49-48ca-b077-690ad4d6af61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Nov 04 02:35:38.753941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:38.753889    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Nov 04 02:35:38.754525 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:38.753970    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv" podUID="8f604ec4-bd49-48ca-b077-690ad4d6af61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Nov 04 02:35:39.753332 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:39.753296    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused" start-of-body=
Nov 04 02:35:39.753548 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:39.753355    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv" podUID="8f604ec4-bd49-48ca-b077-690ad4d6af61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": dial tcp 10.133.0.83:15021: connect: connection refused"
Nov 04 02:35:40.616904 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:35:40.616861    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:35:41.795796 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:41.795361    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 02:35:41.795796 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:41.795439    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv" podUID="8f604ec4-bd49-48ca-b077-690ad4d6af61" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.83:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:35:41.888961 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:41.888926    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:41.889444 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:41.889424    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:41.900156 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:41.900120    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:46.947134 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:46.947097    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"]
Nov 04 02:35:46.947750 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:46.947353    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj" podUID="79d6d61c-e0cd-4b22-8ae7-212908d5249d" containerName="istio-proxy" containerID="cri-o://bb9d44bd5269e46b54c2c079d7a6faae5703ceaace5a85b5f0ccc40f3f6eadfd" gracePeriod=30
Nov 04 02:35:46.964960 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:46.964920    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"]
Nov 04 02:35:46.965205 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:46.965162    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv" podUID="8f604ec4-bd49-48ca-b077-690ad4d6af61" containerName="istio-proxy" containerID="cri-o://ce33fbd92edd836d2d1083dbd1f12ac4c3b042cef28fab7d8842411e67c0c7c3" gracePeriod=30
Nov 04 02:35:46.995816 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:46.995772    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"]
Nov 04 02:35:46.996074 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:46.996048    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57" podUID="9af764ed-0a79-4623-baa7-2a48950c6541" containerName="istio-proxy" containerID="cri-o://01aa70ddb633d91e79ccd263346394e3f0b9aa9021f0e68e7bf74f563d8707d2" gracePeriod=30
Nov 04 02:35:48.050339 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:48.050298    4548 patch_prober.go:29] interesting pod/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 02:35:48.050991 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:48.050948    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57" podUID="9af764ed-0a79-4623-baa7-2a48950c6541" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 02:35:49.986060 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:49.985643    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-9rmjg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 02:35:49.986060 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:49.985727    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg" podUID="a8df164d-d2b2-469b-8203-cb157a218c8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:35:52.335293 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.335260    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:52.345273 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.343384    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:35:52.371720 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.371676    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-envoy\") pod \"8f604ec4-bd49-48ca-b077-690ad4d6af61\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") "
Nov 04 02:35:52.371927 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.371761    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-credential-socket\") pod \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") "
Nov 04 02:35:52.371927 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.371815    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-podinfo\") pod \"8f604ec4-bd49-48ca-b077-690ad4d6af61\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") "
Nov 04 02:35:52.371927 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.371877    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-token\" (UniqueName: \"kubernetes.io/projected/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-token\") pod \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") "
Nov 04 02:35:52.371927 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.371923    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-envoy\") pod \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") "
Nov 04 02:35:52.372190 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.371963    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-workload-certs\") pod \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") "
Nov 04 02:35:52.372190 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.372018    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-data\") pod \"8f604ec4-bd49-48ca-b077-690ad4d6af61\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") "
Nov 04 02:35:52.372190 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.372050    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-data\") pod \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") "
Nov 04 02:35:52.372190 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.372086    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-workload-socket\") pod \"8f604ec4-bd49-48ca-b077-690ad4d6af61\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") "
Nov 04 02:35:52.372190 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.372123    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/79d6d61c-e0cd-4b22-8ae7-212908d5249d-kube-api-access-c2hht\" (UniqueName: \"kubernetes.io/projected/79d6d61c-e0cd-4b22-8ae7-212908d5249d-kube-api-access-c2hht\") pod \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") "
Nov 04 02:35:52.372470 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.372277    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-credential-socket" pod "79d6d61c-e0cd-4b22-8ae7-212908d5249d" (UID: "79d6d61c-e0cd-4b22-8ae7-212908d5249d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.372607 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.372523    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-workload-certs" pod "79d6d61c-e0cd-4b22-8ae7-212908d5249d" (UID: "79d6d61c-e0cd-4b22-8ae7-212908d5249d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.372875 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.372849    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-credential-socket\") pod \"8f604ec4-bd49-48ca-b077-690ad4d6af61\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") "
Nov 04 02:35:52.373015 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.372999    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-token\" (UniqueName: \"kubernetes.io/projected/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-token\") pod \"8f604ec4-bd49-48ca-b077-690ad4d6af61\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") "
Nov 04 02:35:52.373123 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.373107    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8f604ec4-bd49-48ca-b077-690ad4d6af61-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f604ec4-bd49-48ca-b077-690ad4d6af61-istiod-ca-cert\") pod \"8f604ec4-bd49-48ca-b077-690ad4d6af61\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") "
Nov 04 02:35:52.373211 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.373158    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8f604ec4-bd49-48ca-b077-690ad4d6af61-kube-api-access-69bdz\" (UniqueName: \"kubernetes.io/projected/8f604ec4-bd49-48ca-b077-690ad4d6af61-kube-api-access-69bdz\") pod \"8f604ec4-bd49-48ca-b077-690ad4d6af61\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") "
Nov 04 02:35:52.373279 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.373244    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istiod-ca-cert\") pod \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") "
Nov 04 02:35:52.373341 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.373296    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-workload-certs\") pod \"8f604ec4-bd49-48ca-b077-690ad4d6af61\" (UID: \"8f604ec4-bd49-48ca-b077-690ad4d6af61\") "
Nov 04 02:35:52.373341 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.373333    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-workload-socket\") pod \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") "
Nov 04 02:35:52.373464 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.373393    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-podinfo\") pod \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\" (UID: \"79d6d61c-e0cd-4b22-8ae7-212908d5249d\") "
Nov 04 02:35:52.377257 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.376156    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-data" pod "8f604ec4-bd49-48ca-b077-690ad4d6af61" (UID: "8f604ec4-bd49-48ca-b077-690ad4d6af61"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.377257 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.376653    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-data" pod "79d6d61c-e0cd-4b22-8ae7-212908d5249d" (UID: "79d6d61c-e0cd-4b22-8ae7-212908d5249d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.377257 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.377075    4548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-credential-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.377257 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.377099    4548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-workload-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.377257 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.377114    4548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-data\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.377257 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.377128    4548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-data\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.377693 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.377270    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-workload-socket" pod "8f604ec4-bd49-48ca-b077-690ad4d6af61" (UID: "8f604ec4-bd49-48ca-b077-690ad4d6af61"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.378526 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.377764    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istiod-ca-cert" pod "79d6d61c-e0cd-4b22-8ae7-212908d5249d" (UID: "79d6d61c-e0cd-4b22-8ae7-212908d5249d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:35:52.378526 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.377999    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-credential-socket" pod "8f604ec4-bd49-48ca-b077-690ad4d6af61" (UID: "8f604ec4-bd49-48ca-b077-690ad4d6af61"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.378526 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.378209    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8f604ec4-bd49-48ca-b077-690ad4d6af61-istiod-ca-cert" pod "8f604ec4-bd49-48ca-b077-690ad4d6af61" (UID: "8f604ec4-bd49-48ca-b077-690ad4d6af61"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:35:52.378526 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.378304    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-workload-certs" pod "8f604ec4-bd49-48ca-b077-690ad4d6af61" (UID: "8f604ec4-bd49-48ca-b077-690ad4d6af61"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.378912 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.378857    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-workload-socket" pod "79d6d61c-e0cd-4b22-8ae7-212908d5249d" (UID: "79d6d61c-e0cd-4b22-8ae7-212908d5249d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.379931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.379879    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-envoy" pod "8f604ec4-bd49-48ca-b077-690ad4d6af61" (UID: "8f604ec4-bd49-48ca-b077-690ad4d6af61"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.382309 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.382162    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f604ec4-bd49-48ca-b077-690ad4d6af61-kube-api-access-69bdz" pod "8f604ec4-bd49-48ca-b077-690ad4d6af61" (UID: "8f604ec4-bd49-48ca-b077-690ad4d6af61"). InnerVolumeSpecName "kube-api-access-69bdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:52.382547 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.382526    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-podinfo" pod "8f604ec4-bd49-48ca-b077-690ad4d6af61" (UID: "8f604ec4-bd49-48ca-b077-690ad4d6af61"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:35:52.382666 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.382582    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-token" pod "79d6d61c-e0cd-4b22-8ae7-212908d5249d" (UID: "79d6d61c-e0cd-4b22-8ae7-212908d5249d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:52.382737 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.382652    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-envoy" pod "79d6d61c-e0cd-4b22-8ae7-212908d5249d" (UID: "79d6d61c-e0cd-4b22-8ae7-212908d5249d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.384239 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.384048    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-podinfo" pod "79d6d61c-e0cd-4b22-8ae7-212908d5249d" (UID: "79d6d61c-e0cd-4b22-8ae7-212908d5249d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:35:52.384381 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.384360    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79d6d61c-e0cd-4b22-8ae7-212908d5249d-kube-api-access-c2hht" pod "79d6d61c-e0cd-4b22-8ae7-212908d5249d" (UID: "79d6d61c-e0cd-4b22-8ae7-212908d5249d"). InnerVolumeSpecName "kube-api-access-c2hht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:52.385322 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.385299    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-token" pod "8f604ec4-bd49-48ca-b077-690ad4d6af61" (UID: "8f604ec4-bd49-48ca-b077-690ad4d6af61"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:52.389215 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.389127    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:35:52.479931 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.479892    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-credential-socket\") pod \"9af764ed-0a79-4623-baa7-2a48950c6541\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") "
Nov 04 02:35:52.480238 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.479949    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9af764ed-0a79-4623-baa7-2a48950c6541-istio-token\" (UniqueName: \"kubernetes.io/projected/9af764ed-0a79-4623-baa7-2a48950c6541-istio-token\") pod \"9af764ed-0a79-4623-baa7-2a48950c6541\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") "
Nov 04 02:35:52.480238 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.480050    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9af764ed-0a79-4623-baa7-2a48950c6541-kube-api-access-rst8c\" (UniqueName: \"kubernetes.io/projected/9af764ed-0a79-4623-baa7-2a48950c6541-kube-api-access-rst8c\") pod \"9af764ed-0a79-4623-baa7-2a48950c6541\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") "
Nov 04 02:35:52.480238 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.480130    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9af764ed-0a79-4623-baa7-2a48950c6541-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9af764ed-0a79-4623-baa7-2a48950c6541-istio-podinfo\") pod \"9af764ed-0a79-4623-baa7-2a48950c6541\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") "
Nov 04 02:35:52.480238 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.480235    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-workload-certs\") pod \"9af764ed-0a79-4623-baa7-2a48950c6541\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") "
Nov 04 02:35:52.480858 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.480352    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-workload-socket\") pod \"9af764ed-0a79-4623-baa7-2a48950c6541\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") "
Nov 04 02:35:52.480858 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.480418    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9af764ed-0a79-4623-baa7-2a48950c6541-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9af764ed-0a79-4623-baa7-2a48950c6541-istiod-ca-cert\") pod \"9af764ed-0a79-4623-baa7-2a48950c6541\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") "
Nov 04 02:35:52.480858 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.480480    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-istio-envoy\") pod \"9af764ed-0a79-4623-baa7-2a48950c6541\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") "
Nov 04 02:35:52.480858 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.480537    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-istio-data\") pod \"9af764ed-0a79-4623-baa7-2a48950c6541\" (UID: \"9af764ed-0a79-4623-baa7-2a48950c6541\") "
Nov 04 02:35:52.483121 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.481583    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-credential-socket" pod "9af764ed-0a79-4623-baa7-2a48950c6541" (UID: "9af764ed-0a79-4623-baa7-2a48950c6541"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.486940 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.485424    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-workload-certs" pod "9af764ed-0a79-4623-baa7-2a48950c6541" (UID: "9af764ed-0a79-4623-baa7-2a48950c6541"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.486940 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.485870    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9af764ed-0a79-4623-baa7-2a48950c6541-istiod-ca-cert" pod "9af764ed-0a79-4623-baa7-2a48950c6541" (UID: "9af764ed-0a79-4623-baa7-2a48950c6541"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:35:52.486940 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.486453    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9af764ed-0a79-4623-baa7-2a48950c6541-istio-token" pod "9af764ed-0a79-4623-baa7-2a48950c6541" (UID: "9af764ed-0a79-4623-baa7-2a48950c6541"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:52.487289 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.487101    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-istio-data" pod "9af764ed-0a79-4623-baa7-2a48950c6541" (UID: "9af764ed-0a79-4623-baa7-2a48950c6541"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.487539 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.487466    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9af764ed-0a79-4623-baa7-2a48950c6541-kube-api-access-rst8c" pod "9af764ed-0a79-4623-baa7-2a48950c6541" (UID: "9af764ed-0a79-4623-baa7-2a48950c6541"). InnerVolumeSpecName "kube-api-access-rst8c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:35:52.487840 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.487793    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-workload-socket" pod "9af764ed-0a79-4623-baa7-2a48950c6541" (UID: "9af764ed-0a79-4623-baa7-2a48950c6541"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.488430 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.488407    4548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-workload-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.488430 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.488436    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2hht\" (UniqueName: \"kubernetes.io/projected/79d6d61c-e0cd-4b22-8ae7-212908d5249d-kube-api-access-c2hht\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.488591 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.488451    4548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-credential-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.488591 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.488468    4548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-token\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.488591 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.488482    4548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8f604ec4-bd49-48ca-b077-690ad4d6af61-istiod-ca-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.488591 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.488496    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69bdz\" (UniqueName: \"kubernetes.io/projected/8f604ec4-bd49-48ca-b077-690ad4d6af61-kube-api-access-69bdz\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.488591 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.488510    4548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istiod-ca-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.488591 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.488523    4548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-workload-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.488591 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.488537    4548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-workload-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.488591 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.488552    4548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-podinfo\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.488591 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.488566    4548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-envoy\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.488591 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.488579    4548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8f604ec4-bd49-48ca-b077-690ad4d6af61-istio-podinfo\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.488591 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.488593    4548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-token\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.489143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.488607    4548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/79d6d61c-e0cd-4b22-8ae7-212908d5249d-istio-envoy\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.489484 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.489457    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-istio-envoy" pod "9af764ed-0a79-4623-baa7-2a48950c6541" (UID: "9af764ed-0a79-4623-baa7-2a48950c6541"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:35:52.491425 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.491399    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9af764ed-0a79-4623-baa7-2a48950c6541-istio-podinfo" pod "9af764ed-0a79-4623-baa7-2a48950c6541" (UID: "9af764ed-0a79-4623-baa7-2a48950c6541"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:35:52.589885 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.589812    4548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-credential-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.589885 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.589847    4548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9af764ed-0a79-4623-baa7-2a48950c6541-istio-token\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.589885 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.589862    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rst8c\" (UniqueName: \"kubernetes.io/projected/9af764ed-0a79-4623-baa7-2a48950c6541-kube-api-access-rst8c\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.589885 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.589877    4548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9af764ed-0a79-4623-baa7-2a48950c6541-istio-podinfo\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.589885 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.589891    4548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-workload-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.590245 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.589904    4548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-workload-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.590245 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.589917    4548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9af764ed-0a79-4623-baa7-2a48950c6541-istiod-ca-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.590245 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.589929    4548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-istio-envoy\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.590245 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.589941    4548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9af764ed-0a79-4623-baa7-2a48950c6541-istio-data\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:35:52.985239 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.985207    4548 generic.go:356] "Generic (PLEG): container finished" podID="79d6d61c-e0cd-4b22-8ae7-212908d5249d" containerID="bb9d44bd5269e46b54c2c079d7a6faae5703ceaace5a85b5f0ccc40f3f6eadfd" exitCode=0
Nov 04 02:35:52.985498 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.985271    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj" event={"ID":"79d6d61c-e0cd-4b22-8ae7-212908d5249d","Type":"ContainerDied","Data":"bb9d44bd5269e46b54c2c079d7a6faae5703ceaace5a85b5f0ccc40f3f6eadfd"}
Nov 04 02:35:52.985498 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.985303    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"
Nov 04 02:35:52.985498 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.985331    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj" event={"ID":"79d6d61c-e0cd-4b22-8ae7-212908d5249d","Type":"ContainerDied","Data":"9bb06ae948a6a3cf201d0fc2ab7fb5f3936ff6c9c0fec9985e8fafeac2ad642e"}
Nov 04 02:35:52.985498 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.985348    4548 scope.go:122] "RemoveContainer" containerID="bb9d44bd5269e46b54c2c079d7a6faae5703ceaace5a85b5f0ccc40f3f6eadfd"
Nov 04 02:35:52.987076 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.987053    4548 generic.go:356] "Generic (PLEG): container finished" podID="8f604ec4-bd49-48ca-b077-690ad4d6af61" containerID="ce33fbd92edd836d2d1083dbd1f12ac4c3b042cef28fab7d8842411e67c0c7c3" exitCode=0
Nov 04 02:35:52.987235 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.987216    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"
Nov 04 02:35:52.987395 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.987218    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv" event={"ID":"8f604ec4-bd49-48ca-b077-690ad4d6af61","Type":"ContainerDied","Data":"ce33fbd92edd836d2d1083dbd1f12ac4c3b042cef28fab7d8842411e67c0c7c3"}
Nov 04 02:35:52.987477 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.987415    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv" event={"ID":"8f604ec4-bd49-48ca-b077-690ad4d6af61","Type":"ContainerDied","Data":"861ab05e4b1b21f9c749b833dc93f09374b6fd19f7fce91fab786d3caceae06f"}
Nov 04 02:35:52.989901 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.989870    4548 generic.go:356] "Generic (PLEG): container finished" podID="9af764ed-0a79-4623-baa7-2a48950c6541" containerID="01aa70ddb633d91e79ccd263346394e3f0b9aa9021f0e68e7bf74f563d8707d2" exitCode=0
Nov 04 02:35:52.990026 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.989934    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57" event={"ID":"9af764ed-0a79-4623-baa7-2a48950c6541","Type":"ContainerDied","Data":"01aa70ddb633d91e79ccd263346394e3f0b9aa9021f0e68e7bf74f563d8707d2"}
Nov 04 02:35:52.990026 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.989980    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"
Nov 04 02:35:52.990026 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:52.989995    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57" event={"ID":"9af764ed-0a79-4623-baa7-2a48950c6541","Type":"ContainerDied","Data":"5d12b1f06afada22321ff75cc62111d87cca76488e5bd100071dc59eb9704e85"}
Nov 04 02:35:53.001781 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:53.001746    4548 scope.go:122] "RemoveContainer" containerID="bb9d44bd5269e46b54c2c079d7a6faae5703ceaace5a85b5f0ccc40f3f6eadfd"
Nov 04 02:35:53.002268 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:35:53.002237    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb9d44bd5269e46b54c2c079d7a6faae5703ceaace5a85b5f0ccc40f3f6eadfd\": container with ID starting with bb9d44bd5269e46b54c2c079d7a6faae5703ceaace5a85b5f0ccc40f3f6eadfd not found: ID does not exist" containerID="bb9d44bd5269e46b54c2c079d7a6faae5703ceaace5a85b5f0ccc40f3f6eadfd"
Nov 04 02:35:53.002389 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:53.002287    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb9d44bd5269e46b54c2c079d7a6faae5703ceaace5a85b5f0ccc40f3f6eadfd"} err="failed to get container status \"bb9d44bd5269e46b54c2c079d7a6faae5703ceaace5a85b5f0ccc40f3f6eadfd\": rpc error: code = NotFound desc = could not find container \"bb9d44bd5269e46b54c2c079d7a6faae5703ceaace5a85b5f0ccc40f3f6eadfd\": container with ID starting with bb9d44bd5269e46b54c2c079d7a6faae5703ceaace5a85b5f0ccc40f3f6eadfd not found: ID does not exist"
Nov 04 02:35:53.002389 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:53.002316    4548 scope.go:122] "RemoveContainer" containerID="ce33fbd92edd836d2d1083dbd1f12ac4c3b042cef28fab7d8842411e67c0c7c3"
Nov 04 02:35:53.014473 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:53.014453    4548 scope.go:122] "RemoveContainer" containerID="ce33fbd92edd836d2d1083dbd1f12ac4c3b042cef28fab7d8842411e67c0c7c3"
Nov 04 02:35:53.014886 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:35:53.014865    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce33fbd92edd836d2d1083dbd1f12ac4c3b042cef28fab7d8842411e67c0c7c3\": container with ID starting with ce33fbd92edd836d2d1083dbd1f12ac4c3b042cef28fab7d8842411e67c0c7c3 not found: ID does not exist" containerID="ce33fbd92edd836d2d1083dbd1f12ac4c3b042cef28fab7d8842411e67c0c7c3"
Nov 04 02:35:53.014945 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:53.014898    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce33fbd92edd836d2d1083dbd1f12ac4c3b042cef28fab7d8842411e67c0c7c3"} err="failed to get container status \"ce33fbd92edd836d2d1083dbd1f12ac4c3b042cef28fab7d8842411e67c0c7c3\": rpc error: code = NotFound desc = could not find container \"ce33fbd92edd836d2d1083dbd1f12ac4c3b042cef28fab7d8842411e67c0c7c3\": container with ID starting with ce33fbd92edd836d2d1083dbd1f12ac4c3b042cef28fab7d8842411e67c0c7c3 not found: ID does not exist"
Nov 04 02:35:53.014945 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:53.014919    4548 scope.go:122] "RemoveContainer" containerID="01aa70ddb633d91e79ccd263346394e3f0b9aa9021f0e68e7bf74f563d8707d2"
Nov 04 02:35:53.026415 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:53.026388    4548 scope.go:122] "RemoveContainer" containerID="40846d7e7380e7b90a8836e22c9d023b0fc74b45ecb07899c7e81d6e0f7a1a23"
Nov 04 02:35:53.037558 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:53.037532    4548 scope.go:122] "RemoveContainer" containerID="01aa70ddb633d91e79ccd263346394e3f0b9aa9021f0e68e7bf74f563d8707d2"
Nov 04 02:35:53.037928 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:35:53.037905    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01aa70ddb633d91e79ccd263346394e3f0b9aa9021f0e68e7bf74f563d8707d2\": container with ID starting with 01aa70ddb633d91e79ccd263346394e3f0b9aa9021f0e68e7bf74f563d8707d2 not found: ID does not exist" containerID="01aa70ddb633d91e79ccd263346394e3f0b9aa9021f0e68e7bf74f563d8707d2"
Nov 04 02:35:53.038007 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:53.037938    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01aa70ddb633d91e79ccd263346394e3f0b9aa9021f0e68e7bf74f563d8707d2"} err="failed to get container status \"01aa70ddb633d91e79ccd263346394e3f0b9aa9021f0e68e7bf74f563d8707d2\": rpc error: code = NotFound desc = could not find container \"01aa70ddb633d91e79ccd263346394e3f0b9aa9021f0e68e7bf74f563d8707d2\": container with ID starting with 01aa70ddb633d91e79ccd263346394e3f0b9aa9021f0e68e7bf74f563d8707d2 not found: ID does not exist"
Nov 04 02:35:53.038007 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:53.037962    4548 scope.go:122] "RemoveContainer" containerID="40846d7e7380e7b90a8836e22c9d023b0fc74b45ecb07899c7e81d6e0f7a1a23"
Nov 04 02:35:53.038349 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:35:53.038328    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40846d7e7380e7b90a8836e22c9d023b0fc74b45ecb07899c7e81d6e0f7a1a23\": container with ID starting with 40846d7e7380e7b90a8836e22c9d023b0fc74b45ecb07899c7e81d6e0f7a1a23 not found: ID does not exist" containerID="40846d7e7380e7b90a8836e22c9d023b0fc74b45ecb07899c7e81d6e0f7a1a23"
Nov 04 02:35:53.038406 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:53.038357    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40846d7e7380e7b90a8836e22c9d023b0fc74b45ecb07899c7e81d6e0f7a1a23"} err="failed to get container status \"40846d7e7380e7b90a8836e22c9d023b0fc74b45ecb07899c7e81d6e0f7a1a23\": rpc error: code = NotFound desc = could not find container \"40846d7e7380e7b90a8836e22c9d023b0fc74b45ecb07899c7e81d6e0f7a1a23\": container with ID starting with 40846d7e7380e7b90a8836e22c9d023b0fc74b45ecb07899c7e81d6e0f7a1a23 not found: ID does not exist"
Nov 04 02:35:53.163777 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:53.163737    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"]
Nov 04 02:35:53.169006 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:53.168968    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-4cvtv"]
Nov 04 02:35:53.283588 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:53.283548    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"]
Nov 04 02:35:53.288726 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:53.288691    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-qrh57"]
Nov 04 02:35:53.401443 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:53.401404    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"]
Nov 04 02:35:53.405368 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:53.405332    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-a18c43-openshift-default-797b4855dc-dcvnj"]
Nov 04 02:35:54.524767 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:54.524734    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="79d6d61c-e0cd-4b22-8ae7-212908d5249d" path="/var/lib/kubelet/pods/79d6d61c-e0cd-4b22-8ae7-212908d5249d/volumes"
Nov 04 02:35:54.525258 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:54.525243    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8f604ec4-bd49-48ca-b077-690ad4d6af61" path="/var/lib/kubelet/pods/8f604ec4-bd49-48ca-b077-690ad4d6af61/volumes"
Nov 04 02:35:54.525679 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:35:54.525666    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9af764ed-0a79-4623-baa7-2a48950c6541" path="/var/lib/kubelet/pods/9af764ed-0a79-4623-baa7-2a48950c6541/volumes"
Nov 04 02:36:06.750886 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:06.750853    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:36:06.754497 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:06.754473    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:36:10.612037 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:36:10.611999    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:36:40.404459 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:40.404423    4548 generic.go:356] "Generic (PLEG): container finished" podID="765164d9-fde8-43e6-bd5d-527b9bd69a23" containerID="315a2e4a441b117ad00e0eb07c1b6753ad74567fa6c6d28d74dd9952cda2e393" exitCode=0
Nov 04 02:36:40.404925 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:40.404479    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t" event={"ID":"765164d9-fde8-43e6-bd5d-527b9bd69a23","Type":"ContainerDied","Data":"315a2e4a441b117ad00e0eb07c1b6753ad74567fa6c6d28d74dd9952cda2e393"}
Nov 04 02:36:40.404971 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:40.404939    4548 scope.go:122] "RemoveContainer" containerID="315a2e4a441b117ad00e0eb07c1b6753ad74567fa6c6d28d74dd9952cda2e393"
Nov 04 02:36:40.406612 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:40.406579    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:36:40.406690 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:40.406658    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:36:40.406728 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:40.406692    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:36:40.614581 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:36:40.614548    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:36:41.422637 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:41.422593    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t" event={"ID":"765164d9-fde8-43e6-bd5d-527b9bd69a23","Type":"ContainerStarted","Data":"77e19eb247aceea07a2486c2acaac15ce25d956ad6d15d2bbb19db27dcfea8e2"}
Nov 04 02:36:42.231286 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:42.230494    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:36:42.231838 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:42.231807    4548 patch_prober.go:29] interesting pod/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Nov 04 02:36:42.231935 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:42.231883    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t" podUID="765164d9-fde8-43e6-bd5d-527b9bd69a23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Nov 04 02:36:43.230517 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:43.230479    4548 patch_prober.go:29] interesting pod/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Nov 04 02:36:43.231027 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:43.230556    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t" podUID="765164d9-fde8-43e6-bd5d-527b9bd69a23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Nov 04 02:36:44.230463 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:44.230425    4548 patch_prober.go:29] interesting pod/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Nov 04 02:36:44.230695 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:44.230501    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t" podUID="765164d9-fde8-43e6-bd5d-527b9bd69a23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Nov 04 02:36:44.293674 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:44.293633    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:36:45.229961 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:45.229925    4548 patch_prober.go:29] interesting pod/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Nov 04 02:36:45.230151 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:45.229987    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t" podUID="765164d9-fde8-43e6-bd5d-527b9bd69a23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Nov 04 02:36:46.230406 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:46.230372    4548 patch_prober.go:29] interesting pod/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused" start-of-body=
Nov 04 02:36:46.230834 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:46.230436    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t" podUID="765164d9-fde8-43e6-bd5d-527b9bd69a23" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.80:15021/healthz/ready\": dial tcp 10.133.0.80:15021: connect: connection refused"
Nov 04 02:36:47.234458 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:47.234423    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:36:47.235576 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:47.235553    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:36:55.571949 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.571898    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl"]
Nov 04 02:36:55.572715 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.572694    4548 cpu_manager.go:414] "containerMap: removing container" podUID="8f604ec4-bd49-48ca-b077-690ad4d6af61" containerName="istio-proxy"
Nov 04 02:36:55.572796 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.572717    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8f604ec4-bd49-48ca-b077-690ad4d6af61" containerName="istio-proxy"
Nov 04 02:36:55.572796 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.572758    4548 cpu_manager.go:414] "containerMap: removing container" podUID="9af764ed-0a79-4623-baa7-2a48950c6541" containerName="istio-proxy"
Nov 04 02:36:55.572796 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.572767    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9af764ed-0a79-4623-baa7-2a48950c6541" containerName="istio-proxy"
Nov 04 02:36:55.572796 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.572779    4548 cpu_manager.go:414] "containerMap: removing container" podUID="79d6d61c-e0cd-4b22-8ae7-212908d5249d" containerName="istio-proxy"
Nov 04 02:36:55.572796 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.572787    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="79d6d61c-e0cd-4b22-8ae7-212908d5249d" containerName="istio-proxy"
Nov 04 02:36:55.573005 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.572818    4548 cpu_manager.go:414] "containerMap: removing container" podUID="9af764ed-0a79-4623-baa7-2a48950c6541" containerName="istio-proxy"
Nov 04 02:36:55.573005 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.572826    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9af764ed-0a79-4623-baa7-2a48950c6541" containerName="istio-proxy"
Nov 04 02:36:55.573005 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.572943    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="79d6d61c-e0cd-4b22-8ae7-212908d5249d" containerName="istio-proxy"
Nov 04 02:36:55.573005 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.572959    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="9af764ed-0a79-4623-baa7-2a48950c6541" containerName="istio-proxy"
Nov 04 02:36:55.573005 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.572972    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="8f604ec4-bd49-48ca-b077-690ad4d6af61" containerName="istio-proxy"
Nov 04 02:36:55.576997 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.576966    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl"
Nov 04 02:36:55.620059 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.620005    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/730b294f-8be4-4950-907a-cfb848d41dcf-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-69cfda10-fr2hl\" (UID: \"730b294f-8be4-4950-907a-cfb848d41dcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl"
Nov 04 02:36:55.620264 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.620237    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfpw6\" (UniqueName: \"kubernetes.io/projected/730b294f-8be4-4950-907a-cfb848d41dcf-kube-api-access-lfpw6\") pod \"maas-api-revoke-sub-69cfda10-fr2hl\" (UID: \"730b294f-8be4-4950-907a-cfb848d41dcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl"
Nov 04 02:36:55.620466 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.620436    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/730b294f-8be4-4950-907a-cfb848d41dcf-maas-api-xks-ca\") pod \"maas-api-revoke-sub-69cfda10-fr2hl\" (UID: \"730b294f-8be4-4950-907a-cfb848d41dcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl"
Nov 04 02:36:55.635583 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.635543    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl"]
Nov 04 02:36:55.679693 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.679653    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 02:36:55.679888 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.679703    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:36:55.682505 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.682480    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:36:55.682581 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.682551    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:36:55.722460 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.722427    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/730b294f-8be4-4950-907a-cfb848d41dcf-maas-api-xks-ca\") pod \"maas-api-revoke-sub-69cfda10-fr2hl\" (UID: \"730b294f-8be4-4950-907a-cfb848d41dcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl"
Nov 04 02:36:55.722683 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.722532    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/730b294f-8be4-4950-907a-cfb848d41dcf-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-69cfda10-fr2hl\" (UID: \"730b294f-8be4-4950-907a-cfb848d41dcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl"
Nov 04 02:36:55.722683 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.722648    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfpw6\" (UniqueName: \"kubernetes.io/projected/730b294f-8be4-4950-907a-cfb848d41dcf-kube-api-access-lfpw6\") pod \"maas-api-revoke-sub-69cfda10-fr2hl\" (UID: \"730b294f-8be4-4950-907a-cfb848d41dcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl"
Nov 04 02:36:55.723385 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.723365    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/730b294f-8be4-4950-907a-cfb848d41dcf-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-69cfda10-fr2hl\" (UID: \"730b294f-8be4-4950-907a-cfb848d41dcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl"
Nov 04 02:36:55.725243 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.725214    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/730b294f-8be4-4950-907a-cfb848d41dcf-maas-api-xks-ca\") pod \"maas-api-revoke-sub-69cfda10-fr2hl\" (UID: \"730b294f-8be4-4950-907a-cfb848d41dcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl"
Nov 04 02:36:55.789828 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.789782    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfpw6\" (UniqueName: \"kubernetes.io/projected/730b294f-8be4-4950-907a-cfb848d41dcf-kube-api-access-lfpw6\") pod \"maas-api-revoke-sub-69cfda10-fr2hl\" (UID: \"730b294f-8be4-4950-907a-cfb848d41dcf\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl"
Nov 04 02:36:55.891773 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:55.891683    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl"
Nov 04 02:36:56.278713 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:56.278679    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl"]
Nov 04 02:36:56.280790 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:36:56.280759    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod730b294f_8be4_4950_907a_cfb848d41dcf.slice/crio-a09c91c159f9e8f649570201b2b622dbca2f1ad3ab9e278188579977272a1bb2 WatchSource:0}: Error finding container a09c91c159f9e8f649570201b2b622dbca2f1ad3ab9e278188579977272a1bb2: Status 404 returned error can't find the container with id a09c91c159f9e8f649570201b2b622dbca2f1ad3ab9e278188579977272a1bb2
Nov 04 02:36:56.539671 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:56.539579    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl" event={"ID":"730b294f-8be4-4950-907a-cfb848d41dcf","Type":"ContainerStarted","Data":"a09c91c159f9e8f649570201b2b622dbca2f1ad3ab9e278188579977272a1bb2"}
Nov 04 02:36:57.548787 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:57.548748    4548 generic.go:356] "Generic (PLEG): container finished" podID="730b294f-8be4-4950-907a-cfb848d41dcf" containerID="2ff4232f44a8e7185637950f6336497c1a059878b2e1ff2b1d8826caf6baa4fe" exitCode=0
Nov 04 02:36:57.549270 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:57.548841    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl" event={"ID":"730b294f-8be4-4950-907a-cfb848d41dcf","Type":"ContainerDied","Data":"2ff4232f44a8e7185637950f6336497c1a059878b2e1ff2b1d8826caf6baa4fe"}
Nov 04 02:36:58.723583 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:58.723544    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl"
Nov 04 02:36:58.762802 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:58.762765    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/730b294f-8be4-4950-907a-cfb848d41dcf-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/730b294f-8be4-4950-907a-cfb848d41dcf-maas-api-openshift-ca\") pod \"730b294f-8be4-4950-907a-cfb848d41dcf\" (UID: \"730b294f-8be4-4950-907a-cfb848d41dcf\") "
Nov 04 02:36:58.763001 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:58.762821    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/730b294f-8be4-4950-907a-cfb848d41dcf-kube-api-access-lfpw6\" (UniqueName: \"kubernetes.io/projected/730b294f-8be4-4950-907a-cfb848d41dcf-kube-api-access-lfpw6\") pod \"730b294f-8be4-4950-907a-cfb848d41dcf\" (UID: \"730b294f-8be4-4950-907a-cfb848d41dcf\") "
Nov 04 02:36:58.763001 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:58.762894    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/730b294f-8be4-4950-907a-cfb848d41dcf-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/730b294f-8be4-4950-907a-cfb848d41dcf-maas-api-xks-ca\") pod \"730b294f-8be4-4950-907a-cfb848d41dcf\" (UID: \"730b294f-8be4-4950-907a-cfb848d41dcf\") "
Nov 04 02:36:58.763307 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:58.763279    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/730b294f-8be4-4950-907a-cfb848d41dcf-maas-api-openshift-ca" pod "730b294f-8be4-4950-907a-cfb848d41dcf" (UID: "730b294f-8be4-4950-907a-cfb848d41dcf"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:36:58.765313 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:58.765276    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/730b294f-8be4-4950-907a-cfb848d41dcf-maas-api-xks-ca" pod "730b294f-8be4-4950-907a-cfb848d41dcf" (UID: "730b294f-8be4-4950-907a-cfb848d41dcf"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:36:58.765428 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:58.765338    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/730b294f-8be4-4950-907a-cfb848d41dcf-kube-api-access-lfpw6" pod "730b294f-8be4-4950-907a-cfb848d41dcf" (UID: "730b294f-8be4-4950-907a-cfb848d41dcf"). InnerVolumeSpecName "kube-api-access-lfpw6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:36:58.864518 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:58.864433    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/730b294f-8be4-4950-907a-cfb848d41dcf-maas-api-openshift-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:36:58.864518 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:58.864466    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfpw6\" (UniqueName: \"kubernetes.io/projected/730b294f-8be4-4950-907a-cfb848d41dcf-kube-api-access-lfpw6\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:36:58.864518 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:58.864477    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/730b294f-8be4-4950-907a-cfb848d41dcf-maas-api-xks-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:36:59.563826 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:59.563794    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl"
Nov 04 02:36:59.564048 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:59.563793    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl" event={"ID":"730b294f-8be4-4950-907a-cfb848d41dcf","Type":"ContainerDied","Data":"a09c91c159f9e8f649570201b2b622dbca2f1ad3ab9e278188579977272a1bb2"}
Nov 04 02:36:59.564048 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:36:59.563916    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a09c91c159f9e8f649570201b2b622dbca2f1ad3ab9e278188579977272a1bb2"
Nov 04 02:37:08.441867 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.441825    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62"]
Nov 04 02:37:08.442432 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.442377    4548 cpu_manager.go:414] "containerMap: removing container" podUID="730b294f-8be4-4950-907a-cfb848d41dcf" containerName="revoke-keys"
Nov 04 02:37:08.442432 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.442390    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="730b294f-8be4-4950-907a-cfb848d41dcf" containerName="revoke-keys"
Nov 04 02:37:08.442508 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.442484    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="9af764ed-0a79-4623-baa7-2a48950c6541" containerName="istio-proxy"
Nov 04 02:37:08.442508 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.442497    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="730b294f-8be4-4950-907a-cfb848d41dcf" containerName="revoke-keys"
Nov 04 02:37:08.446125 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.446103    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62"
Nov 04 02:37:08.503439 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.503395    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62"]
Nov 04 02:37:08.547657 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.547624    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:37:08.547657 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.547637    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 02:37:08.547657 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.547662    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:37:08.547934 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.547724    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:37:08.603749 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.603708    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2vqn\" (UniqueName: \"kubernetes.io/projected/e04f4b82-f244-4314-b27d-51dfafee4e7f-kube-api-access-q2vqn\") pod \"maas-api-revoke-sub-4229a718-l9w62\" (UID: \"e04f4b82-f244-4314-b27d-51dfafee4e7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62"
Nov 04 02:37:08.603961 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.603868    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e04f4b82-f244-4314-b27d-51dfafee4e7f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4229a718-l9w62\" (UID: \"e04f4b82-f244-4314-b27d-51dfafee4e7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62"
Nov 04 02:37:08.603961 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.603935    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e04f4b82-f244-4314-b27d-51dfafee4e7f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4229a718-l9w62\" (UID: \"e04f4b82-f244-4314-b27d-51dfafee4e7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62"
Nov 04 02:37:08.705537 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.705432    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2vqn\" (UniqueName: \"kubernetes.io/projected/e04f4b82-f244-4314-b27d-51dfafee4e7f-kube-api-access-q2vqn\") pod \"maas-api-revoke-sub-4229a718-l9w62\" (UID: \"e04f4b82-f244-4314-b27d-51dfafee4e7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62"
Nov 04 02:37:08.705709 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.705563    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e04f4b82-f244-4314-b27d-51dfafee4e7f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4229a718-l9w62\" (UID: \"e04f4b82-f244-4314-b27d-51dfafee4e7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62"
Nov 04 02:37:08.705709 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.705646    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e04f4b82-f244-4314-b27d-51dfafee4e7f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4229a718-l9w62\" (UID: \"e04f4b82-f244-4314-b27d-51dfafee4e7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62"
Nov 04 02:37:08.706385 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.706363    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e04f4b82-f244-4314-b27d-51dfafee4e7f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4229a718-l9w62\" (UID: \"e04f4b82-f244-4314-b27d-51dfafee4e7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62"
Nov 04 02:37:08.708303 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.708282    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e04f4b82-f244-4314-b27d-51dfafee4e7f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4229a718-l9w62\" (UID: \"e04f4b82-f244-4314-b27d-51dfafee4e7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62"
Nov 04 02:37:08.767564 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:08.767529    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2vqn\" (UniqueName: \"kubernetes.io/projected/e04f4b82-f244-4314-b27d-51dfafee4e7f-kube-api-access-q2vqn\") pod \"maas-api-revoke-sub-4229a718-l9w62\" (UID: \"e04f4b82-f244-4314-b27d-51dfafee4e7f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62"
Nov 04 02:37:09.061095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:09.061057    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62"
Nov 04 02:37:09.446551 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:09.446518    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62"]
Nov 04 02:37:09.447733 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:37:09.447694    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode04f4b82_f244_4314_b27d_51dfafee4e7f.slice/crio-cc06614f91357ff32bdf5cc434cb250aa0bcb240122c3809900c7cee1f0bd4a9 WatchSource:0}: Error finding container cc06614f91357ff32bdf5cc434cb250aa0bcb240122c3809900c7cee1f0bd4a9: Status 404 returned error can't find the container with id cc06614f91357ff32bdf5cc434cb250aa0bcb240122c3809900c7cee1f0bd4a9
Nov 04 02:37:09.653386 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:09.653339    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62" event={"ID":"e04f4b82-f244-4314-b27d-51dfafee4e7f","Type":"ContainerStarted","Data":"cc06614f91357ff32bdf5cc434cb250aa0bcb240122c3809900c7cee1f0bd4a9"}
Nov 04 02:37:10.612785 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:37:10.612745    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:37:10.662392 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:10.662347    4548 generic.go:356] "Generic (PLEG): container finished" podID="e04f4b82-f244-4314-b27d-51dfafee4e7f" containerID="57c15f2141561b6546707bb78b3d2954959ae7686fb4eb791f731348e118771b" exitCode=0
Nov 04 02:37:10.662567 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:10.662432    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62" event={"ID":"e04f4b82-f244-4314-b27d-51dfafee4e7f","Type":"ContainerDied","Data":"57c15f2141561b6546707bb78b3d2954959ae7686fb4eb791f731348e118771b"}
Nov 04 02:37:11.844712 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:11.844681    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62"
Nov 04 02:37:11.948833 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:11.948724    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e04f4b82-f244-4314-b27d-51dfafee4e7f-kube-api-access-q2vqn\" (UniqueName: \"kubernetes.io/projected/e04f4b82-f244-4314-b27d-51dfafee4e7f-kube-api-access-q2vqn\") pod \"e04f4b82-f244-4314-b27d-51dfafee4e7f\" (UID: \"e04f4b82-f244-4314-b27d-51dfafee4e7f\") "
Nov 04 02:37:11.948833 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:11.948816    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e04f4b82-f244-4314-b27d-51dfafee4e7f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e04f4b82-f244-4314-b27d-51dfafee4e7f-maas-api-openshift-ca\") pod \"e04f4b82-f244-4314-b27d-51dfafee4e7f\" (UID: \"e04f4b82-f244-4314-b27d-51dfafee4e7f\") "
Nov 04 02:37:11.949077 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:11.948858    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e04f4b82-f244-4314-b27d-51dfafee4e7f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e04f4b82-f244-4314-b27d-51dfafee4e7f-maas-api-xks-ca\") pod \"e04f4b82-f244-4314-b27d-51dfafee4e7f\" (UID: \"e04f4b82-f244-4314-b27d-51dfafee4e7f\") "
Nov 04 02:37:11.949217 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:11.949188    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e04f4b82-f244-4314-b27d-51dfafee4e7f-maas-api-openshift-ca" pod "e04f4b82-f244-4314-b27d-51dfafee4e7f" (UID: "e04f4b82-f244-4314-b27d-51dfafee4e7f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:37:11.949406 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:11.949391    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e04f4b82-f244-4314-b27d-51dfafee4e7f-maas-api-openshift-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:37:11.951288 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:11.951250    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e04f4b82-f244-4314-b27d-51dfafee4e7f-kube-api-access-q2vqn" pod "e04f4b82-f244-4314-b27d-51dfafee4e7f" (UID: "e04f4b82-f244-4314-b27d-51dfafee4e7f"). InnerVolumeSpecName "kube-api-access-q2vqn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:37:11.951288 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:11.951257    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e04f4b82-f244-4314-b27d-51dfafee4e7f-maas-api-xks-ca" pod "e04f4b82-f244-4314-b27d-51dfafee4e7f" (UID: "e04f4b82-f244-4314-b27d-51dfafee4e7f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:37:12.050693 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:12.050655    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q2vqn\" (UniqueName: \"kubernetes.io/projected/e04f4b82-f244-4314-b27d-51dfafee4e7f-kube-api-access-q2vqn\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:37:12.050693 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:12.050688    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e04f4b82-f244-4314-b27d-51dfafee4e7f-maas-api-xks-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:37:12.678700 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:12.678669    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62"
Nov 04 02:37:12.678911 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:12.678665    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62" event={"ID":"e04f4b82-f244-4314-b27d-51dfafee4e7f","Type":"ContainerDied","Data":"cc06614f91357ff32bdf5cc434cb250aa0bcb240122c3809900c7cee1f0bd4a9"}
Nov 04 02:37:12.678911 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:37:12.678790    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc06614f91357ff32bdf5cc434cb250aa0bcb240122c3809900c7cee1f0bd4a9"
Nov 04 02:37:40.656617 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:37:40.656575    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:38:10.617532 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:38:10.617491    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:38:21.472775 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:21.472740    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"]
Nov 04 02:38:21.473331 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:21.472949    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w" podUID="9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" containerName="istio-proxy" containerID="cri-o://5dcb8a7b3d3114b263550a8008109c00c0346e0301f8d41721cc56a8dee64e96" gracePeriod=30
Nov 04 02:38:22.281351 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.281305    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9"]
Nov 04 02:38:22.281954 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.281934    4548 cpu_manager.go:414] "containerMap: removing container" podUID="e04f4b82-f244-4314-b27d-51dfafee4e7f" containerName="revoke-keys"
Nov 04 02:38:22.282068 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.281957    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e04f4b82-f244-4314-b27d-51dfafee4e7f" containerName="revoke-keys"
Nov 04 02:38:22.282159 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.282145    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="e04f4b82-f244-4314-b27d-51dfafee4e7f" containerName="revoke-keys"
Nov 04 02:38:22.285965 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.285937    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9"
Nov 04 02:38:22.341755 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.341703    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9"]
Nov 04 02:38:22.368893 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.368853    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 02:38:22.368893 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.368868    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:38:22.369180 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.368868    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:38:22.387431 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.387396    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:38:22.413988 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.413933    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-978pg\" (UniqueName: \"kubernetes.io/projected/6356dba0-549d-46d2-87f3-6fee2ddea239-kube-api-access-978pg\") pod \"maas-api-revoke-sub-db63b8d3-hmhq9\" (UID: \"6356dba0-549d-46d2-87f3-6fee2ddea239\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9"
Nov 04 02:38:22.414220 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.414092    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6356dba0-549d-46d2-87f3-6fee2ddea239-maas-api-xks-ca\") pod \"maas-api-revoke-sub-db63b8d3-hmhq9\" (UID: \"6356dba0-549d-46d2-87f3-6fee2ddea239\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9"
Nov 04 02:38:22.414339 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.414239    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6356dba0-549d-46d2-87f3-6fee2ddea239-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-db63b8d3-hmhq9\" (UID: \"6356dba0-549d-46d2-87f3-6fee2ddea239\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9"
Nov 04 02:38:22.516115 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.516072    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6356dba0-549d-46d2-87f3-6fee2ddea239-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-db63b8d3-hmhq9\" (UID: \"6356dba0-549d-46d2-87f3-6fee2ddea239\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9"
Nov 04 02:38:22.516590 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.516282    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-978pg\" (UniqueName: \"kubernetes.io/projected/6356dba0-549d-46d2-87f3-6fee2ddea239-kube-api-access-978pg\") pod \"maas-api-revoke-sub-db63b8d3-hmhq9\" (UID: \"6356dba0-549d-46d2-87f3-6fee2ddea239\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9"
Nov 04 02:38:22.516590 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.516339    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6356dba0-549d-46d2-87f3-6fee2ddea239-maas-api-xks-ca\") pod \"maas-api-revoke-sub-db63b8d3-hmhq9\" (UID: \"6356dba0-549d-46d2-87f3-6fee2ddea239\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9"
Nov 04 02:38:22.516828 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.516797    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6356dba0-549d-46d2-87f3-6fee2ddea239-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-db63b8d3-hmhq9\" (UID: \"6356dba0-549d-46d2-87f3-6fee2ddea239\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9"
Nov 04 02:38:22.519005 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.518981    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6356dba0-549d-46d2-87f3-6fee2ddea239-maas-api-xks-ca\") pod \"maas-api-revoke-sub-db63b8d3-hmhq9\" (UID: \"6356dba0-549d-46d2-87f3-6fee2ddea239\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9"
Nov 04 02:38:22.585245 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.585139    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-978pg\" (UniqueName: \"kubernetes.io/projected/6356dba0-549d-46d2-87f3-6fee2ddea239-kube-api-access-978pg\") pod \"maas-api-revoke-sub-db63b8d3-hmhq9\" (UID: \"6356dba0-549d-46d2-87f3-6fee2ddea239\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9"
Nov 04 02:38:22.604423 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.604385    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9"
Nov 04 02:38:22.686304 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.686264    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"]
Nov 04 02:38:22.697389 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:22.693482    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr" podUID="4b694e41-1176-4a62-a1eb-6451520b1ece" containerName="istio-proxy" containerID="cri-o://ed290b86713aef36855ba6b858ebf962722394f6ddd12342c04fe746eba290ac" gracePeriod=30
Nov 04 02:38:23.055441 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:23.055409    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9"]
Nov 04 02:38:23.057129 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:38:23.057100    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6356dba0_549d_46d2_87f3_6fee2ddea239.slice/crio-53f3e1710f681d4ee3bd76d4331abdaea0e58947c5d752a320e1a5a23e9809ac WatchSource:0}: Error finding container 53f3e1710f681d4ee3bd76d4331abdaea0e58947c5d752a320e1a5a23e9809ac: Status 404 returned error can't find the container with id 53f3e1710f681d4ee3bd76d4331abdaea0e58947c5d752a320e1a5a23e9809ac
Nov 04 02:38:23.342376 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:23.342269    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9" event={"ID":"6356dba0-549d-46d2-87f3-6fee2ddea239","Type":"ContainerStarted","Data":"53f3e1710f681d4ee3bd76d4331abdaea0e58947c5d752a320e1a5a23e9809ac"}
Nov 04 02:38:24.351237 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:24.351201    4548 generic.go:356] "Generic (PLEG): container finished" podID="6356dba0-549d-46d2-87f3-6fee2ddea239" containerID="72ca8a6ae1fec78ab453e1dda62ff2b3c2e5f86e1cd2fa74d7c8b409180962e6" exitCode=0
Nov 04 02:38:24.351680 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:24.351262    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9" event={"ID":"6356dba0-549d-46d2-87f3-6fee2ddea239","Type":"ContainerDied","Data":"72ca8a6ae1fec78ab453e1dda62ff2b3c2e5f86e1cd2fa74d7c8b409180962e6"}
Nov 04 02:38:25.542285 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:25.542257    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9"
Nov 04 02:38:25.662827 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:25.662730    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6356dba0-549d-46d2-87f3-6fee2ddea239-kube-api-access-978pg\" (UniqueName: \"kubernetes.io/projected/6356dba0-549d-46d2-87f3-6fee2ddea239-kube-api-access-978pg\") pod \"6356dba0-549d-46d2-87f3-6fee2ddea239\" (UID: \"6356dba0-549d-46d2-87f3-6fee2ddea239\") "
Nov 04 02:38:25.663005 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:25.662892    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/6356dba0-549d-46d2-87f3-6fee2ddea239-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6356dba0-549d-46d2-87f3-6fee2ddea239-maas-api-xks-ca\") pod \"6356dba0-549d-46d2-87f3-6fee2ddea239\" (UID: \"6356dba0-549d-46d2-87f3-6fee2ddea239\") "
Nov 04 02:38:25.663005 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:25.662951    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6356dba0-549d-46d2-87f3-6fee2ddea239-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6356dba0-549d-46d2-87f3-6fee2ddea239-maas-api-openshift-ca\") pod \"6356dba0-549d-46d2-87f3-6fee2ddea239\" (UID: \"6356dba0-549d-46d2-87f3-6fee2ddea239\") "
Nov 04 02:38:25.664272 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:25.664243    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6356dba0-549d-46d2-87f3-6fee2ddea239-maas-api-openshift-ca" pod "6356dba0-549d-46d2-87f3-6fee2ddea239" (UID: "6356dba0-549d-46d2-87f3-6fee2ddea239"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:38:25.666321 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:25.666289    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6356dba0-549d-46d2-87f3-6fee2ddea239-maas-api-xks-ca" pod "6356dba0-549d-46d2-87f3-6fee2ddea239" (UID: "6356dba0-549d-46d2-87f3-6fee2ddea239"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:38:25.666492 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:25.666463    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6356dba0-549d-46d2-87f3-6fee2ddea239-kube-api-access-978pg" pod "6356dba0-549d-46d2-87f3-6fee2ddea239" (UID: "6356dba0-549d-46d2-87f3-6fee2ddea239"). InnerVolumeSpecName "kube-api-access-978pg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:38:25.764576 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:25.764536    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/6356dba0-549d-46d2-87f3-6fee2ddea239-maas-api-xks-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:25.764576 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:25.764567    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/6356dba0-549d-46d2-87f3-6fee2ddea239-maas-api-openshift-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:25.764576 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:25.764578    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-978pg\" (UniqueName: \"kubernetes.io/projected/6356dba0-549d-46d2-87f3-6fee2ddea239-kube-api-access-978pg\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:26.366180 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.366136    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9"
Nov 04 02:38:26.366370 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.366189    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9" event={"ID":"6356dba0-549d-46d2-87f3-6fee2ddea239","Type":"ContainerDied","Data":"53f3e1710f681d4ee3bd76d4331abdaea0e58947c5d752a320e1a5a23e9809ac"}
Nov 04 02:38:26.366370 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.366238    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="53f3e1710f681d4ee3bd76d4331abdaea0e58947c5d752a320e1a5a23e9809ac"
Nov 04 02:38:26.743096 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.743066    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:38:26.878756 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.878720    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-kube-api-access-w4vxm\" (UniqueName: \"kubernetes.io/projected/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-kube-api-access-w4vxm\") pod \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") "
Nov 04 02:38:26.878975 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.878778    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-envoy\") pod \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") "
Nov 04 02:38:26.878975 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.878875    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-credential-socket\") pod \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") "
Nov 04 02:38:26.878975 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.878926    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-podinfo\") pod \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") "
Nov 04 02:38:26.879253 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.879011    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istiod-ca-cert\") pod \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") "
Nov 04 02:38:26.879253 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.879057    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-workload-certs\") pod \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") "
Nov 04 02:38:26.879253 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.879083    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-workload-socket\") pod \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") "
Nov 04 02:38:26.879253 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.879140    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-data\") pod \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") "
Nov 04 02:38:26.879253 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.879189    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-token\" (UniqueName: \"kubernetes.io/projected/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-token\") pod \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\" (UID: \"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9\") "
Nov 04 02:38:26.879513 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.879266    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-credential-socket" pod "9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" (UID: "9fa0bc0c-e89d-4af3-9212-ca64152dd1b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:38:26.879513 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.879464    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-workload-socket" pod "9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" (UID: "9fa0bc0c-e89d-4af3-9212-ca64152dd1b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:38:26.879619 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.879573    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-data" pod "9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" (UID: "9fa0bc0c-e89d-4af3-9212-ca64152dd1b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:38:26.879697 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.879672    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istiod-ca-cert" pod "9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" (UID: "9fa0bc0c-e89d-4af3-9212-ca64152dd1b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:38:26.880517 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.879893    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-workload-certs" pod "9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" (UID: "9fa0bc0c-e89d-4af3-9212-ca64152dd1b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:38:26.880517 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.880288    4548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-credential-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:26.880517 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.880314    4548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istiod-ca-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:26.880517 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.880329    4548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-workload-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:26.880517 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.880343    4548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-workload-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:26.880517 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.880356    4548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-data\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:26.882020 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.881981    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-envoy" pod "9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" (UID: "9fa0bc0c-e89d-4af3-9212-ca64152dd1b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:38:26.882254 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.882223    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-kube-api-access-w4vxm" pod "9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" (UID: "9fa0bc0c-e89d-4af3-9212-ca64152dd1b9"). InnerVolumeSpecName "kube-api-access-w4vxm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:38:26.882376 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.882353    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-podinfo" pod "9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" (UID: "9fa0bc0c-e89d-4af3-9212-ca64152dd1b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:38:26.882595 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.882576    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-token" pod "9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" (UID: "9fa0bc0c-e89d-4af3-9212-ca64152dd1b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:38:26.984791 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.984698    4548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-envoy\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:26.984791 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.984738    4548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-podinfo\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:26.984791 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.984752    4548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-istio-token\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:26.984791 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:26.984765    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4vxm\" (UniqueName: \"kubernetes.io/projected/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9-kube-api-access-w4vxm\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:27.376863 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:27.376826    4548 generic.go:356] "Generic (PLEG): container finished" podID="9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" containerID="5dcb8a7b3d3114b263550a8008109c00c0346e0301f8d41721cc56a8dee64e96" exitCode=0
Nov 04 02:38:27.377083 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:27.376882    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"
Nov 04 02:38:27.377083 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:27.376914    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w" event={"ID":"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9","Type":"ContainerDied","Data":"5dcb8a7b3d3114b263550a8008109c00c0346e0301f8d41721cc56a8dee64e96"}
Nov 04 02:38:27.377083 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:27.376978    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w" event={"ID":"9fa0bc0c-e89d-4af3-9212-ca64152dd1b9","Type":"ContainerDied","Data":"82e14eecff7a64b33318a1f62aa9f6ef7d427bca0692b9a7610e92f64f087217"}
Nov 04 02:38:27.377083 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:27.377003    4548 scope.go:122] "RemoveContainer" containerID="5dcb8a7b3d3114b263550a8008109c00c0346e0301f8d41721cc56a8dee64e96"
Nov 04 02:38:27.389832 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:27.389802    4548 scope.go:122] "RemoveContainer" containerID="5dcb8a7b3d3114b263550a8008109c00c0346e0301f8d41721cc56a8dee64e96"
Nov 04 02:38:27.390263 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:38:27.390232    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5dcb8a7b3d3114b263550a8008109c00c0346e0301f8d41721cc56a8dee64e96\": container with ID starting with 5dcb8a7b3d3114b263550a8008109c00c0346e0301f8d41721cc56a8dee64e96 not found: ID does not exist" containerID="5dcb8a7b3d3114b263550a8008109c00c0346e0301f8d41721cc56a8dee64e96"
Nov 04 02:38:27.390351 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:27.390268    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5dcb8a7b3d3114b263550a8008109c00c0346e0301f8d41721cc56a8dee64e96"} err="failed to get container status \"5dcb8a7b3d3114b263550a8008109c00c0346e0301f8d41721cc56a8dee64e96\": rpc error: code = NotFound desc = could not find container \"5dcb8a7b3d3114b263550a8008109c00c0346e0301f8d41721cc56a8dee64e96\": container with ID starting with 5dcb8a7b3d3114b263550a8008109c00c0346e0301f8d41721cc56a8dee64e96 not found: ID does not exist"
Nov 04 02:38:27.596565 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:27.596524    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"]
Nov 04 02:38:27.646221 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:27.646120    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-t5s7w"]
Nov 04 02:38:27.985719 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:27.985694    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:38:28.098396 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.098362    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-data\") pod \"4b694e41-1176-4a62-a1eb-6451520b1ece\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") "
Nov 04 02:38:28.098594 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.098442    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-workload-socket\") pod \"4b694e41-1176-4a62-a1eb-6451520b1ece\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") "
Nov 04 02:38:28.098594 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.098477    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4b694e41-1176-4a62-a1eb-6451520b1ece-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b694e41-1176-4a62-a1eb-6451520b1ece-istiod-ca-cert\") pod \"4b694e41-1176-4a62-a1eb-6451520b1ece\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") "
Nov 04 02:38:28.098594 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.098517    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-envoy\") pod \"4b694e41-1176-4a62-a1eb-6451520b1ece\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") "
Nov 04 02:38:28.098594 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.098546    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-credential-socket\") pod \"4b694e41-1176-4a62-a1eb-6451520b1ece\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") "
Nov 04 02:38:28.098789 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.098613    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4b694e41-1176-4a62-a1eb-6451520b1ece-kube-api-access-2dzfq\" (UniqueName: \"kubernetes.io/projected/4b694e41-1176-4a62-a1eb-6451520b1ece-kube-api-access-2dzfq\") pod \"4b694e41-1176-4a62-a1eb-6451520b1ece\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") "
Nov 04 02:38:28.098789 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.098713    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-data" pod "4b694e41-1176-4a62-a1eb-6451520b1ece" (UID: "4b694e41-1176-4a62-a1eb-6451520b1ece"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:38:28.098789 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.098730    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-podinfo\") pod \"4b694e41-1176-4a62-a1eb-6451520b1ece\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") "
Nov 04 02:38:28.098953 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.098777    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-workload-socket" pod "4b694e41-1176-4a62-a1eb-6451520b1ece" (UID: "4b694e41-1176-4a62-a1eb-6451520b1ece"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:38:28.098953 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.098806    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-token\" (UniqueName: \"kubernetes.io/projected/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-token\") pod \"4b694e41-1176-4a62-a1eb-6451520b1ece\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") "
Nov 04 02:38:28.098953 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.098896    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-workload-certs\") pod \"4b694e41-1176-4a62-a1eb-6451520b1ece\" (UID: \"4b694e41-1176-4a62-a1eb-6451520b1ece\") "
Nov 04 02:38:28.099103 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.098963    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b694e41-1176-4a62-a1eb-6451520b1ece-istiod-ca-cert" pod "4b694e41-1176-4a62-a1eb-6451520b1ece" (UID: "4b694e41-1176-4a62-a1eb-6451520b1ece"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:38:28.099103 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.098992    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-credential-socket" pod "4b694e41-1176-4a62-a1eb-6451520b1ece" (UID: "4b694e41-1176-4a62-a1eb-6451520b1ece"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:38:28.099320 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.099300    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-workload-certs" pod "4b694e41-1176-4a62-a1eb-6451520b1ece" (UID: "4b694e41-1176-4a62-a1eb-6451520b1ece"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:38:28.099508 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.099493    4548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-workload-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:28.099572 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.099514    4548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-data\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:28.099572 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.099529    4548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-workload-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:28.099572 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.099545    4548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4b694e41-1176-4a62-a1eb-6451520b1ece-istiod-ca-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:28.099572 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.099560    4548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-credential-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:28.101112 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.101080    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-podinfo" pod "4b694e41-1176-4a62-a1eb-6451520b1ece" (UID: "4b694e41-1176-4a62-a1eb-6451520b1ece"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:38:28.101240 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.101150    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b694e41-1176-4a62-a1eb-6451520b1ece-kube-api-access-2dzfq" pod "4b694e41-1176-4a62-a1eb-6451520b1ece" (UID: "4b694e41-1176-4a62-a1eb-6451520b1ece"). InnerVolumeSpecName "kube-api-access-2dzfq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:38:28.101618 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.101601    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-token" pod "4b694e41-1176-4a62-a1eb-6451520b1ece" (UID: "4b694e41-1176-4a62-a1eb-6451520b1ece"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:38:28.101618 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.101604    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-envoy" pod "4b694e41-1176-4a62-a1eb-6451520b1ece" (UID: "4b694e41-1176-4a62-a1eb-6451520b1ece"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:38:28.200506 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.200474    4548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-envoy\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:28.200506 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.200504    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dzfq\" (UniqueName: \"kubernetes.io/projected/4b694e41-1176-4a62-a1eb-6451520b1ece-kube-api-access-2dzfq\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:28.200506 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.200516    4548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-podinfo\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:28.200744 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.200527    4548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4b694e41-1176-4a62-a1eb-6451520b1ece-istio-token\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:28.389150 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.389118    4548 generic.go:356] "Generic (PLEG): container finished" podID="4b694e41-1176-4a62-a1eb-6451520b1ece" containerID="ed290b86713aef36855ba6b858ebf962722394f6ddd12342c04fe746eba290ac" exitCode=0
Nov 04 02:38:28.389392 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.389206    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"
Nov 04 02:38:28.389392 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.389205    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr" event={"ID":"4b694e41-1176-4a62-a1eb-6451520b1ece","Type":"ContainerDied","Data":"ed290b86713aef36855ba6b858ebf962722394f6ddd12342c04fe746eba290ac"}
Nov 04 02:38:28.389392 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.389267    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr" event={"ID":"4b694e41-1176-4a62-a1eb-6451520b1ece","Type":"ContainerDied","Data":"728ad13c9c7feb4746c1deeb098bbf16e0d2949ade2a4f3862449abf58901fc0"}
Nov 04 02:38:28.389392 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.389300    4548 scope.go:122] "RemoveContainer" containerID="ed290b86713aef36855ba6b858ebf962722394f6ddd12342c04fe746eba290ac"
Nov 04 02:38:28.407116 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.407090    4548 scope.go:122] "RemoveContainer" containerID="58e3b2c28fc62c18716f92c7b229d910766441c57e33ebb81d6f29f4a5730cc0"
Nov 04 02:38:28.418025 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.417998    4548 scope.go:122] "RemoveContainer" containerID="ed290b86713aef36855ba6b858ebf962722394f6ddd12342c04fe746eba290ac"
Nov 04 02:38:28.418422 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:38:28.418392    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed290b86713aef36855ba6b858ebf962722394f6ddd12342c04fe746eba290ac\": container with ID starting with ed290b86713aef36855ba6b858ebf962722394f6ddd12342c04fe746eba290ac not found: ID does not exist" containerID="ed290b86713aef36855ba6b858ebf962722394f6ddd12342c04fe746eba290ac"
Nov 04 02:38:28.418542 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.418426    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed290b86713aef36855ba6b858ebf962722394f6ddd12342c04fe746eba290ac"} err="failed to get container status \"ed290b86713aef36855ba6b858ebf962722394f6ddd12342c04fe746eba290ac\": rpc error: code = NotFound desc = could not find container \"ed290b86713aef36855ba6b858ebf962722394f6ddd12342c04fe746eba290ac\": container with ID starting with ed290b86713aef36855ba6b858ebf962722394f6ddd12342c04fe746eba290ac not found: ID does not exist"
Nov 04 02:38:28.418542 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.418449    4548 scope.go:122] "RemoveContainer" containerID="58e3b2c28fc62c18716f92c7b229d910766441c57e33ebb81d6f29f4a5730cc0"
Nov 04 02:38:28.418744 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:38:28.418728    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58e3b2c28fc62c18716f92c7b229d910766441c57e33ebb81d6f29f4a5730cc0\": container with ID starting with 58e3b2c28fc62c18716f92c7b229d910766441c57e33ebb81d6f29f4a5730cc0 not found: ID does not exist" containerID="58e3b2c28fc62c18716f92c7b229d910766441c57e33ebb81d6f29f4a5730cc0"
Nov 04 02:38:28.418796 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.418750    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58e3b2c28fc62c18716f92c7b229d910766441c57e33ebb81d6f29f4a5730cc0"} err="failed to get container status \"58e3b2c28fc62c18716f92c7b229d910766441c57e33ebb81d6f29f4a5730cc0\": rpc error: code = NotFound desc = could not find container \"58e3b2c28fc62c18716f92c7b229d910766441c57e33ebb81d6f29f4a5730cc0\": container with ID starting with 58e3b2c28fc62c18716f92c7b229d910766441c57e33ebb81d6f29f4a5730cc0 not found: ID does not exist"
Nov 04 02:38:28.524889 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.524854    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" path="/var/lib/kubelet/pods/9fa0bc0c-e89d-4af3-9212-ca64152dd1b9/volumes"
Nov 04 02:38:28.557865 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.557824    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"]
Nov 04 02:38:28.608082 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:28.608046    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-a-493b10-openshift-default-c47476b77-69ftr"]
Nov 04 02:38:30.536064 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:30.536003    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4b694e41-1176-4a62-a1eb-6451520b1ece" path="/var/lib/kubelet/pods/4b694e41-1176-4a62-a1eb-6451520b1ece/volumes"
Nov 04 02:38:40.615844 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:38:40.615797    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:38:45.879007 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:45.878968    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"]
Nov 04 02:38:45.879552 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:45.879237    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d" podUID="be003f9f-9a96-47b9-b603-c2698b09a2a0" containerName="istio-proxy" containerID="cri-o://49cf7faa519e843741d49c913e7ba5cff7138e147d4fac41cbcb0e9ec2319827" gracePeriod=30
Nov 04 02:38:48.641782 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:48.641736    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 02:38:48.642243 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:48.641828    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d" podUID="be003f9f-9a96-47b9-b603-c2698b09a2a0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 02:38:51.163675 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.163642    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:38:51.341290 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.341248    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-credential-socket\") pod \"be003f9f-9a96-47b9-b603-c2698b09a2a0\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") "
Nov 04 02:38:51.341290 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.341293    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-token\" (UniqueName: \"kubernetes.io/projected/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-token\") pod \"be003f9f-9a96-47b9-b603-c2698b09a2a0\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") "
Nov 04 02:38:51.341563 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.341435    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/be003f9f-9a96-47b9-b603-c2698b09a2a0-kube-api-access-ws7z9\" (UniqueName: \"kubernetes.io/projected/be003f9f-9a96-47b9-b603-c2698b09a2a0-kube-api-access-ws7z9\") pod \"be003f9f-9a96-47b9-b603-c2698b09a2a0\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") "
Nov 04 02:38:51.341563 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.341480    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-podinfo\") pod \"be003f9f-9a96-47b9-b603-c2698b09a2a0\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") "
Nov 04 02:38:51.341668 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.341570    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/be003f9f-9a96-47b9-b603-c2698b09a2a0-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be003f9f-9a96-47b9-b603-c2698b09a2a0-istiod-ca-cert\") pod \"be003f9f-9a96-47b9-b603-c2698b09a2a0\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") "
Nov 04 02:38:51.341668 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.341604    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-workload-certs\") pod \"be003f9f-9a96-47b9-b603-c2698b09a2a0\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") "
Nov 04 02:38:51.341779 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.341682    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-workload-socket\") pod \"be003f9f-9a96-47b9-b603-c2698b09a2a0\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") "
Nov 04 02:38:51.341779 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.341766    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-data\") pod \"be003f9f-9a96-47b9-b603-c2698b09a2a0\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") "
Nov 04 02:38:51.341884 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.341804    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-envoy\") pod \"be003f9f-9a96-47b9-b603-c2698b09a2a0\" (UID: \"be003f9f-9a96-47b9-b603-c2698b09a2a0\") "
Nov 04 02:38:51.341884 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.341608    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-credential-socket" pod "be003f9f-9a96-47b9-b603-c2698b09a2a0" (UID: "be003f9f-9a96-47b9-b603-c2698b09a2a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:38:51.342001 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.341923    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be003f9f-9a96-47b9-b603-c2698b09a2a0-istiod-ca-cert" pod "be003f9f-9a96-47b9-b603-c2698b09a2a0" (UID: "be003f9f-9a96-47b9-b603-c2698b09a2a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:38:51.342056 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.342031    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-workload-socket" pod "be003f9f-9a96-47b9-b603-c2698b09a2a0" (UID: "be003f9f-9a96-47b9-b603-c2698b09a2a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:38:51.342108 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.342068    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-data" pod "be003f9f-9a96-47b9-b603-c2698b09a2a0" (UID: "be003f9f-9a96-47b9-b603-c2698b09a2a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:38:51.342208 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.342104    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-workload-certs" pod "be003f9f-9a96-47b9-b603-c2698b09a2a0" (UID: "be003f9f-9a96-47b9-b603-c2698b09a2a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:38:51.342803 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.342775    4548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-workload-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:51.342930 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.342809    4548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-data\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:51.342930 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.342823    4548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-credential-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:51.342930 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.342837    4548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be003f9f-9a96-47b9-b603-c2698b09a2a0-istiod-ca-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:51.342930 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.342849    4548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-workload-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:51.344076 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.344043    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-token" pod "be003f9f-9a96-47b9-b603-c2698b09a2a0" (UID: "be003f9f-9a96-47b9-b603-c2698b09a2a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:38:51.344271 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.344232    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-podinfo" pod "be003f9f-9a96-47b9-b603-c2698b09a2a0" (UID: "be003f9f-9a96-47b9-b603-c2698b09a2a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:38:51.344459 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.344441    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-envoy" pod "be003f9f-9a96-47b9-b603-c2698b09a2a0" (UID: "be003f9f-9a96-47b9-b603-c2698b09a2a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:38:51.344704 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.344687    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be003f9f-9a96-47b9-b603-c2698b09a2a0-kube-api-access-ws7z9" pod "be003f9f-9a96-47b9-b603-c2698b09a2a0" (UID: "be003f9f-9a96-47b9-b603-c2698b09a2a0"). InnerVolumeSpecName "kube-api-access-ws7z9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:38:51.444190 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.444078    4548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-envoy\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:51.444190 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.444112    4548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-token\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:51.444190 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.444123    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ws7z9\" (UniqueName: \"kubernetes.io/projected/be003f9f-9a96-47b9-b603-c2698b09a2a0-kube-api-access-ws7z9\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:51.444190 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.444133    4548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be003f9f-9a96-47b9-b603-c2698b09a2a0-istio-podinfo\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:38:51.599568 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.599529    4548 generic.go:356] "Generic (PLEG): container finished" podID="be003f9f-9a96-47b9-b603-c2698b09a2a0" containerID="49cf7faa519e843741d49c913e7ba5cff7138e147d4fac41cbcb0e9ec2319827" exitCode=0
Nov 04 02:38:51.599970 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.599620    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"
Nov 04 02:38:51.604624 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.599640    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d" event={"ID":"be003f9f-9a96-47b9-b603-c2698b09a2a0","Type":"ContainerDied","Data":"49cf7faa519e843741d49c913e7ba5cff7138e147d4fac41cbcb0e9ec2319827"}
Nov 04 02:38:51.604821 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.604666    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d" event={"ID":"be003f9f-9a96-47b9-b603-c2698b09a2a0","Type":"ContainerDied","Data":"5dd3ad052e41536945112933591c37cd28497ba5e6fd2f28893f301439000d8d"}
Nov 04 02:38:51.604821 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.604710    4548 scope.go:122] "RemoveContainer" containerID="49cf7faa519e843741d49c913e7ba5cff7138e147d4fac41cbcb0e9ec2319827"
Nov 04 02:38:51.620780 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.620754    4548 scope.go:122] "RemoveContainer" containerID="fa03dd3f7af23021eb4e748626cf8bedba5195876b9273df4369e32fa48dae34"
Nov 04 02:38:51.634398 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.634368    4548 scope.go:122] "RemoveContainer" containerID="49cf7faa519e843741d49c913e7ba5cff7138e147d4fac41cbcb0e9ec2319827"
Nov 04 02:38:51.634819 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:38:51.634791    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49cf7faa519e843741d49c913e7ba5cff7138e147d4fac41cbcb0e9ec2319827\": container with ID starting with 49cf7faa519e843741d49c913e7ba5cff7138e147d4fac41cbcb0e9ec2319827 not found: ID does not exist" containerID="49cf7faa519e843741d49c913e7ba5cff7138e147d4fac41cbcb0e9ec2319827"
Nov 04 02:38:51.634917 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.634828    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49cf7faa519e843741d49c913e7ba5cff7138e147d4fac41cbcb0e9ec2319827"} err="failed to get container status \"49cf7faa519e843741d49c913e7ba5cff7138e147d4fac41cbcb0e9ec2319827\": rpc error: code = NotFound desc = could not find container \"49cf7faa519e843741d49c913e7ba5cff7138e147d4fac41cbcb0e9ec2319827\": container with ID starting with 49cf7faa519e843741d49c913e7ba5cff7138e147d4fac41cbcb0e9ec2319827 not found: ID does not exist"
Nov 04 02:38:51.634917 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.634849    4548 scope.go:122] "RemoveContainer" containerID="fa03dd3f7af23021eb4e748626cf8bedba5195876b9273df4369e32fa48dae34"
Nov 04 02:38:51.635211 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:38:51.635189    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa03dd3f7af23021eb4e748626cf8bedba5195876b9273df4369e32fa48dae34\": container with ID starting with fa03dd3f7af23021eb4e748626cf8bedba5195876b9273df4369e32fa48dae34 not found: ID does not exist" containerID="fa03dd3f7af23021eb4e748626cf8bedba5195876b9273df4369e32fa48dae34"
Nov 04 02:38:51.635261 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.635220    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa03dd3f7af23021eb4e748626cf8bedba5195876b9273df4369e32fa48dae34"} err="failed to get container status \"fa03dd3f7af23021eb4e748626cf8bedba5195876b9273df4369e32fa48dae34\": rpc error: code = NotFound desc = could not find container \"fa03dd3f7af23021eb4e748626cf8bedba5195876b9273df4369e32fa48dae34\": container with ID starting with fa03dd3f7af23021eb4e748626cf8bedba5195876b9273df4369e32fa48dae34 not found: ID does not exist"
Nov 04 02:38:51.798479 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.797601    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"]
Nov 04 02:38:51.807322 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:51.807272    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-a-31626a-openshift-default-78dc97674f-nkq4d"]
Nov 04 02:38:52.524609 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:52.524560    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="be003f9f-9a96-47b9-b603-c2698b09a2a0" path="/var/lib/kubelet/pods/be003f9f-9a96-47b9-b603-c2698b09a2a0/volumes"
Nov 04 02:38:58.111287 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.111246    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"]
Nov 04 02:38:58.111784 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.111768    4548 cpu_manager.go:414] "containerMap: removing container" podUID="4b694e41-1176-4a62-a1eb-6451520b1ece" containerName="istio-proxy"
Nov 04 02:38:58.111860 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.111786    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4b694e41-1176-4a62-a1eb-6451520b1ece" containerName="istio-proxy"
Nov 04 02:38:58.111860 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.111799    4548 cpu_manager.go:414] "containerMap: removing container" podUID="6356dba0-549d-46d2-87f3-6fee2ddea239" containerName="revoke-keys"
Nov 04 02:38:58.111860 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.111804    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6356dba0-549d-46d2-87f3-6fee2ddea239" containerName="revoke-keys"
Nov 04 02:38:58.111860 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.111813    4548 cpu_manager.go:414] "containerMap: removing container" podUID="4b694e41-1176-4a62-a1eb-6451520b1ece" containerName="istio-proxy"
Nov 04 02:38:58.111860 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.111819    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4b694e41-1176-4a62-a1eb-6451520b1ece" containerName="istio-proxy"
Nov 04 02:38:58.111860 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.111841    4548 cpu_manager.go:414] "containerMap: removing container" podUID="9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" containerName="istio-proxy"
Nov 04 02:38:58.111860 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.111846    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" containerName="istio-proxy"
Nov 04 02:38:58.111860 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.111854    4548 cpu_manager.go:414] "containerMap: removing container" podUID="be003f9f-9a96-47b9-b603-c2698b09a2a0" containerName="istio-proxy"
Nov 04 02:38:58.112144 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.111862    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be003f9f-9a96-47b9-b603-c2698b09a2a0" containerName="istio-proxy"
Nov 04 02:38:58.112144 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.111878    4548 cpu_manager.go:414] "containerMap: removing container" podUID="be003f9f-9a96-47b9-b603-c2698b09a2a0" containerName="istio-proxy"
Nov 04 02:38:58.112144 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.111883    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="be003f9f-9a96-47b9-b603-c2698b09a2a0" containerName="istio-proxy"
Nov 04 02:38:58.112144 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.111974    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="4b694e41-1176-4a62-a1eb-6451520b1ece" containerName="istio-proxy"
Nov 04 02:38:58.112144 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.111982    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="6356dba0-549d-46d2-87f3-6fee2ddea239" containerName="revoke-keys"
Nov 04 02:38:58.112144 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.111992    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="9fa0bc0c-e89d-4af3-9212-ca64152dd1b9" containerName="istio-proxy"
Nov 04 02:38:58.112144 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.111999    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="be003f9f-9a96-47b9-b603-c2698b09a2a0" containerName="istio-proxy"
Nov 04 02:38:58.112144 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.112007    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="be003f9f-9a96-47b9-b603-c2698b09a2a0" containerName="istio-proxy"
Nov 04 02:38:58.115713 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.115686    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"
Nov 04 02:38:58.219239 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.218478    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"agc-cred-63866b33446b\""
Nov 04 02:38:58.219239 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.218478    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"payload-processing-external-model-dockercfg-btb9r\""
Nov 04 02:38:58.219239 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.218555    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"models-as-a-service\"/\"agc-cred-a2f4f0610abb\""
Nov 04 02:38:58.219239 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.218564    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"routing-overlay\""
Nov 04 02:38:58.219239 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.218596    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"openshift-service-ca.crt\""
Nov 04 02:38:58.219239 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.218663    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"kube-root-ca.crt\""
Nov 04 02:38:58.219239 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.218833    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"models-as-a-service\"/\"payload-processing-external-model-plugins\""
Nov 04 02:38:58.224894 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.224861    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"]
Nov 04 02:38:58.250962 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.250920    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmnnr\" (UniqueName: \"kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-kube-api-access-lmnnr\") pod \"payload-processing-external-model-54f9d586c7-9k9pj\" (UID: \"09e06531-bcdc-436a-91d9-9c8748ee248b\") " pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"
Nov 04 02:38:58.251244 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.251089    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09e06531-bcdc-436a-91d9-9c8748ee248b-plugins-config-volume\") pod \"payload-processing-external-model-54f9d586c7-9k9pj\" (UID: \"09e06531-bcdc-436a-91d9-9c8748ee248b\") " pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"
Nov 04 02:38:58.251244 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.251153    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials\") pod \"payload-processing-external-model-54f9d586c7-9k9pj\" (UID: \"09e06531-bcdc-436a-91d9-9c8748ee248b\") " pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"
Nov 04 02:38:58.251391 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.251323    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/09e06531-bcdc-436a-91d9-9c8748ee248b-routing-overlay-volume\") pod \"payload-processing-external-model-54f9d586c7-9k9pj\" (UID: \"09e06531-bcdc-436a-91d9-9c8748ee248b\") " pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"
Nov 04 02:38:58.352161 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.352122    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmnnr\" (UniqueName: \"kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-kube-api-access-lmnnr\") pod \"payload-processing-external-model-54f9d586c7-9k9pj\" (UID: \"09e06531-bcdc-436a-91d9-9c8748ee248b\") " pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"
Nov 04 02:38:58.352399 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.352240    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09e06531-bcdc-436a-91d9-9c8748ee248b-plugins-config-volume\") pod \"payload-processing-external-model-54f9d586c7-9k9pj\" (UID: \"09e06531-bcdc-436a-91d9-9c8748ee248b\") " pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"
Nov 04 02:38:58.352399 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.352263    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials\") pod \"payload-processing-external-model-54f9d586c7-9k9pj\" (UID: \"09e06531-bcdc-436a-91d9-9c8748ee248b\") " pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"
Nov 04 02:38:58.352399 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.352331    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/09e06531-bcdc-436a-91d9-9c8748ee248b-routing-overlay-volume\") pod \"payload-processing-external-model-54f9d586c7-9k9pj\" (UID: \"09e06531-bcdc-436a-91d9-9c8748ee248b\") " pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"
Nov 04 02:38:58.352956 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.352929    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/09e06531-bcdc-436a-91d9-9c8748ee248b-routing-overlay-volume\") pod \"payload-processing-external-model-54f9d586c7-9k9pj\" (UID: \"09e06531-bcdc-436a-91d9-9c8748ee248b\") " pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"
Nov 04 02:38:58.353058 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.353012    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09e06531-bcdc-436a-91d9-9c8748ee248b-plugins-config-volume\") pod \"payload-processing-external-model-54f9d586c7-9k9pj\" (UID: \"09e06531-bcdc-436a-91d9-9c8748ee248b\") " pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"
Nov 04 02:38:58.355300 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.355275    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials\") pod \"payload-processing-external-model-54f9d586c7-9k9pj\" (UID: \"09e06531-bcdc-436a-91d9-9c8748ee248b\") " pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"
Nov 04 02:38:58.414278 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.414194    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmnnr\" (UniqueName: \"kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-kube-api-access-lmnnr\") pod \"payload-processing-external-model-54f9d586c7-9k9pj\" (UID: \"09e06531-bcdc-436a-91d9-9c8748ee248b\") " pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"
Nov 04 02:38:58.431260 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.431214    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"
Nov 04 02:38:58.819703 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.819649    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"]
Nov 04 02:38:58.820106 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:38:58.820070    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09e06531_bcdc_436a_91d9_9c8748ee248b.slice/crio-48d1a7a6532aa143fb5ebd3eef20b9571a0b58fe0cde63c73c14b6cb9a541bd2 WatchSource:0}: Error finding container 48d1a7a6532aa143fb5ebd3eef20b9571a0b58fe0cde63c73c14b6cb9a541bd2: Status 404 returned error can't find the container with id 48d1a7a6532aa143fb5ebd3eef20b9571a0b58fe0cde63c73c14b6cb9a541bd2
Nov 04 02:38:58.826803 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:58.826782    4548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 02:38:59.659622 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:38:59.659580    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj" event={"ID":"09e06531-bcdc-436a-91d9-9c8748ee248b","Type":"ContainerStarted","Data":"48d1a7a6532aa143fb5ebd3eef20b9571a0b58fe0cde63c73c14b6cb9a541bd2"}
Nov 04 02:39:02.719439 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:02.719383    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj" event={"ID":"09e06531-bcdc-436a-91d9-9c8748ee248b","Type":"ContainerStarted","Data":"0fce57d390289e303b8868af15306c918637d07e44541b65e4ab91312d3d3700"}
Nov 04 02:39:02.720118 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:02.720075    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"
Nov 04 02:39:02.841316 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:02.840583    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj" podStartSLOduration=1.443536518 podStartE2EDuration="4.840560441s" totalImagesPullingTime="3.397023923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:38:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:39:02.838557499 +0000 UTC m=+1376.443570499" watchObservedRunningTime="2026-11-04 02:39:02.840560441 +0000 UTC m=+1376.445573440"
Nov 04 02:39:04.980352 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:04.980303    4548 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-fd4b99879-9rmjg container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Nov 04 02:39:04.981012 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:04.980976    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-fd4b99879-9rmjg" podUID="a8df164d-d2b2-469b-8203-cb157a218c8a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.50:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:39:05.254297 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:05.236551    4548 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt" podUID="7bea1b32-d4ba-496c-b17d-b0b2d459010f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.66:8000/health\": context deadline exceeded"
Nov 04 02:39:05.301199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:05.301010    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z" podUID="8eafd96d-c3bb-494f-9b45-96c2d1d7bc00" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:39:10.613494 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:39:10.613451    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:39:14.803031 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:14.803002    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"
Nov 04 02:39:21.622384 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:21.622265    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94"]
Nov 04 02:39:21.622938 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:21.622922    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="4b694e41-1176-4a62-a1eb-6451520b1ece" containerName="istio-proxy"
Nov 04 02:39:21.628301 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:21.628274    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94"
Nov 04 02:39:21.682382 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:21.682340    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94"]
Nov 04 02:39:21.713938 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:21.713895    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2d3a3a4f-8908-4d9a-9e13-647354d1557c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3f509dfe-49t94\" (UID: \"2d3a3a4f-8908-4d9a-9e13-647354d1557c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94"
Nov 04 02:39:21.713938 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:21.713942    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2d3a3a4f-8908-4d9a-9e13-647354d1557c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3f509dfe-49t94\" (UID: \"2d3a3a4f-8908-4d9a-9e13-647354d1557c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94"
Nov 04 02:39:21.714261 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:21.714128    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqj5k\" (UniqueName: \"kubernetes.io/projected/2d3a3a4f-8908-4d9a-9e13-647354d1557c-kube-api-access-cqj5k\") pod \"maas-api-revoke-sub-3f509dfe-49t94\" (UID: \"2d3a3a4f-8908-4d9a-9e13-647354d1557c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94"
Nov 04 02:39:21.728199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:21.728143    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 02:39:21.728199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:21.728143    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:39:21.728417 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:21.728211    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:39:21.731209 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:21.731139    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:39:21.815113 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:21.815061    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqj5k\" (UniqueName: \"kubernetes.io/projected/2d3a3a4f-8908-4d9a-9e13-647354d1557c-kube-api-access-cqj5k\") pod \"maas-api-revoke-sub-3f509dfe-49t94\" (UID: \"2d3a3a4f-8908-4d9a-9e13-647354d1557c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94"
Nov 04 02:39:21.815372 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:21.815316    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2d3a3a4f-8908-4d9a-9e13-647354d1557c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3f509dfe-49t94\" (UID: \"2d3a3a4f-8908-4d9a-9e13-647354d1557c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94"
Nov 04 02:39:21.815372 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:21.815345    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2d3a3a4f-8908-4d9a-9e13-647354d1557c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3f509dfe-49t94\" (UID: \"2d3a3a4f-8908-4d9a-9e13-647354d1557c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94"
Nov 04 02:39:21.815967 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:21.815941    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2d3a3a4f-8908-4d9a-9e13-647354d1557c-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-3f509dfe-49t94\" (UID: \"2d3a3a4f-8908-4d9a-9e13-647354d1557c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94"
Nov 04 02:39:21.818079 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:21.818051    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2d3a3a4f-8908-4d9a-9e13-647354d1557c-maas-api-xks-ca\") pod \"maas-api-revoke-sub-3f509dfe-49t94\" (UID: \"2d3a3a4f-8908-4d9a-9e13-647354d1557c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94"
Nov 04 02:39:21.876728 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:21.876646    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqj5k\" (UniqueName: \"kubernetes.io/projected/2d3a3a4f-8908-4d9a-9e13-647354d1557c-kube-api-access-cqj5k\") pod \"maas-api-revoke-sub-3f509dfe-49t94\" (UID: \"2d3a3a4f-8908-4d9a-9e13-647354d1557c\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94"
Nov 04 02:39:21.943796 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:21.943761    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94"
Nov 04 02:39:22.367934 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:39:22.367897    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d3a3a4f_8908_4d9a_9e13_647354d1557c.slice/crio-d61a64e0c064292c3d7a8b0b66f0d670c0b15a26e088c605165a3ce7d19fb193 WatchSource:0}: Error finding container d61a64e0c064292c3d7a8b0b66f0d670c0b15a26e088c605165a3ce7d19fb193: Status 404 returned error can't find the container with id d61a64e0c064292c3d7a8b0b66f0d670c0b15a26e088c605165a3ce7d19fb193
Nov 04 02:39:22.368283 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:22.368252    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94"]
Nov 04 02:39:22.981575 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:22.981474    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94" event={"ID":"2d3a3a4f-8908-4d9a-9e13-647354d1557c","Type":"ContainerStarted","Data":"86bba3150f44efc7813df111b579df850e3a93a016774958b64e236c0d3dd77d"}
Nov 04 02:39:22.981575 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:22.981554    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94" event={"ID":"2d3a3a4f-8908-4d9a-9e13-647354d1557c","Type":"ContainerStarted","Data":"d61a64e0c064292c3d7a8b0b66f0d670c0b15a26e088c605165a3ce7d19fb193"}
Nov 04 02:39:23.110619 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:23.110566    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94" podStartSLOduration=2.110549639 podStartE2EDuration="2.110549639s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:39:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:39:23.109824819 +0000 UTC m=+1396.714837817" watchObservedRunningTime="2026-11-04 02:39:23.110549639 +0000 UTC m=+1396.715562634"
Nov 04 02:39:23.990951 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:23.990915    4548 generic.go:356] "Generic (PLEG): container finished" podID="2d3a3a4f-8908-4d9a-9e13-647354d1557c" containerID="86bba3150f44efc7813df111b579df850e3a93a016774958b64e236c0d3dd77d" exitCode=0
Nov 04 02:39:23.991567 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:23.990956    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94" event={"ID":"2d3a3a4f-8908-4d9a-9e13-647354d1557c","Type":"ContainerDied","Data":"86bba3150f44efc7813df111b579df850e3a93a016774958b64e236c0d3dd77d"}
Nov 04 02:39:25.235212 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:25.235141    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94"
Nov 04 02:39:25.270086 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:25.269021    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2d3a3a4f-8908-4d9a-9e13-647354d1557c-kube-api-access-cqj5k\" (UniqueName: \"kubernetes.io/projected/2d3a3a4f-8908-4d9a-9e13-647354d1557c-kube-api-access-cqj5k\") pod \"2d3a3a4f-8908-4d9a-9e13-647354d1557c\" (UID: \"2d3a3a4f-8908-4d9a-9e13-647354d1557c\") "
Nov 04 02:39:25.270086 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:25.269234    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2d3a3a4f-8908-4d9a-9e13-647354d1557c-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2d3a3a4f-8908-4d9a-9e13-647354d1557c-maas-api-openshift-ca\") pod \"2d3a3a4f-8908-4d9a-9e13-647354d1557c\" (UID: \"2d3a3a4f-8908-4d9a-9e13-647354d1557c\") "
Nov 04 02:39:25.270086 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:25.269349    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/2d3a3a4f-8908-4d9a-9e13-647354d1557c-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2d3a3a4f-8908-4d9a-9e13-647354d1557c-maas-api-xks-ca\") pod \"2d3a3a4f-8908-4d9a-9e13-647354d1557c\" (UID: \"2d3a3a4f-8908-4d9a-9e13-647354d1557c\") "
Nov 04 02:39:25.270086 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:25.270031    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d3a3a4f-8908-4d9a-9e13-647354d1557c-maas-api-openshift-ca" pod "2d3a3a4f-8908-4d9a-9e13-647354d1557c" (UID: "2d3a3a4f-8908-4d9a-9e13-647354d1557c"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:25.272333 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:25.272280    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d3a3a4f-8908-4d9a-9e13-647354d1557c-kube-api-access-cqj5k" pod "2d3a3a4f-8908-4d9a-9e13-647354d1557c" (UID: "2d3a3a4f-8908-4d9a-9e13-647354d1557c"). InnerVolumeSpecName "kube-api-access-cqj5k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:25.272752 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:25.272718    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d3a3a4f-8908-4d9a-9e13-647354d1557c-maas-api-xks-ca" pod "2d3a3a4f-8908-4d9a-9e13-647354d1557c" (UID: "2d3a3a4f-8908-4d9a-9e13-647354d1557c"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:39:25.377447 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:25.375272    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/2d3a3a4f-8908-4d9a-9e13-647354d1557c-maas-api-openshift-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:25.377447 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:25.375321    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/2d3a3a4f-8908-4d9a-9e13-647354d1557c-maas-api-xks-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:25.377447 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:25.375338    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cqj5k\" (UniqueName: \"kubernetes.io/projected/2d3a3a4f-8908-4d9a-9e13-647354d1557c-kube-api-access-cqj5k\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:25.841199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:25.840989    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"]
Nov 04 02:39:26.079467 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:26.079414    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94" event={"ID":"2d3a3a4f-8908-4d9a-9e13-647354d1557c","Type":"ContainerDied","Data":"d61a64e0c064292c3d7a8b0b66f0d670c0b15a26e088c605165a3ce7d19fb193"}
Nov 04 02:39:26.079798 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:26.079774    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d61a64e0c064292c3d7a8b0b66f0d670c0b15a26e088c605165a3ce7d19fb193"
Nov 04 02:39:26.090720 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:26.089672    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94"
Nov 04 02:39:28.575667 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:28.575625    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z" podUID="8eafd96d-c3bb-494f-9b45-96c2d1d7bc00" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": context deadline exceeded"
Nov 04 02:39:28.588205 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:28.582679    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z" podUID="eda062bb-6f3f-44d9-aea9-2e58c7c22190" containerName="main" probeResult="failure" output="Get \"https://10.133.0.65:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:39:28.798738 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:28.793892    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s" podUID="45e794f5-9772-4b3f-93e9-a968d32239cd" containerName="main" probeResult="failure" output="Get \"https://10.133.0.59:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:39:30.064802 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:30.064763    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462"]
Nov 04 02:39:30.114699 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:30.114641    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-21e2b100-kl462"]
Nov 04 02:39:30.524724 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:30.524685    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ed658b59-6b9d-45eb-b5d8-80f40d574e60" path="/var/lib/kubelet/pods/ed658b59-6b9d-45eb-b5d8-80f40d574e60/volumes"
Nov 04 02:39:31.549341 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.549297    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b"]
Nov 04 02:39:31.549837 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.549822    4548 cpu_manager.go:414] "containerMap: removing container" podUID="2d3a3a4f-8908-4d9a-9e13-647354d1557c" containerName="revoke-keys"
Nov 04 02:39:31.549885 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.549838    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2d3a3a4f-8908-4d9a-9e13-647354d1557c" containerName="revoke-keys"
Nov 04 02:39:31.549959 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.549949    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="2d3a3a4f-8908-4d9a-9e13-647354d1557c" containerName="revoke-keys"
Nov 04 02:39:31.554552 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.554526    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b"
Nov 04 02:39:31.610137 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.610098    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b"]
Nov 04 02:39:31.631225 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.631146    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt5r5\" (UniqueName: \"kubernetes.io/projected/d4d5a9fc-e958-462f-8028-b9a9213b18a9-kube-api-access-pt5r5\") pod \"maas-api-revoke-sub-b789f6a8-cfz2b\" (UID: \"d4d5a9fc-e958-462f-8028-b9a9213b18a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b"
Nov 04 02:39:31.631225 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.631216    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4d5a9fc-e958-462f-8028-b9a9213b18a9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b789f6a8-cfz2b\" (UID: \"d4d5a9fc-e958-462f-8028-b9a9213b18a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b"
Nov 04 02:39:31.631829 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.631802    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4d5a9fc-e958-462f-8028-b9a9213b18a9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b789f6a8-cfz2b\" (UID: \"d4d5a9fc-e958-462f-8028-b9a9213b18a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b"
Nov 04 02:39:31.654194 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.654146    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 02:39:31.654395 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.654377    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:39:31.657145 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.657119    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:39:31.657354 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.657302    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:39:31.734498 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.734460    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt5r5\" (UniqueName: \"kubernetes.io/projected/d4d5a9fc-e958-462f-8028-b9a9213b18a9-kube-api-access-pt5r5\") pod \"maas-api-revoke-sub-b789f6a8-cfz2b\" (UID: \"d4d5a9fc-e958-462f-8028-b9a9213b18a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b"
Nov 04 02:39:31.734498 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.734503    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4d5a9fc-e958-462f-8028-b9a9213b18a9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b789f6a8-cfz2b\" (UID: \"d4d5a9fc-e958-462f-8028-b9a9213b18a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b"
Nov 04 02:39:31.734744 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.734728    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4d5a9fc-e958-462f-8028-b9a9213b18a9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b789f6a8-cfz2b\" (UID: \"d4d5a9fc-e958-462f-8028-b9a9213b18a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b"
Nov 04 02:39:31.735451 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.735425    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4d5a9fc-e958-462f-8028-b9a9213b18a9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-b789f6a8-cfz2b\" (UID: \"d4d5a9fc-e958-462f-8028-b9a9213b18a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b"
Nov 04 02:39:31.737321 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.737295    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4d5a9fc-e958-462f-8028-b9a9213b18a9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-b789f6a8-cfz2b\" (UID: \"d4d5a9fc-e958-462f-8028-b9a9213b18a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b"
Nov 04 02:39:31.796413 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.796376    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt5r5\" (UniqueName: \"kubernetes.io/projected/d4d5a9fc-e958-462f-8028-b9a9213b18a9-kube-api-access-pt5r5\") pod \"maas-api-revoke-sub-b789f6a8-cfz2b\" (UID: \"d4d5a9fc-e958-462f-8028-b9a9213b18a9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b"
Nov 04 02:39:31.868954 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:31.868859    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b"
Nov 04 02:39:32.253905 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:32.253872    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b"]
Nov 04 02:39:32.254802 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:39:32.254761    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4d5a9fc_e958_462f_8028_b9a9213b18a9.slice/crio-cce1e3165880e6799b9415158e2f503f532c8b742a6eb6fe664e48860b185cff WatchSource:0}: Error finding container cce1e3165880e6799b9415158e2f503f532c8b742a6eb6fe664e48860b185cff: Status 404 returned error can't find the container with id cce1e3165880e6799b9415158e2f503f532c8b742a6eb6fe664e48860b185cff
Nov 04 02:39:32.830497 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:32.830389    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b" event={"ID":"d4d5a9fc-e958-462f-8028-b9a9213b18a9","Type":"ContainerStarted","Data":"7817fcced66b76a05ba7da55dab7c95e03b75d989b8cb9bd3fe575f67e3c299e"}
Nov 04 02:39:32.830497 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:32.830459    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b" event={"ID":"d4d5a9fc-e958-462f-8028-b9a9213b18a9","Type":"ContainerStarted","Data":"cce1e3165880e6799b9415158e2f503f532c8b742a6eb6fe664e48860b185cff"}
Nov 04 02:39:32.951825 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:32.951752    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b" podStartSLOduration=1.951736533 podStartE2EDuration="1.951736533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:39:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:39:32.947747654 +0000 UTC m=+1406.552760650" watchObservedRunningTime="2026-11-04 02:39:32.951736533 +0000 UTC m=+1406.556749524"
Nov 04 02:39:33.839372 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:33.839329    4548 generic.go:356] "Generic (PLEG): container finished" podID="d4d5a9fc-e958-462f-8028-b9a9213b18a9" containerID="7817fcced66b76a05ba7da55dab7c95e03b75d989b8cb9bd3fe575f67e3c299e" exitCode=0
Nov 04 02:39:33.839845 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:33.839419    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b" event={"ID":"d4d5a9fc-e958-462f-8028-b9a9213b18a9","Type":"ContainerDied","Data":"7817fcced66b76a05ba7da55dab7c95e03b75d989b8cb9bd3fe575f67e3c299e"}
Nov 04 02:39:35.006826 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:35.006790    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b"
Nov 04 02:39:35.096370 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:35.096254    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d4d5a9fc-e958-462f-8028-b9a9213b18a9-kube-api-access-pt5r5\" (UniqueName: \"kubernetes.io/projected/d4d5a9fc-e958-462f-8028-b9a9213b18a9-kube-api-access-pt5r5\") pod \"d4d5a9fc-e958-462f-8028-b9a9213b18a9\" (UID: \"d4d5a9fc-e958-462f-8028-b9a9213b18a9\") "
Nov 04 02:39:35.096557 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:35.096416    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d4d5a9fc-e958-462f-8028-b9a9213b18a9-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4d5a9fc-e958-462f-8028-b9a9213b18a9-maas-api-openshift-ca\") pod \"d4d5a9fc-e958-462f-8028-b9a9213b18a9\" (UID: \"d4d5a9fc-e958-462f-8028-b9a9213b18a9\") "
Nov 04 02:39:35.096557 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:35.096516    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d4d5a9fc-e958-462f-8028-b9a9213b18a9-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4d5a9fc-e958-462f-8028-b9a9213b18a9-maas-api-xks-ca\") pod \"d4d5a9fc-e958-462f-8028-b9a9213b18a9\" (UID: \"d4d5a9fc-e958-462f-8028-b9a9213b18a9\") "
Nov 04 02:39:35.096848 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:35.096819    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4d5a9fc-e958-462f-8028-b9a9213b18a9-maas-api-openshift-ca" pod "d4d5a9fc-e958-462f-8028-b9a9213b18a9" (UID: "d4d5a9fc-e958-462f-8028-b9a9213b18a9"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:35.096995 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:35.096978    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d4d5a9fc-e958-462f-8028-b9a9213b18a9-maas-api-openshift-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:35.098678 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:35.098642    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4d5a9fc-e958-462f-8028-b9a9213b18a9-kube-api-access-pt5r5" pod "d4d5a9fc-e958-462f-8028-b9a9213b18a9" (UID: "d4d5a9fc-e958-462f-8028-b9a9213b18a9"). InnerVolumeSpecName "kube-api-access-pt5r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:35.098767 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:35.098716    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d4d5a9fc-e958-462f-8028-b9a9213b18a9-maas-api-xks-ca" pod "d4d5a9fc-e958-462f-8028-b9a9213b18a9" (UID: "d4d5a9fc-e958-462f-8028-b9a9213b18a9"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:39:35.198367 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:35.198326    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt5r5\" (UniqueName: \"kubernetes.io/projected/d4d5a9fc-e958-462f-8028-b9a9213b18a9-kube-api-access-pt5r5\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:35.198367 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:35.198363    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d4d5a9fc-e958-462f-8028-b9a9213b18a9-maas-api-xks-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:35.854186 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:35.854152    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b"
Nov 04 02:39:35.854386 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:35.854216    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b" event={"ID":"d4d5a9fc-e958-462f-8028-b9a9213b18a9","Type":"ContainerDied","Data":"cce1e3165880e6799b9415158e2f503f532c8b742a6eb6fe664e48860b185cff"}
Nov 04 02:39:35.854386 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:35.854265    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cce1e3165880e6799b9415158e2f503f532c8b742a6eb6fe664e48860b185cff"
Nov 04 02:39:40.613620 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:39:40.613577    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:39:41.713022 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:41.712948    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z" podUID="eda062bb-6f3f-44d9-aea9-2e58c7c22190" containerName="main" containerID="cri-o://d8223ac7138b66616e54c17b8e9f28d89f648e8fdfc2b04fc92a171ee9fa8900" gracePeriod=45
Nov 04 02:39:41.946105 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:41.946068    4548 generic.go:356] "Generic (PLEG): container finished" podID="eda062bb-6f3f-44d9-aea9-2e58c7c22190" containerID="d8223ac7138b66616e54c17b8e9f28d89f648e8fdfc2b04fc92a171ee9fa8900" exitCode=0
Nov 04 02:39:41.946345 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:41.946145    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z" event={"ID":"eda062bb-6f3f-44d9-aea9-2e58c7c22190","Type":"ContainerDied","Data":"d8223ac7138b66616e54c17b8e9f28d89f648e8fdfc2b04fc92a171ee9fa8900"}
Nov 04 02:39:41.992406 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:41.992376    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:39:42.087883 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.087845    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-tmp-dir\") pod \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") "
Nov 04 02:39:42.088416 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.087898    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eda062bb-6f3f-44d9-aea9-2e58c7c22190-kube-api-access-hg46x\" (UniqueName: \"kubernetes.io/projected/eda062bb-6f3f-44d9-aea9-2e58c7c22190-kube-api-access-hg46x\") pod \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") "
Nov 04 02:39:42.088416 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.087929    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eda062bb-6f3f-44d9-aea9-2e58c7c22190-tls-certs\" (UniqueName: \"kubernetes.io/secret/eda062bb-6f3f-44d9-aea9-2e58c7c22190-tls-certs\") pod \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") "
Nov 04 02:39:42.088416 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.088304    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-tmp-dir" pod "eda062bb-6f3f-44d9-aea9-2e58c7c22190" (UID: "eda062bb-6f3f-44d9-aea9-2e58c7c22190"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:42.088416 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.088311    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-home\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-home\") pod \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") "
Nov 04 02:39:42.088674 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.088489    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-home" pod "eda062bb-6f3f-44d9-aea9-2e58c7c22190" (UID: "eda062bb-6f3f-44d9-aea9-2e58c7c22190"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:42.088674 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.088558    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-model-cache\") pod \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") "
Nov 04 02:39:42.090076 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.088673    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-dshm\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-dshm\") pod \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\" (UID: \"eda062bb-6f3f-44d9-aea9-2e58c7c22190\") "
Nov 04 02:39:42.090076 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.089695    4548 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-tmp-dir\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:42.090076 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.089747    4548 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-home\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:42.090311 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.090265    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-model-cache" pod "eda062bb-6f3f-44d9-aea9-2e58c7c22190" (UID: "eda062bb-6f3f-44d9-aea9-2e58c7c22190"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:42.109349 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.100296    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-dshm" pod "eda062bb-6f3f-44d9-aea9-2e58c7c22190" (UID: "eda062bb-6f3f-44d9-aea9-2e58c7c22190"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:42.109837 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.109781    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eda062bb-6f3f-44d9-aea9-2e58c7c22190-kube-api-access-hg46x" pod "eda062bb-6f3f-44d9-aea9-2e58c7c22190" (UID: "eda062bb-6f3f-44d9-aea9-2e58c7c22190"). InnerVolumeSpecName "kube-api-access-hg46x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:42.110155 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.110109    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eda062bb-6f3f-44d9-aea9-2e58c7c22190-tls-certs" pod "eda062bb-6f3f-44d9-aea9-2e58c7c22190" (UID: "eda062bb-6f3f-44d9-aea9-2e58c7c22190"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:39:42.190489 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.190450    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hg46x\" (UniqueName: \"kubernetes.io/projected/eda062bb-6f3f-44d9-aea9-2e58c7c22190-kube-api-access-hg46x\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:42.190489 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.190478    4548 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eda062bb-6f3f-44d9-aea9-2e58c7c22190-tls-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:42.190489 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.190489    4548 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-model-cache\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:42.190489 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.190499    4548 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eda062bb-6f3f-44d9-aea9-2e58c7c22190-dshm\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:42.586804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.586759    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"]
Nov 04 02:39:42.587028 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.586991    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9" podUID="a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" containerName="istio-proxy" containerID="cri-o://9f9c83a6434ad07845e0fb400ac96c976d04ed53859cfb1ea49178885e0cda39" gracePeriod=30
Nov 04 02:39:42.954775 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.954689    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"
Nov 04 02:39:42.954775 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.954712    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z" event={"ID":"eda062bb-6f3f-44d9-aea9-2e58c7c22190","Type":"ContainerDied","Data":"20f8433be646f3fa3b5cd8aa9963a584abb06c3f0be373c8c81350e15254cffd"}
Nov 04 02:39:42.954775 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:42.954768    4548 scope.go:122] "RemoveContainer" containerID="d8223ac7138b66616e54c17b8e9f28d89f648e8fdfc2b04fc92a171ee9fa8900"
Nov 04 02:39:43.121929 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.121892    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"]
Nov 04 02:39:43.126092 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.126059    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-2ba6b8/premium-w0-2ba6b8-kserve-c6d479c85-56k5z"]
Nov 04 02:39:43.792510 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.792472    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt"]
Nov 04 02:39:43.792981 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.792969    4548 cpu_manager.go:414] "containerMap: removing container" podUID="eda062bb-6f3f-44d9-aea9-2e58c7c22190" containerName="main"
Nov 04 02:39:43.793022 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.792983    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eda062bb-6f3f-44d9-aea9-2e58c7c22190" containerName="main"
Nov 04 02:39:43.793022 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.793020    4548 cpu_manager.go:414] "containerMap: removing container" podUID="d4d5a9fc-e958-462f-8028-b9a9213b18a9" containerName="revoke-keys"
Nov 04 02:39:43.793106 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.793025    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d4d5a9fc-e958-462f-8028-b9a9213b18a9" containerName="revoke-keys"
Nov 04 02:39:43.793106 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.793102    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="d4d5a9fc-e958-462f-8028-b9a9213b18a9" containerName="revoke-keys"
Nov 04 02:39:43.793211 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.793114    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="eda062bb-6f3f-44d9-aea9-2e58c7c22190" containerName="main"
Nov 04 02:39:43.796487 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.796455    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt"
Nov 04 02:39:43.809636 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.809604    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ada4b080-27f3-4520-ac57-8dd379d3af97-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9788dfba-x94xt\" (UID: \"ada4b080-27f3-4520-ac57-8dd379d3af97\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt"
Nov 04 02:39:43.809789 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.809652    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ada4b080-27f3-4520-ac57-8dd379d3af97-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9788dfba-x94xt\" (UID: \"ada4b080-27f3-4520-ac57-8dd379d3af97\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt"
Nov 04 02:39:43.809789 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.809722    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxpqm\" (UniqueName: \"kubernetes.io/projected/ada4b080-27f3-4520-ac57-8dd379d3af97-kube-api-access-jxpqm\") pod \"maas-api-revoke-sub-9788dfba-x94xt\" (UID: \"ada4b080-27f3-4520-ac57-8dd379d3af97\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt"
Nov 04 02:39:43.849945 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.849911    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 02:39:43.849945 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.849936    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:39:43.849945 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.849918    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:39:43.850237 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.849911    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:39:43.850479 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.850461    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt"]
Nov 04 02:39:43.910710 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.910671    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ada4b080-27f3-4520-ac57-8dd379d3af97-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9788dfba-x94xt\" (UID: \"ada4b080-27f3-4520-ac57-8dd379d3af97\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt"
Nov 04 02:39:43.910930 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.910724    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ada4b080-27f3-4520-ac57-8dd379d3af97-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9788dfba-x94xt\" (UID: \"ada4b080-27f3-4520-ac57-8dd379d3af97\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt"
Nov 04 02:39:43.910930 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.910896    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxpqm\" (UniqueName: \"kubernetes.io/projected/ada4b080-27f3-4520-ac57-8dd379d3af97-kube-api-access-jxpqm\") pod \"maas-api-revoke-sub-9788dfba-x94xt\" (UID: \"ada4b080-27f3-4520-ac57-8dd379d3af97\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt"
Nov 04 02:39:43.911615 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.911585    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ada4b080-27f3-4520-ac57-8dd379d3af97-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9788dfba-x94xt\" (UID: \"ada4b080-27f3-4520-ac57-8dd379d3af97\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt"
Nov 04 02:39:43.914095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.914065    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ada4b080-27f3-4520-ac57-8dd379d3af97-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9788dfba-x94xt\" (UID: \"ada4b080-27f3-4520-ac57-8dd379d3af97\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt"
Nov 04 02:39:43.972946 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:43.972909    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxpqm\" (UniqueName: \"kubernetes.io/projected/ada4b080-27f3-4520-ac57-8dd379d3af97-kube-api-access-jxpqm\") pod \"maas-api-revoke-sub-9788dfba-x94xt\" (UID: \"ada4b080-27f3-4520-ac57-8dd379d3af97\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt"
Nov 04 02:39:44.111753 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:44.111659    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt"
Nov 04 02:39:44.503442 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:44.498774    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt"]
Nov 04 02:39:44.503901 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:39:44.503864    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podada4b080_27f3_4520_ac57_8dd379d3af97.slice/crio-8fed8653b3da85f281947fd5fe101d4e219fe95cb3b1b0283ac505b3de5c7c31 WatchSource:0}: Error finding container 8fed8653b3da85f281947fd5fe101d4e219fe95cb3b1b0283ac505b3de5c7c31: Status 404 returned error can't find the container with id 8fed8653b3da85f281947fd5fe101d4e219fe95cb3b1b0283ac505b3de5c7c31
Nov 04 02:39:44.526576 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:44.526551    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="eda062bb-6f3f-44d9-aea9-2e58c7c22190" path="/var/lib/kubelet/pods/eda062bb-6f3f-44d9-aea9-2e58c7c22190/volumes"
Nov 04 02:39:44.973839 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:44.973798    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt" event={"ID":"ada4b080-27f3-4520-ac57-8dd379d3af97","Type":"ContainerStarted","Data":"a2a519f36611e8e2b26f057aff336c910c9b11343d9f85126ecf4f05f2112c7f"}
Nov 04 02:39:44.974400 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:44.973868    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt" event={"ID":"ada4b080-27f3-4520-ac57-8dd379d3af97","Type":"ContainerStarted","Data":"8fed8653b3da85f281947fd5fe101d4e219fe95cb3b1b0283ac505b3de5c7c31"}
Nov 04 02:39:45.059197 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:45.059106    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7"]
Nov 04 02:39:45.059518 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:45.059496    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b9ae9dd1-kv5w7"]
Nov 04 02:39:45.094065 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:45.093987    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt" podStartSLOduration=2.093961938 podStartE2EDuration="2.093961938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:39:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:39:45.089213376 +0000 UTC m=+1418.694226365" watchObservedRunningTime="2026-11-04 02:39:45.093961938 +0000 UTC m=+1418.698974936"
Nov 04 02:39:45.985483 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:45.985433    4548 generic.go:356] "Generic (PLEG): container finished" podID="ada4b080-27f3-4520-ac57-8dd379d3af97" containerID="a2a519f36611e8e2b26f057aff336c910c9b11343d9f85126ecf4f05f2112c7f" exitCode=0
Nov 04 02:39:45.985919 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:45.985509    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt" event={"ID":"ada4b080-27f3-4520-ac57-8dd379d3af97","Type":"ContainerDied","Data":"a2a519f36611e8e2b26f057aff336c910c9b11343d9f85126ecf4f05f2112c7f"}
Nov 04 02:39:46.527989 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:46.527941    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8ac59d70-ef3e-47cc-b78d-ca2cda1e6900" path="/var/lib/kubelet/pods/8ac59d70-ef3e-47cc-b78d-ca2cda1e6900/volumes"
Nov 04 02:39:47.229258 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.229224    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt"
Nov 04 02:39:47.263469 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.263421    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ada4b080-27f3-4520-ac57-8dd379d3af97-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ada4b080-27f3-4520-ac57-8dd379d3af97-maas-api-openshift-ca\") pod \"ada4b080-27f3-4520-ac57-8dd379d3af97\" (UID: \"ada4b080-27f3-4520-ac57-8dd379d3af97\") "
Nov 04 02:39:47.263659 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.263633    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ada4b080-27f3-4520-ac57-8dd379d3af97-kube-api-access-jxpqm\" (UniqueName: \"kubernetes.io/projected/ada4b080-27f3-4520-ac57-8dd379d3af97-kube-api-access-jxpqm\") pod \"ada4b080-27f3-4520-ac57-8dd379d3af97\" (UID: \"ada4b080-27f3-4520-ac57-8dd379d3af97\") "
Nov 04 02:39:47.263745 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.263710    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ada4b080-27f3-4520-ac57-8dd379d3af97-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ada4b080-27f3-4520-ac57-8dd379d3af97-maas-api-xks-ca\") pod \"ada4b080-27f3-4520-ac57-8dd379d3af97\" (UID: \"ada4b080-27f3-4520-ac57-8dd379d3af97\") "
Nov 04 02:39:47.263837 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.263808    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ada4b080-27f3-4520-ac57-8dd379d3af97-maas-api-openshift-ca" pod "ada4b080-27f3-4520-ac57-8dd379d3af97" (UID: "ada4b080-27f3-4520-ac57-8dd379d3af97"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:47.264310 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.264275    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/ada4b080-27f3-4520-ac57-8dd379d3af97-maas-api-openshift-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:47.266251 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.266208    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ada4b080-27f3-4520-ac57-8dd379d3af97-kube-api-access-jxpqm" pod "ada4b080-27f3-4520-ac57-8dd379d3af97" (UID: "ada4b080-27f3-4520-ac57-8dd379d3af97"). InnerVolumeSpecName "kube-api-access-jxpqm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:47.266375 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.266282    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ada4b080-27f3-4520-ac57-8dd379d3af97-maas-api-xks-ca" pod "ada4b080-27f3-4520-ac57-8dd379d3af97" (UID: "ada4b080-27f3-4520-ac57-8dd379d3af97"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:39:47.365742 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.365696    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxpqm\" (UniqueName: \"kubernetes.io/projected/ada4b080-27f3-4520-ac57-8dd379d3af97-kube-api-access-jxpqm\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:47.365742 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.365742    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/ada4b080-27f3-4520-ac57-8dd379d3af97-maas-api-xks-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:47.873644 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.873569    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:39:47.973260 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.973209    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-workload-socket\") pod \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") "
Nov 04 02:39:47.973489 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.973275    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-token\" (UniqueName: \"kubernetes.io/projected/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-token\") pod \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") "
Nov 04 02:39:47.973489 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.973299    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-envoy\") pod \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") "
Nov 04 02:39:47.973489 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.973318    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-credential-socket\") pod \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") "
Nov 04 02:39:47.973489 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.973341    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-kube-api-access-fw22w\" (UniqueName: \"kubernetes.io/projected/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-kube-api-access-fw22w\") pod \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") "
Nov 04 02:39:47.973489 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.973445    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-workload-certs\") pod \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") "
Nov 04 02:39:47.973489 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.973481    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-podinfo\") pod \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") "
Nov 04 02:39:47.973815 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.973620    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istiod-ca-cert\") pod \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") "
Nov 04 02:39:47.973815 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.973617    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-workload-socket" pod "a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" (UID: "a5f00213-c2d0-4e55-ac63-8d35d6a33a9c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:47.973815 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.973693    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-data\") pod \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\" (UID: \"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c\") "
Nov 04 02:39:47.973969 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.973813    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-workload-certs" pod "a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" (UID: "a5f00213-c2d0-4e55-ac63-8d35d6a33a9c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:47.973969 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.973922    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-credential-socket" pod "a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" (UID: "a5f00213-c2d0-4e55-ac63-8d35d6a33a9c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:47.974141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.974120    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istiod-ca-cert" pod "a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" (UID: "a5f00213-c2d0-4e55-ac63-8d35d6a33a9c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:47.974141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.974127    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-data" pod "a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" (UID: "a5f00213-c2d0-4e55-ac63-8d35d6a33a9c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:47.974326 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.974233    4548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istiod-ca-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:47.974326 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.974246    4548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-data\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:47.974326 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.974256    4548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-workload-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:47.974326 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.974265    4548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-credential-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:47.974326 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.974277    4548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-workload-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:47.976126 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.976100    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-token" pod "a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" (UID: "a5f00213-c2d0-4e55-ac63-8d35d6a33a9c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:47.976441 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.976420    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-envoy" pod "a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" (UID: "a5f00213-c2d0-4e55-ac63-8d35d6a33a9c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:39:47.976523 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.976433    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-podinfo" pod "a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" (UID: "a5f00213-c2d0-4e55-ac63-8d35d6a33a9c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:39:47.976523 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:47.976491    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-kube-api-access-fw22w" pod "a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" (UID: "a5f00213-c2d0-4e55-ac63-8d35d6a33a9c"). InnerVolumeSpecName "kube-api-access-fw22w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:48.013508 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.013475    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt"
Nov 04 02:39:48.013714 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.013473    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt" event={"ID":"ada4b080-27f3-4520-ac57-8dd379d3af97","Type":"ContainerDied","Data":"8fed8653b3da85f281947fd5fe101d4e219fe95cb3b1b0283ac505b3de5c7c31"}
Nov 04 02:39:48.013714 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.013607    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8fed8653b3da85f281947fd5fe101d4e219fe95cb3b1b0283ac505b3de5c7c31"
Nov 04 02:39:48.015451 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.015415    4548 generic.go:356] "Generic (PLEG): container finished" podID="a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" containerID="9f9c83a6434ad07845e0fb400ac96c976d04ed53859cfb1ea49178885e0cda39" exitCode=0
Nov 04 02:39:48.015660 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.015530    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"
Nov 04 02:39:48.015660 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.015554    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9" event={"ID":"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c","Type":"ContainerDied","Data":"9f9c83a6434ad07845e0fb400ac96c976d04ed53859cfb1ea49178885e0cda39"}
Nov 04 02:39:48.015660 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.015607    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9" event={"ID":"a5f00213-c2d0-4e55-ac63-8d35d6a33a9c","Type":"ContainerDied","Data":"4ba7582dfcb9f59c00fa53d094911b1ede6cb58827e4725a5e8f785add543ab5"}
Nov 04 02:39:48.015660 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.015630    4548 scope.go:122] "RemoveContainer" containerID="9f9c83a6434ad07845e0fb400ac96c976d04ed53859cfb1ea49178885e0cda39"
Nov 04 02:39:48.027078 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.027050    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"]
Nov 04 02:39:48.029396 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.029304    4548 scope.go:122] "RemoveContainer" containerID="8723899f124bacc79d04ea3509734cc06351a30646bdc11c8953e89959f6c23b"
Nov 04 02:39:48.034711 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.034678    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"]
Nov 04 02:39:48.043836 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.043809    4548 scope.go:122] "RemoveContainer" containerID="9f9c83a6434ad07845e0fb400ac96c976d04ed53859cfb1ea49178885e0cda39"
Nov 04 02:39:48.044306 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:39:48.044275    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f9c83a6434ad07845e0fb400ac96c976d04ed53859cfb1ea49178885e0cda39\": container with ID starting with 9f9c83a6434ad07845e0fb400ac96c976d04ed53859cfb1ea49178885e0cda39 not found: ID does not exist" containerID="9f9c83a6434ad07845e0fb400ac96c976d04ed53859cfb1ea49178885e0cda39"
Nov 04 02:39:48.044845 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.044315    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f9c83a6434ad07845e0fb400ac96c976d04ed53859cfb1ea49178885e0cda39"} err="failed to get container status \"9f9c83a6434ad07845e0fb400ac96c976d04ed53859cfb1ea49178885e0cda39\": rpc error: code = NotFound desc = could not find container \"9f9c83a6434ad07845e0fb400ac96c976d04ed53859cfb1ea49178885e0cda39\": container with ID starting with 9f9c83a6434ad07845e0fb400ac96c976d04ed53859cfb1ea49178885e0cda39 not found: ID does not exist"
Nov 04 02:39:48.044845 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.044339    4548 scope.go:122] "RemoveContainer" containerID="8723899f124bacc79d04ea3509734cc06351a30646bdc11c8953e89959f6c23b"
Nov 04 02:39:48.044845 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:39:48.044672    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8723899f124bacc79d04ea3509734cc06351a30646bdc11c8953e89959f6c23b\": container with ID starting with 8723899f124bacc79d04ea3509734cc06351a30646bdc11c8953e89959f6c23b not found: ID does not exist" containerID="8723899f124bacc79d04ea3509734cc06351a30646bdc11c8953e89959f6c23b"
Nov 04 02:39:48.044845 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.044703    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8723899f124bacc79d04ea3509734cc06351a30646bdc11c8953e89959f6c23b"} err="failed to get container status \"8723899f124bacc79d04ea3509734cc06351a30646bdc11c8953e89959f6c23b\": rpc error: code = NotFound desc = could not find container \"8723899f124bacc79d04ea3509734cc06351a30646bdc11c8953e89959f6c23b\": container with ID starting with 8723899f124bacc79d04ea3509734cc06351a30646bdc11c8953e89959f6c23b not found: ID does not exist"
Nov 04 02:39:48.075514 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.075482    4548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-token\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:48.075514 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.075513    4548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-envoy\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:48.075514 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.075530    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fw22w\" (UniqueName: \"kubernetes.io/projected/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-kube-api-access-fw22w\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:48.075837 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.075545    4548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c-istio-podinfo\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:48.307020 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.306981    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"]
Nov 04 02:39:48.311812 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.311779    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-b-d501fd-openshift-default-7946556545-2kpf9"]
Nov 04 02:39:48.525755 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.525725    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" path="/var/lib/kubelet/pods/a5f00213-c2d0-4e55-ac63-8d35d6a33a9c/volumes"
Nov 04 02:39:48.686582 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.686537    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c"]
Nov 04 02:39:48.687337 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.687313    4548 cpu_manager.go:414] "containerMap: removing container" podUID="ada4b080-27f3-4520-ac57-8dd379d3af97" containerName="revoke-keys"
Nov 04 02:39:48.687381 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.687340    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ada4b080-27f3-4520-ac57-8dd379d3af97" containerName="revoke-keys"
Nov 04 02:39:48.687381 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.687357    4548 cpu_manager.go:414] "containerMap: removing container" podUID="a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" containerName="istio-proxy"
Nov 04 02:39:48.687381 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.687365    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" containerName="istio-proxy"
Nov 04 02:39:48.687479 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.687391    4548 cpu_manager.go:414] "containerMap: removing container" podUID="a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" containerName="istio-proxy"
Nov 04 02:39:48.687479 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.687399    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" containerName="istio-proxy"
Nov 04 02:39:48.687542 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.687533    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" containerName="istio-proxy"
Nov 04 02:39:48.687575 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.687552    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="ada4b080-27f3-4520-ac57-8dd379d3af97" containerName="revoke-keys"
Nov 04 02:39:48.691300 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.691267    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c"
Nov 04 02:39:48.743989 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.743954    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:39:48.744252 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.744002    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 02:39:48.744252 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.744088    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c"]
Nov 04 02:39:48.747147 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.747047    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:39:48.747147 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.747077    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:39:48.784201 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.784037    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpdhx\" (UniqueName: \"kubernetes.io/projected/4fed28ec-42fa-4ef4-b663-34aff2fea909-kube-api-access-zpdhx\") pod \"maas-api-revoke-sub-2747a4ad-vsv5c\" (UID: \"4fed28ec-42fa-4ef4-b663-34aff2fea909\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c"
Nov 04 02:39:48.784581 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.784538    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4fed28ec-42fa-4ef4-b663-34aff2fea909-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2747a4ad-vsv5c\" (UID: \"4fed28ec-42fa-4ef4-b663-34aff2fea909\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c"
Nov 04 02:39:48.784720 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.784621    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4fed28ec-42fa-4ef4-b663-34aff2fea909-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2747a4ad-vsv5c\" (UID: \"4fed28ec-42fa-4ef4-b663-34aff2fea909\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c"
Nov 04 02:39:48.885624 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.885580    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpdhx\" (UniqueName: \"kubernetes.io/projected/4fed28ec-42fa-4ef4-b663-34aff2fea909-kube-api-access-zpdhx\") pod \"maas-api-revoke-sub-2747a4ad-vsv5c\" (UID: \"4fed28ec-42fa-4ef4-b663-34aff2fea909\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c"
Nov 04 02:39:48.885845 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.885641    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4fed28ec-42fa-4ef4-b663-34aff2fea909-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2747a4ad-vsv5c\" (UID: \"4fed28ec-42fa-4ef4-b663-34aff2fea909\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c"
Nov 04 02:39:48.885845 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.885678    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4fed28ec-42fa-4ef4-b663-34aff2fea909-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2747a4ad-vsv5c\" (UID: \"4fed28ec-42fa-4ef4-b663-34aff2fea909\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c"
Nov 04 02:39:48.886437 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.886416    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4fed28ec-42fa-4ef4-b663-34aff2fea909-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-2747a4ad-vsv5c\" (UID: \"4fed28ec-42fa-4ef4-b663-34aff2fea909\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c"
Nov 04 02:39:48.888496 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.888466    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4fed28ec-42fa-4ef4-b663-34aff2fea909-maas-api-xks-ca\") pod \"maas-api-revoke-sub-2747a4ad-vsv5c\" (UID: \"4fed28ec-42fa-4ef4-b663-34aff2fea909\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c"
Nov 04 02:39:48.947352 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:48.947320    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpdhx\" (UniqueName: \"kubernetes.io/projected/4fed28ec-42fa-4ef4-b663-34aff2fea909-kube-api-access-zpdhx\") pod \"maas-api-revoke-sub-2747a4ad-vsv5c\" (UID: \"4fed28ec-42fa-4ef4-b663-34aff2fea909\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c"
Nov 04 02:39:49.005734 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:49.005684    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c"
Nov 04 02:39:49.393676 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:49.393638    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c"]
Nov 04 02:39:49.394977 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:39:49.394949    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fed28ec_42fa_4ef4_b663_34aff2fea909.slice/crio-35343b4aa5afb6bc760a9f1f48982b5608880fe1ed3bbc6d6203356216d04a64 WatchSource:0}: Error finding container 35343b4aa5afb6bc760a9f1f48982b5608880fe1ed3bbc6d6203356216d04a64: Status 404 returned error can't find the container with id 35343b4aa5afb6bc760a9f1f48982b5608880fe1ed3bbc6d6203356216d04a64
Nov 04 02:39:50.036492 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:50.036445    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c" event={"ID":"4fed28ec-42fa-4ef4-b663-34aff2fea909","Type":"ContainerStarted","Data":"ebaa2b4ad1d19c30d94965fe2949a075e74be81155281bdf19bc689baa95036c"}
Nov 04 02:39:50.037064 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:50.036522    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c" event={"ID":"4fed28ec-42fa-4ef4-b663-34aff2fea909","Type":"ContainerStarted","Data":"35343b4aa5afb6bc760a9f1f48982b5608880fe1ed3bbc6d6203356216d04a64"}
Nov 04 02:39:50.153841 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:50.153785    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c" podStartSLOduration=2.153770158 podStartE2EDuration="2.153770158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:39:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:39:50.151978402 +0000 UTC m=+1423.756991415" watchObservedRunningTime="2026-11-04 02:39:50.153770158 +0000 UTC m=+1423.758783201"
Nov 04 02:39:51.045380 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:51.045333    4548 generic.go:356] "Generic (PLEG): container finished" podID="4fed28ec-42fa-4ef4-b663-34aff2fea909" containerID="ebaa2b4ad1d19c30d94965fe2949a075e74be81155281bdf19bc689baa95036c" exitCode=0
Nov 04 02:39:51.045820 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:51.045418    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c" event={"ID":"4fed28ec-42fa-4ef4-b663-34aff2fea909","Type":"ContainerDied","Data":"ebaa2b4ad1d19c30d94965fe2949a075e74be81155281bdf19bc689baa95036c"}
Nov 04 02:39:52.211379 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:52.211346    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c"
Nov 04 02:39:52.323061 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:52.322963    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/4fed28ec-42fa-4ef4-b663-34aff2fea909-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4fed28ec-42fa-4ef4-b663-34aff2fea909-maas-api-openshift-ca\") pod \"4fed28ec-42fa-4ef4-b663-34aff2fea909\" (UID: \"4fed28ec-42fa-4ef4-b663-34aff2fea909\") "
Nov 04 02:39:52.323061 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:52.323042    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/4fed28ec-42fa-4ef4-b663-34aff2fea909-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4fed28ec-42fa-4ef4-b663-34aff2fea909-maas-api-xks-ca\") pod \"4fed28ec-42fa-4ef4-b663-34aff2fea909\" (UID: \"4fed28ec-42fa-4ef4-b663-34aff2fea909\") "
Nov 04 02:39:52.323328 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:52.323091    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/4fed28ec-42fa-4ef4-b663-34aff2fea909-kube-api-access-zpdhx\" (UniqueName: \"kubernetes.io/projected/4fed28ec-42fa-4ef4-b663-34aff2fea909-kube-api-access-zpdhx\") pod \"4fed28ec-42fa-4ef4-b663-34aff2fea909\" (UID: \"4fed28ec-42fa-4ef4-b663-34aff2fea909\") "
Nov 04 02:39:52.323483 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:52.323455    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fed28ec-42fa-4ef4-b663-34aff2fea909-maas-api-openshift-ca" pod "4fed28ec-42fa-4ef4-b663-34aff2fea909" (UID: "4fed28ec-42fa-4ef4-b663-34aff2fea909"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:39:52.326204 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:52.325680    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fed28ec-42fa-4ef4-b663-34aff2fea909-maas-api-xks-ca" pod "4fed28ec-42fa-4ef4-b663-34aff2fea909" (UID: "4fed28ec-42fa-4ef4-b663-34aff2fea909"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:39:52.326204 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:52.325911    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fed28ec-42fa-4ef4-b663-34aff2fea909-kube-api-access-zpdhx" pod "4fed28ec-42fa-4ef4-b663-34aff2fea909" (UID: "4fed28ec-42fa-4ef4-b663-34aff2fea909"). InnerVolumeSpecName "kube-api-access-zpdhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:39:52.424948 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:52.424907    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/4fed28ec-42fa-4ef4-b663-34aff2fea909-maas-api-openshift-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:52.424948 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:52.424941    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/4fed28ec-42fa-4ef4-b663-34aff2fea909-maas-api-xks-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:52.424948 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:52.424951    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpdhx\" (UniqueName: \"kubernetes.io/projected/4fed28ec-42fa-4ef4-b663-34aff2fea909-kube-api-access-zpdhx\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:39:52.991133 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:52.991095    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"]
Nov 04 02:39:53.060616 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:53.060586    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c"
Nov 04 02:39:53.060791 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:53.060628    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c" event={"ID":"4fed28ec-42fa-4ef4-b663-34aff2fea909","Type":"ContainerDied","Data":"35343b4aa5afb6bc760a9f1f48982b5608880fe1ed3bbc6d6203356216d04a64"}
Nov 04 02:39:53.060791 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:39:53.060688    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35343b4aa5afb6bc760a9f1f48982b5608880fe1ed3bbc6d6203356216d04a64"
Nov 04 02:40:00.672010 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.671972    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2"]
Nov 04 02:40:00.672577 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.672562    4548 cpu_manager.go:414] "containerMap: removing container" podUID="4fed28ec-42fa-4ef4-b663-34aff2fea909" containerName="revoke-keys"
Nov 04 02:40:00.672622 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.672579    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="4fed28ec-42fa-4ef4-b663-34aff2fea909" containerName="revoke-keys"
Nov 04 02:40:00.672683 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.672673    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="a5f00213-c2d0-4e55-ac63-8d35d6a33a9c" containerName="istio-proxy"
Nov 04 02:40:00.672718 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.672686    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="4fed28ec-42fa-4ef4-b663-34aff2fea909" containerName="revoke-keys"
Nov 04 02:40:00.676352 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.676329    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2"
Nov 04 02:40:00.730291 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.730253    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2"]
Nov 04 02:40:00.776312 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.776267    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 02:40:00.776312 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.776315    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:40:00.776536 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.776315    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:40:00.778793 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.778774    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:40:00.828146 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.828099    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t5vvj\" (UniqueName: \"kubernetes.io/projected/d276ead2-d5ad-445a-b0f1-61390b3c6afd-kube-api-access-t5vvj\") pod \"maas-api-revoke-sub-9859d220-x6zz2\" (UID: \"d276ead2-d5ad-445a-b0f1-61390b3c6afd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2"
Nov 04 02:40:00.828355 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.828304    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d276ead2-d5ad-445a-b0f1-61390b3c6afd-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9859d220-x6zz2\" (UID: \"d276ead2-d5ad-445a-b0f1-61390b3c6afd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2"
Nov 04 02:40:00.828444 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.828429    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d276ead2-d5ad-445a-b0f1-61390b3c6afd-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9859d220-x6zz2\" (UID: \"d276ead2-d5ad-445a-b0f1-61390b3c6afd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2"
Nov 04 02:40:00.930005 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.929905    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d276ead2-d5ad-445a-b0f1-61390b3c6afd-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9859d220-x6zz2\" (UID: \"d276ead2-d5ad-445a-b0f1-61390b3c6afd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2"
Nov 04 02:40:00.930226 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.930009    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d276ead2-d5ad-445a-b0f1-61390b3c6afd-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9859d220-x6zz2\" (UID: \"d276ead2-d5ad-445a-b0f1-61390b3c6afd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2"
Nov 04 02:40:00.930226 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.930030    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t5vvj\" (UniqueName: \"kubernetes.io/projected/d276ead2-d5ad-445a-b0f1-61390b3c6afd-kube-api-access-t5vvj\") pod \"maas-api-revoke-sub-9859d220-x6zz2\" (UID: \"d276ead2-d5ad-445a-b0f1-61390b3c6afd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2"
Nov 04 02:40:00.930663 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.930639    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d276ead2-d5ad-445a-b0f1-61390b3c6afd-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-9859d220-x6zz2\" (UID: \"d276ead2-d5ad-445a-b0f1-61390b3c6afd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2"
Nov 04 02:40:00.932674 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.932650    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d276ead2-d5ad-445a-b0f1-61390b3c6afd-maas-api-xks-ca\") pod \"maas-api-revoke-sub-9859d220-x6zz2\" (UID: \"d276ead2-d5ad-445a-b0f1-61390b3c6afd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2"
Nov 04 02:40:00.991425 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:00.991395    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t5vvj\" (UniqueName: \"kubernetes.io/projected/d276ead2-d5ad-445a-b0f1-61390b3c6afd-kube-api-access-t5vvj\") pod \"maas-api-revoke-sub-9859d220-x6zz2\" (UID: \"d276ead2-d5ad-445a-b0f1-61390b3c6afd\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2"
Nov 04 02:40:01.290639 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:01.290607    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2"
Nov 04 02:40:01.675884 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:01.675851    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2"]
Nov 04 02:40:01.676563 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:40:01.676531    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd276ead2_d5ad_445a_b0f1_61390b3c6afd.slice/crio-c4839f870d74c755c684e72537b556673d059a92d4741b17fc77844cc07f6788 WatchSource:0}: Error finding container c4839f870d74c755c684e72537b556673d059a92d4741b17fc77844cc07f6788: Status 404 returned error can't find the container with id c4839f870d74c755c684e72537b556673d059a92d4741b17fc77844cc07f6788
Nov 04 02:40:02.055388 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:02.055347    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5"]
Nov 04 02:40:02.079303 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:02.079266    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-cf9c3306-64kh5"]
Nov 04 02:40:02.176260 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:02.175266    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2" event={"ID":"d276ead2-d5ad-445a-b0f1-61390b3c6afd","Type":"ContainerStarted","Data":"8dbf462cd7a8517919a271e2aa8761101a75437c0bad7e8da6da99fe58305610"}
Nov 04 02:40:02.176260 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:02.175420    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2" event={"ID":"d276ead2-d5ad-445a-b0f1-61390b3c6afd","Type":"ContainerStarted","Data":"c4839f870d74c755c684e72537b556673d059a92d4741b17fc77844cc07f6788"}
Nov 04 02:40:02.299007 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:02.298923    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2" podStartSLOduration=2.298897967 podStartE2EDuration="2.298897967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:40:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:40:02.293145071 +0000 UTC m=+1435.898158072" watchObservedRunningTime="2026-11-04 02:40:02.298897967 +0000 UTC m=+1435.903910966"
Nov 04 02:40:02.524854 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:02.524820    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="07899954-050f-4a17-8a6c-1f92ffee92b5" path="/var/lib/kubelet/pods/07899954-050f-4a17-8a6c-1f92ffee92b5/volumes"
Nov 04 02:40:03.052809 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.052751    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s" podUID="45e794f5-9772-4b3f-93e9-a968d32239cd" containerName="main" containerID="cri-o://1d62733c24748155f043b8e1716e83f041f4ea83c08969ce41212f5c11304af9" gracePeriod=45
Nov 04 02:40:03.057320 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.057282    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8" podUID="e37c21b6-3bb6-441e-a559-012803d6ac6c" containerName="main" containerID="cri-o://895ee3c12131633d7cd7a7746e4dd9560b14b0d5fa64d8d0da6e6af3ca04a573" gracePeriod=45
Nov 04 02:40:03.237374 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.235089    4548 generic.go:356] "Generic (PLEG): container finished" podID="d276ead2-d5ad-445a-b0f1-61390b3c6afd" containerID="8dbf462cd7a8517919a271e2aa8761101a75437c0bad7e8da6da99fe58305610" exitCode=0
Nov 04 02:40:03.237374 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.235196    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2" event={"ID":"d276ead2-d5ad-445a-b0f1-61390b3c6afd","Type":"ContainerDied","Data":"8dbf462cd7a8517919a271e2aa8761101a75437c0bad7e8da6da99fe58305610"}
Nov 04 02:40:03.511197 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.508576    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:40:03.521198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.518574    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-dshm\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-dshm\") pod \"45e794f5-9772-4b3f-93e9-a968d32239cd\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") "
Nov 04 02:40:03.521198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.518741    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-model-cache\") pod \"45e794f5-9772-4b3f-93e9-a968d32239cd\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") "
Nov 04 02:40:03.521198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.518824    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-home\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-home\") pod \"45e794f5-9772-4b3f-93e9-a968d32239cd\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") "
Nov 04 02:40:03.521198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.518855    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/45e794f5-9772-4b3f-93e9-a968d32239cd-tls-certs\" (UniqueName: \"kubernetes.io/secret/45e794f5-9772-4b3f-93e9-a968d32239cd-tls-certs\") pod \"45e794f5-9772-4b3f-93e9-a968d32239cd\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") "
Nov 04 02:40:03.521198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.518929    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/45e794f5-9772-4b3f-93e9-a968d32239cd-kube-api-access-j88v7\" (UniqueName: \"kubernetes.io/projected/45e794f5-9772-4b3f-93e9-a968d32239cd-kube-api-access-j88v7\") pod \"45e794f5-9772-4b3f-93e9-a968d32239cd\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") "
Nov 04 02:40:03.521198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.518986    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-tmp-dir\") pod \"45e794f5-9772-4b3f-93e9-a968d32239cd\" (UID: \"45e794f5-9772-4b3f-93e9-a968d32239cd\") "
Nov 04 02:40:03.521198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.520421    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-home" pod "45e794f5-9772-4b3f-93e9-a968d32239cd" (UID: "45e794f5-9772-4b3f-93e9-a968d32239cd"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:03.531731 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.526328    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-model-cache" pod "45e794f5-9772-4b3f-93e9-a968d32239cd" (UID: "45e794f5-9772-4b3f-93e9-a968d32239cd"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:03.538576 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.532954    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/45e794f5-9772-4b3f-93e9-a968d32239cd-tls-certs" pod "45e794f5-9772-4b3f-93e9-a968d32239cd" (UID: "45e794f5-9772-4b3f-93e9-a968d32239cd"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:40:03.538576 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.538521    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/45e794f5-9772-4b3f-93e9-a968d32239cd-kube-api-access-j88v7" pod "45e794f5-9772-4b3f-93e9-a968d32239cd" (UID: "45e794f5-9772-4b3f-93e9-a968d32239cd"). InnerVolumeSpecName "kube-api-access-j88v7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:03.539509 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.539463    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-tmp-dir" pod "45e794f5-9772-4b3f-93e9-a968d32239cd" (UID: "45e794f5-9772-4b3f-93e9-a968d32239cd"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:03.543408 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.542522    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-dshm" pod "45e794f5-9772-4b3f-93e9-a968d32239cd" (UID: "45e794f5-9772-4b3f-93e9-a968d32239cd"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:03.572012 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.571980    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:40:03.619957 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.619920    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e37c21b6-3bb6-441e-a559-012803d6ac6c-kube-api-access-jq5f2\" (UniqueName: \"kubernetes.io/projected/e37c21b6-3bb6-441e-a559-012803d6ac6c-kube-api-access-jq5f2\") pod \"e37c21b6-3bb6-441e-a559-012803d6ac6c\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") "
Nov 04 02:40:03.620221 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.620002    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-tmp-dir\") pod \"e37c21b6-3bb6-441e-a559-012803d6ac6c\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") "
Nov 04 02:40:03.620221 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.620044    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-dshm\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-dshm\") pod \"e37c21b6-3bb6-441e-a559-012803d6ac6c\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") "
Nov 04 02:40:03.620221 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.620076    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e37c21b6-3bb6-441e-a559-012803d6ac6c-tls-certs\" (UniqueName: \"kubernetes.io/secret/e37c21b6-3bb6-441e-a559-012803d6ac6c-tls-certs\") pod \"e37c21b6-3bb6-441e-a559-012803d6ac6c\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") "
Nov 04 02:40:03.620221 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.620143    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-home\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-home\") pod \"e37c21b6-3bb6-441e-a559-012803d6ac6c\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") "
Nov 04 02:40:03.620446 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.620238    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-model-cache\") pod \"e37c21b6-3bb6-441e-a559-012803d6ac6c\" (UID: \"e37c21b6-3bb6-441e-a559-012803d6ac6c\") "
Nov 04 02:40:03.620863 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.620677    4548 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-home\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:03.620863 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.620701    4548 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/45e794f5-9772-4b3f-93e9-a968d32239cd-tls-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:03.620863 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.620715    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j88v7\" (UniqueName: \"kubernetes.io/projected/45e794f5-9772-4b3f-93e9-a968d32239cd-kube-api-access-j88v7\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:03.620863 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.620730    4548 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-tmp-dir\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:03.620863 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.620743    4548 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-dshm\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:03.620863 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.620755    4548 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/45e794f5-9772-4b3f-93e9-a968d32239cd-model-cache\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:03.621419 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.620989    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-model-cache" pod "e37c21b6-3bb6-441e-a559-012803d6ac6c" (UID: "e37c21b6-3bb6-441e-a559-012803d6ac6c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:03.621679 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.621646    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-home" pod "e37c21b6-3bb6-441e-a559-012803d6ac6c" (UID: "e37c21b6-3bb6-441e-a559-012803d6ac6c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:03.621679 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.621662    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-tmp-dir" pod "e37c21b6-3bb6-441e-a559-012803d6ac6c" (UID: "e37c21b6-3bb6-441e-a559-012803d6ac6c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:03.624253 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.624225    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e37c21b6-3bb6-441e-a559-012803d6ac6c-tls-certs" pod "e37c21b6-3bb6-441e-a559-012803d6ac6c" (UID: "e37c21b6-3bb6-441e-a559-012803d6ac6c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:40:03.624415 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.624300    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e37c21b6-3bb6-441e-a559-012803d6ac6c-kube-api-access-jq5f2" pod "e37c21b6-3bb6-441e-a559-012803d6ac6c" (UID: "e37c21b6-3bb6-441e-a559-012803d6ac6c"). InnerVolumeSpecName "kube-api-access-jq5f2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:03.625557 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.624934    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-dshm" pod "e37c21b6-3bb6-441e-a559-012803d6ac6c" (UID: "e37c21b6-3bb6-441e-a559-012803d6ac6c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:03.721725 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.721688    4548 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-model-cache\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:03.721725 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.721721    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq5f2\" (UniqueName: \"kubernetes.io/projected/e37c21b6-3bb6-441e-a559-012803d6ac6c-kube-api-access-jq5f2\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:03.721725 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.721732    4548 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-tmp-dir\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:03.721985 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.721741    4548 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-dshm\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:03.721985 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.721749    4548 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e37c21b6-3bb6-441e-a559-012803d6ac6c-tls-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:03.721985 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:03.721756    4548 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e37c21b6-3bb6-441e-a559-012803d6ac6c-home\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:04.245431 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.245398    4548 generic.go:356] "Generic (PLEG): container finished" podID="45e794f5-9772-4b3f-93e9-a968d32239cd" containerID="1d62733c24748155f043b8e1716e83f041f4ea83c08969ce41212f5c11304af9" exitCode=0
Nov 04 02:40:04.245431 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.245441    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"
Nov 04 02:40:04.246016 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.245487    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s" event={"ID":"45e794f5-9772-4b3f-93e9-a968d32239cd","Type":"ContainerDied","Data":"1d62733c24748155f043b8e1716e83f041f4ea83c08969ce41212f5c11304af9"}
Nov 04 02:40:04.246016 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.245531    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s" event={"ID":"45e794f5-9772-4b3f-93e9-a968d32239cd","Type":"ContainerDied","Data":"289470ab0c67f5192bba05382d66cd5b6b87b989a08b86329c93b1321150bf64"}
Nov 04 02:40:04.246016 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.245554    4548 scope.go:122] "RemoveContainer" containerID="1d62733c24748155f043b8e1716e83f041f4ea83c08969ce41212f5c11304af9"
Nov 04 02:40:04.246958 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.246939    4548 generic.go:356] "Generic (PLEG): container finished" podID="e37c21b6-3bb6-441e-a559-012803d6ac6c" containerID="895ee3c12131633d7cd7a7746e4dd9560b14b0d5fa64d8d0da6e6af3ca04a573" exitCode=0
Nov 04 02:40:04.247039 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.246977    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"
Nov 04 02:40:04.247039 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.247020    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8" event={"ID":"e37c21b6-3bb6-441e-a559-012803d6ac6c","Type":"ContainerDied","Data":"895ee3c12131633d7cd7a7746e4dd9560b14b0d5fa64d8d0da6e6af3ca04a573"}
Nov 04 02:40:04.247125 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.247056    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8" event={"ID":"e37c21b6-3bb6-441e-a559-012803d6ac6c","Type":"ContainerDied","Data":"efe86edf0b61e5998ebc52c34359bbb469b54db83e8081b406df083f27987d9c"}
Nov 04 02:40:04.263364 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.263338    4548 scope.go:122] "RemoveContainer" containerID="1d62733c24748155f043b8e1716e83f041f4ea83c08969ce41212f5c11304af9"
Nov 04 02:40:04.263798 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:04.263773    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d62733c24748155f043b8e1716e83f041f4ea83c08969ce41212f5c11304af9\": container with ID starting with 1d62733c24748155f043b8e1716e83f041f4ea83c08969ce41212f5c11304af9 not found: ID does not exist" containerID="1d62733c24748155f043b8e1716e83f041f4ea83c08969ce41212f5c11304af9"
Nov 04 02:40:04.263867 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.263813    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d62733c24748155f043b8e1716e83f041f4ea83c08969ce41212f5c11304af9"} err="failed to get container status \"1d62733c24748155f043b8e1716e83f041f4ea83c08969ce41212f5c11304af9\": rpc error: code = NotFound desc = could not find container \"1d62733c24748155f043b8e1716e83f041f4ea83c08969ce41212f5c11304af9\": container with ID starting with 1d62733c24748155f043b8e1716e83f041f4ea83c08969ce41212f5c11304af9 not found: ID does not exist"
Nov 04 02:40:04.263867 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.263838    4548 scope.go:122] "RemoveContainer" containerID="895ee3c12131633d7cd7a7746e4dd9560b14b0d5fa64d8d0da6e6af3ca04a573"
Nov 04 02:40:04.275713 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.275690    4548 scope.go:122] "RemoveContainer" containerID="895ee3c12131633d7cd7a7746e4dd9560b14b0d5fa64d8d0da6e6af3ca04a573"
Nov 04 02:40:04.276100 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:04.276070    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"895ee3c12131633d7cd7a7746e4dd9560b14b0d5fa64d8d0da6e6af3ca04a573\": container with ID starting with 895ee3c12131633d7cd7a7746e4dd9560b14b0d5fa64d8d0da6e6af3ca04a573 not found: ID does not exist" containerID="895ee3c12131633d7cd7a7746e4dd9560b14b0d5fa64d8d0da6e6af3ca04a573"
Nov 04 02:40:04.276307 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.276105    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"895ee3c12131633d7cd7a7746e4dd9560b14b0d5fa64d8d0da6e6af3ca04a573"} err="failed to get container status \"895ee3c12131633d7cd7a7746e4dd9560b14b0d5fa64d8d0da6e6af3ca04a573\": rpc error: code = NotFound desc = could not find container \"895ee3c12131633d7cd7a7746e4dd9560b14b0d5fa64d8d0da6e6af3ca04a573\": container with ID starting with 895ee3c12131633d7cd7a7746e4dd9560b14b0d5fa64d8d0da6e6af3ca04a573 not found: ID does not exist"
Nov 04 02:40:04.410437 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.410393    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2"
Nov 04 02:40:04.414625 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.414593    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"]
Nov 04 02:40:04.416633 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.416599    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8" podUID="e37c21b6-3bb6-441e-a559-012803d6ac6c" containerName="main" probeResult="failure" output="Get \"https://10.133.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:40:04.428137 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.428108    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d276ead2-d5ad-445a-b0f1-61390b3c6afd-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d276ead2-d5ad-445a-b0f1-61390b3c6afd-maas-api-openshift-ca\") pod \"d276ead2-d5ad-445a-b0f1-61390b3c6afd\" (UID: \"d276ead2-d5ad-445a-b0f1-61390b3c6afd\") "
Nov 04 02:40:04.428311 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.428164    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/d276ead2-d5ad-445a-b0f1-61390b3c6afd-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d276ead2-d5ad-445a-b0f1-61390b3c6afd-maas-api-xks-ca\") pod \"d276ead2-d5ad-445a-b0f1-61390b3c6afd\" (UID: \"d276ead2-d5ad-445a-b0f1-61390b3c6afd\") "
Nov 04 02:40:04.428311 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.428254    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d276ead2-d5ad-445a-b0f1-61390b3c6afd-kube-api-access-t5vvj\" (UniqueName: \"kubernetes.io/projected/d276ead2-d5ad-445a-b0f1-61390b3c6afd-kube-api-access-t5vvj\") pod \"d276ead2-d5ad-445a-b0f1-61390b3c6afd\" (UID: \"d276ead2-d5ad-445a-b0f1-61390b3c6afd\") "
Nov 04 02:40:04.428573 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.428547    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d276ead2-d5ad-445a-b0f1-61390b3c6afd-maas-api-openshift-ca" pod "d276ead2-d5ad-445a-b0f1-61390b3c6afd" (UID: "d276ead2-d5ad-445a-b0f1-61390b3c6afd"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:04.430535 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.430509    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d276ead2-d5ad-445a-b0f1-61390b3c6afd-maas-api-xks-ca" pod "d276ead2-d5ad-445a-b0f1-61390b3c6afd" (UID: "d276ead2-d5ad-445a-b0f1-61390b3c6afd"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:40:04.430633 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.430612    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d276ead2-d5ad-445a-b0f1-61390b3c6afd-kube-api-access-t5vvj" pod "d276ead2-d5ad-445a-b0f1-61390b3c6afd" (UID: "d276ead2-d5ad-445a-b0f1-61390b3c6afd"). InnerVolumeSpecName "kube-api-access-t5vvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:04.462947 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.462901    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-6c403f/simulator-w3-6c403f-kserve-59556b7fb8-vw5c8"]
Nov 04 02:40:04.529205 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.528550    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e37c21b6-3bb6-441e-a559-012803d6ac6c" path="/var/lib/kubelet/pods/e37c21b6-3bb6-441e-a559-012803d6ac6c/volumes"
Nov 04 02:40:04.532562 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.532525    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"]
Nov 04 02:40:04.533843 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.533815    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/d276ead2-d5ad-445a-b0f1-61390b3c6afd-maas-api-openshift-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:04.534035 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.534018    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/d276ead2-d5ad-445a-b0f1-61390b3c6afd-maas-api-xks-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:04.534131 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.534110    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t5vvj\" (UniqueName: \"kubernetes.io/projected/d276ead2-d5ad-445a-b0f1-61390b3c6afd-kube-api-access-t5vvj\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:04.538670 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:04.538641    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w3-6c403f/premium-w3-6c403f-kserve-7677d7bd4f-zch4s"]
Nov 04 02:40:05.257903 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.257870    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2"
Nov 04 02:40:05.258479 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.257906    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2" event={"ID":"d276ead2-d5ad-445a-b0f1-61390b3c6afd","Type":"ContainerDied","Data":"c4839f870d74c755c684e72537b556673d059a92d4741b17fc77844cc07f6788"}
Nov 04 02:40:05.258479 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.257955    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c4839f870d74c755c684e72537b556673d059a92d4741b17fc77844cc07f6788"
Nov 04 02:40:05.571591 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.571551    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22"]
Nov 04 02:40:05.572037 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.572023    4548 cpu_manager.go:414] "containerMap: removing container" podUID="d276ead2-d5ad-445a-b0f1-61390b3c6afd" containerName="revoke-keys"
Nov 04 02:40:05.572085 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.572038    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d276ead2-d5ad-445a-b0f1-61390b3c6afd" containerName="revoke-keys"
Nov 04 02:40:05.572085 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.572055    4548 cpu_manager.go:414] "containerMap: removing container" podUID="e37c21b6-3bb6-441e-a559-012803d6ac6c" containerName="main"
Nov 04 02:40:05.572085 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.572060    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e37c21b6-3bb6-441e-a559-012803d6ac6c" containerName="main"
Nov 04 02:40:05.572085 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.572081    4548 cpu_manager.go:414] "containerMap: removing container" podUID="45e794f5-9772-4b3f-93e9-a968d32239cd" containerName="main"
Nov 04 02:40:05.572249 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.572086    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="45e794f5-9772-4b3f-93e9-a968d32239cd" containerName="main"
Nov 04 02:40:05.572249 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.572157    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="e37c21b6-3bb6-441e-a559-012803d6ac6c" containerName="main"
Nov 04 02:40:05.572249 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.572186    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="45e794f5-9772-4b3f-93e9-a968d32239cd" containerName="main"
Nov 04 02:40:05.572249 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.572194    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="d276ead2-d5ad-445a-b0f1-61390b3c6afd" containerName="revoke-keys"
Nov 04 02:40:05.575665 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.575641    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22"
Nov 04 02:40:05.630851 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.628538    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 02:40:05.630851 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.628786    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:40:05.632773 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.632741    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22"]
Nov 04 02:40:05.648725 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.648679    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/17c94039-ee51-461e-ac27-94bbb01d9f79-maas-api-xks-ca\") pod \"maas-api-revoke-sub-17f11f27-jcf22\" (UID: \"17c94039-ee51-461e-ac27-94bbb01d9f79\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22"
Nov 04 02:40:05.648927 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.648758    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/17c94039-ee51-461e-ac27-94bbb01d9f79-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-17f11f27-jcf22\" (UID: \"17c94039-ee51-461e-ac27-94bbb01d9f79\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22"
Nov 04 02:40:05.648987 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.648930    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hjwj\" (UniqueName: \"kubernetes.io/projected/17c94039-ee51-461e-ac27-94bbb01d9f79-kube-api-access-6hjwj\") pod \"maas-api-revoke-sub-17f11f27-jcf22\" (UID: \"17c94039-ee51-461e-ac27-94bbb01d9f79\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22"
Nov 04 02:40:05.677094 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.677064    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:40:05.677273 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.677106    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:40:05.750216 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.750146    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/17c94039-ee51-461e-ac27-94bbb01d9f79-maas-api-xks-ca\") pod \"maas-api-revoke-sub-17f11f27-jcf22\" (UID: \"17c94039-ee51-461e-ac27-94bbb01d9f79\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22"
Nov 04 02:40:05.750380 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.750250    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/17c94039-ee51-461e-ac27-94bbb01d9f79-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-17f11f27-jcf22\" (UID: \"17c94039-ee51-461e-ac27-94bbb01d9f79\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22"
Nov 04 02:40:05.750380 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.750301    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hjwj\" (UniqueName: \"kubernetes.io/projected/17c94039-ee51-461e-ac27-94bbb01d9f79-kube-api-access-6hjwj\") pod \"maas-api-revoke-sub-17f11f27-jcf22\" (UID: \"17c94039-ee51-461e-ac27-94bbb01d9f79\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22"
Nov 04 02:40:05.750968 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.750940    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/17c94039-ee51-461e-ac27-94bbb01d9f79-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-17f11f27-jcf22\" (UID: \"17c94039-ee51-461e-ac27-94bbb01d9f79\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22"
Nov 04 02:40:05.752772 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.752743    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/17c94039-ee51-461e-ac27-94bbb01d9f79-maas-api-xks-ca\") pod \"maas-api-revoke-sub-17f11f27-jcf22\" (UID: \"17c94039-ee51-461e-ac27-94bbb01d9f79\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22"
Nov 04 02:40:05.814319 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.814276    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hjwj\" (UniqueName: \"kubernetes.io/projected/17c94039-ee51-461e-ac27-94bbb01d9f79-kube-api-access-6hjwj\") pod \"maas-api-revoke-sub-17f11f27-jcf22\" (UID: \"17c94039-ee51-461e-ac27-94bbb01d9f79\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22"
Nov 04 02:40:05.891078 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:05.890970    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22"
Nov 04 02:40:06.280275 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:06.280243    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22"]
Nov 04 02:40:06.280713 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:40:06.280328    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17c94039_ee51_461e_ac27_94bbb01d9f79.slice/crio-265e4ee1eb9260e089112214aea1a6aa11263a360685fa0e4db7882eef1aea2b WatchSource:0}: Error finding container 265e4ee1eb9260e089112214aea1a6aa11263a360685fa0e4db7882eef1aea2b: Status 404 returned error can't find the container with id 265e4ee1eb9260e089112214aea1a6aa11263a360685fa0e4db7882eef1aea2b
Nov 04 02:40:06.525510 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:06.525434    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="45e794f5-9772-4b3f-93e9-a968d32239cd" path="/var/lib/kubelet/pods/45e794f5-9772-4b3f-93e9-a968d32239cd/volumes"
Nov 04 02:40:07.279753 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:07.279721    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22" event={"ID":"17c94039-ee51-461e-ac27-94bbb01d9f79","Type":"ContainerStarted","Data":"15e798363a516c42f863698490c5892a7698b9df994151a682684acc559eb1c0"}
Nov 04 02:40:07.279940 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:07.279789    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22" event={"ID":"17c94039-ee51-461e-ac27-94bbb01d9f79","Type":"ContainerStarted","Data":"265e4ee1eb9260e089112214aea1a6aa11263a360685fa0e4db7882eef1aea2b"}
Nov 04 02:40:08.017148 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.017097    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667" podUID="c8160852-d3fd-4f93-b7f3-aa0e0f0bd905" containerName="main" containerID="cri-o://a4af5d5aa4a0e6479860931e16774ba538a509ce8945013ad19090e085650778" gracePeriod=45
Nov 04 02:40:08.304194 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.300755    4548 generic.go:356] "Generic (PLEG): container finished" podID="c8160852-d3fd-4f93-b7f3-aa0e0f0bd905" containerID="a4af5d5aa4a0e6479860931e16774ba538a509ce8945013ad19090e085650778" exitCode=0
Nov 04 02:40:08.304194 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.300906    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667" event={"ID":"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905","Type":"ContainerDied","Data":"a4af5d5aa4a0e6479860931e16774ba538a509ce8945013ad19090e085650778"}
Nov 04 02:40:08.304194 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.302733    4548 generic.go:356] "Generic (PLEG): container finished" podID="17c94039-ee51-461e-ac27-94bbb01d9f79" containerID="15e798363a516c42f863698490c5892a7698b9df994151a682684acc559eb1c0" exitCode=0
Nov 04 02:40:08.304194 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.302864    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22" event={"ID":"17c94039-ee51-461e-ac27-94bbb01d9f79","Type":"ContainerDied","Data":"15e798363a516c42f863698490c5892a7698b9df994151a682684acc559eb1c0"}
Nov 04 02:40:08.356199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.356147    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:40:08.409249 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.397773    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-tls-certs\" (UniqueName: \"kubernetes.io/secret/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-tls-certs\") pod \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") "
Nov 04 02:40:08.409249 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.397888    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-dshm\") pod \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") "
Nov 04 02:40:08.409249 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.397923    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-home\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-home\") pod \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") "
Nov 04 02:40:08.409249 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.397955    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-tmp-dir\") pod \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") "
Nov 04 02:40:08.409249 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.398019    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-kube-api-access-k7gpc\" (UniqueName: \"kubernetes.io/projected/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-kube-api-access-k7gpc\") pod \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") "
Nov 04 02:40:08.409249 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.398186    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-model-cache\") pod \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\" (UID: \"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905\") "
Nov 04 02:40:08.409249 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.398981    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-model-cache" pod "c8160852-d3fd-4f93-b7f3-aa0e0f0bd905" (UID: "c8160852-d3fd-4f93-b7f3-aa0e0f0bd905"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:08.409249 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.408285    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-tmp-dir" pod "c8160852-d3fd-4f93-b7f3-aa0e0f0bd905" (UID: "c8160852-d3fd-4f93-b7f3-aa0e0f0bd905"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:08.409249 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.408389    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-home" pod "c8160852-d3fd-4f93-b7f3-aa0e0f0bd905" (UID: "c8160852-d3fd-4f93-b7f3-aa0e0f0bd905"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:08.416796 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.416653    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-dshm" pod "c8160852-d3fd-4f93-b7f3-aa0e0f0bd905" (UID: "c8160852-d3fd-4f93-b7f3-aa0e0f0bd905"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:08.417706 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.417646    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-tls-certs" pod "c8160852-d3fd-4f93-b7f3-aa0e0f0bd905" (UID: "c8160852-d3fd-4f93-b7f3-aa0e0f0bd905"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:40:08.420701 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.420668    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-kube-api-access-k7gpc" pod "c8160852-d3fd-4f93-b7f3-aa0e0f0bd905" (UID: "c8160852-d3fd-4f93-b7f3-aa0e0f0bd905"). InnerVolumeSpecName "kube-api-access-k7gpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:08.502599 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.500281    4548 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-model-cache\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.502599 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.500317    4548 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-tls-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.502599 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.500333    4548 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-dshm\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.502599 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.500351    4548 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-home\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.502599 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.500364    4548 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-tmp-dir\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.502599 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.500377    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7gpc\" (UniqueName: \"kubernetes.io/projected/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905-kube-api-access-k7gpc\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.530761 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.529761    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22"
Nov 04 02:40:08.602969 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.601459    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/17c94039-ee51-461e-ac27-94bbb01d9f79-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/17c94039-ee51-461e-ac27-94bbb01d9f79-maas-api-xks-ca\") pod \"17c94039-ee51-461e-ac27-94bbb01d9f79\" (UID: \"17c94039-ee51-461e-ac27-94bbb01d9f79\") "
Nov 04 02:40:08.602969 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.601578    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/17c94039-ee51-461e-ac27-94bbb01d9f79-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/17c94039-ee51-461e-ac27-94bbb01d9f79-maas-api-openshift-ca\") pod \"17c94039-ee51-461e-ac27-94bbb01d9f79\" (UID: \"17c94039-ee51-461e-ac27-94bbb01d9f79\") "
Nov 04 02:40:08.602969 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.601611    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/17c94039-ee51-461e-ac27-94bbb01d9f79-kube-api-access-6hjwj\" (UniqueName: \"kubernetes.io/projected/17c94039-ee51-461e-ac27-94bbb01d9f79-kube-api-access-6hjwj\") pod \"17c94039-ee51-461e-ac27-94bbb01d9f79\" (UID: \"17c94039-ee51-461e-ac27-94bbb01d9f79\") "
Nov 04 02:40:08.605392 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.605337    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17c94039-ee51-461e-ac27-94bbb01d9f79-maas-api-openshift-ca" pod "17c94039-ee51-461e-ac27-94bbb01d9f79" (UID: "17c94039-ee51-461e-ac27-94bbb01d9f79"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:08.617081 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.616976    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/17c94039-ee51-461e-ac27-94bbb01d9f79-maas-api-xks-ca" pod "17c94039-ee51-461e-ac27-94bbb01d9f79" (UID: "17c94039-ee51-461e-ac27-94bbb01d9f79"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:40:08.617910 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.617870    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17c94039-ee51-461e-ac27-94bbb01d9f79-kube-api-access-6hjwj" pod "17c94039-ee51-461e-ac27-94bbb01d9f79" (UID: "17c94039-ee51-461e-ac27-94bbb01d9f79"). InnerVolumeSpecName "kube-api-access-6hjwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:08.705262 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.705156    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/17c94039-ee51-461e-ac27-94bbb01d9f79-maas-api-xks-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.705262 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.705216    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/17c94039-ee51-461e-ac27-94bbb01d9f79-maas-api-openshift-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:08.705262 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:08.705232    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hjwj\" (UniqueName: \"kubernetes.io/projected/17c94039-ee51-461e-ac27-94bbb01d9f79-kube-api-access-6hjwj\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:09.215053 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:09.214997    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667" podUID="c8160852-d3fd-4f93-b7f3-aa0e0f0bd905" containerName="main" probeResult="failure" output="Get \"https://10.133.0.69:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:40:09.312414 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:09.312323    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"
Nov 04 02:40:09.312414 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:09.312340    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667" event={"ID":"c8160852-d3fd-4f93-b7f3-aa0e0f0bd905","Type":"ContainerDied","Data":"bc13f9dd6e56abc00225a30e39956a5a99b50a3146c19a0ec4dcc703203516f2"}
Nov 04 02:40:09.312414 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:09.312391    4548 scope.go:122] "RemoveContainer" containerID="a4af5d5aa4a0e6479860931e16774ba538a509ce8945013ad19090e085650778"
Nov 04 02:40:09.314251 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:09.314187    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22"
Nov 04 02:40:09.314251 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:09.314240    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22" event={"ID":"17c94039-ee51-461e-ac27-94bbb01d9f79","Type":"ContainerDied","Data":"265e4ee1eb9260e089112214aea1a6aa11263a360685fa0e4db7882eef1aea2b"}
Nov 04 02:40:09.314251 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:09.314287    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="265e4ee1eb9260e089112214aea1a6aa11263a360685fa0e4db7882eef1aea2b"
Nov 04 02:40:09.573390 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:09.573276    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"]
Nov 04 02:40:09.576926 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:09.576890    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-ab53c1/distinct-w4-ab53c1-kserve-74d8965cfd-wm667"]
Nov 04 02:40:10.524414 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:10.524382    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c8160852-d3fd-4f93-b7f3-aa0e0f0bd905" path="/var/lib/kubelet/pods/c8160852-d3fd-4f93-b7f3-aa0e0f0bd905/volumes"
Nov 04 02:40:10.620717 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:10.620677    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:40:13.834355 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:13.834300    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt" podUID="7bea1b32-d4ba-496c-b17d-b0b2d459010f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.66:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:40:13.928261 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:13.924377    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874" podUID="9a38c5ae-db84-40c1-bb28-e7f7e7842b4a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:40:14.014400 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:14.014335    4548 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874" podUID="9a38c5ae-db84-40c1-bb28-e7f7e7842b4a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:40:14.279207 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:14.278807    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z" podUID="8eafd96d-c3bb-494f-9b45-96c2d1d7bc00" containerName="main" probeResult="failure" output="Get \"https://10.133.0.49:8000/ready\": context deadline exceeded"
Nov 04 02:40:14.930326 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:14.930273    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874" podUID="9a38c5ae-db84-40c1-bb28-e7f7e7842b4a" containerName="main" probeResult="failure" output="Get \"https://10.133.0.60:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:40:14.932362 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:14.932333    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:40:15.287732 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:15.269775    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:40:15.784267 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:15.772834    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt" podUID="7bea1b32-d4ba-496c-b17d-b0b2d459010f" containerName="main" probeResult="failure" output="Get \"https://10.133.0.66:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Nov 04 02:40:22.178773 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:22.178734    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"]
Nov 04 02:40:22.179310 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:22.178990    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2" podUID="d7e95e09-f96e-4635-abe4-390c3fb16b6a" containerName="istio-proxy" containerID="cri-o://933aaa5c161baa6f6438081b90acb1fb2d5184bc270e3174bc0d17d2b2d2b174" gracePeriod=30
Nov 04 02:40:22.943320 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:22.943278    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"]
Nov 04 02:40:22.943759 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:22.943743    4548 cpu_manager.go:414] "containerMap: removing container" podUID="c8160852-d3fd-4f93-b7f3-aa0e0f0bd905" containerName="main"
Nov 04 02:40:22.943809 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:22.943763    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c8160852-d3fd-4f93-b7f3-aa0e0f0bd905" containerName="main"
Nov 04 02:40:22.943809 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:22.943800    4548 cpu_manager.go:414] "containerMap: removing container" podUID="17c94039-ee51-461e-ac27-94bbb01d9f79" containerName="revoke-keys"
Nov 04 02:40:22.943809 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:22.943805    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="17c94039-ee51-461e-ac27-94bbb01d9f79" containerName="revoke-keys"
Nov 04 02:40:22.943903 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:22.943880    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="c8160852-d3fd-4f93-b7f3-aa0e0f0bd905" containerName="main"
Nov 04 02:40:22.943903 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:22.943893    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="17c94039-ee51-461e-ac27-94bbb01d9f79" containerName="revoke-keys"
Nov 04 02:40:22.949125 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:22.949098    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.028843 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.028803    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.029021 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.028965    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.029091 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.029055    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.029129 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.029089    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7l64q\" (UniqueName: \"kubernetes.io/projected/07326a7b-ffa7-411e-9400-5af1b770d1e5-kube-api-access-7l64q\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.029270 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.029243    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07326a7b-ffa7-411e-9400-5af1b770d1e5-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.029370 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.029291    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.029370 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.029325    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.029477 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.029376    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.029477 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.029428    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.132824 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.132778    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.133004 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.132841    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.133004 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.132870    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.133004 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.132896    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7l64q\" (UniqueName: \"kubernetes.io/projected/07326a7b-ffa7-411e-9400-5af1b770d1e5-kube-api-access-7l64q\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.133004 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.132942    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07326a7b-ffa7-411e-9400-5af1b770d1e5-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.133004 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.132972    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.133004 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.133004    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.133448 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.133043    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.133448 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.133081    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.133448 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.133419    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-data\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.133448 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.133431    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-workload-certs\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.133652 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.133619    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-credential-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.133722 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.133698    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-workload-socket\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.133949 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.133916    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07326a7b-ffa7-411e-9400-5af1b770d1e5-istiod-ca-cert\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.135916 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.135889    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-podinfo\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.136246 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.136225    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-envoy\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.152610 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.152571    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"]
Nov 04 02:40:23.195135 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.195057    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-token\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.195551 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.195390    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7l64q\" (UniqueName: \"kubernetes.io/projected/07326a7b-ffa7-411e-9400-5af1b770d1e5-kube-api-access-7l64q\") pod \"e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") " pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.263549 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.263509    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:23.701305 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:40:23.701267    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07326a7b_ffa7_411e_9400_5af1b770d1e5.slice/crio-11ebfc540eb62984b53de483ca0652e1fc0501171df618df1c28e26feba16f0f WatchSource:0}: Error finding container 11ebfc540eb62984b53de483ca0652e1fc0501171df618df1c28e26feba16f0f: Status 404 returned error can't find the container with id 11ebfc540eb62984b53de483ca0652e1fc0501171df618df1c28e26feba16f0f
Nov 04 02:40:23.701601 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.701580    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"]
Nov 04 02:40:23.703919 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.703884    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:40:23.704007 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.703954    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:40:23.704007 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:23.703981    4548 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892008Ki","pods":"250"}
Nov 04 02:40:24.617452 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:24.617414    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng" event={"ID":"07326a7b-ffa7-411e-9400-5af1b770d1e5","Type":"ContainerStarted","Data":"07b79fbbbfba6ea19a00ec2bb57ba9d69c8d381886c2785fffcb7b903434c5e7"}
Nov 04 02:40:24.617901 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:24.617473    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng" event={"ID":"07326a7b-ffa7-411e-9400-5af1b770d1e5","Type":"ContainerStarted","Data":"11ebfc540eb62984b53de483ca0652e1fc0501171df618df1c28e26feba16f0f"}
Nov 04 02:40:24.825307 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:24.825253    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng" podStartSLOduration=2.825235862 podStartE2EDuration="2.825235862s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:40:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:40:24.792129624 +0000 UTC m=+1458.397142624" watchObservedRunningTime="2026-11-04 02:40:24.825235862 +0000 UTC m=+1458.430248861"
Nov 04 02:40:25.273645 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:25.265617    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:25.279193 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:25.278351    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Nov 04 02:40:25.279193 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:25.278421    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng" podUID="07326a7b-ffa7-411e-9400-5af1b770d1e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Nov 04 02:40:26.265637 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:26.265596    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Nov 04 02:40:26.266288 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:26.266255    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng" podUID="07326a7b-ffa7-411e-9400-5af1b770d1e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Nov 04 02:40:27.288203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.280075    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Nov 04 02:40:27.288203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.280143    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng" podUID="07326a7b-ffa7-411e-9400-5af1b770d1e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Nov 04 02:40:27.502463 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.502435    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:40:27.633494 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.633454    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-podinfo\") pod \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") "
Nov 04 02:40:27.633699 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.633593    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-token\" (UniqueName: \"kubernetes.io/projected/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-token\") pod \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") "
Nov 04 02:40:27.633699 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.633623    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-data\") pod \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") "
Nov 04 02:40:27.633813 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.633791    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-workload-socket\") pod \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") "
Nov 04 02:40:27.633948 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.633927    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-credential-socket\") pod \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") "
Nov 04 02:40:27.634037 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.633937    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-data" pod "d7e95e09-f96e-4635-abe4-390c3fb16b6a" (UID: "d7e95e09-f96e-4635-abe4-390c3fb16b6a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:27.634037 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.633968    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istiod-ca-cert\") pod \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") "
Nov 04 02:40:27.634037 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.634006    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-envoy\") pod \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") "
Nov 04 02:40:27.634037 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.634033    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d7e95e09-f96e-4635-abe4-390c3fb16b6a-kube-api-access-c869q\" (UniqueName: \"kubernetes.io/projected/d7e95e09-f96e-4635-abe4-390c3fb16b6a-kube-api-access-c869q\") pod \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") "
Nov 04 02:40:27.634238 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.634039    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-workload-socket" pod "d7e95e09-f96e-4635-abe4-390c3fb16b6a" (UID: "d7e95e09-f96e-4635-abe4-390c3fb16b6a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:27.634238 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.634067    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-workload-certs\") pod \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\" (UID: \"d7e95e09-f96e-4635-abe4-390c3fb16b6a\") "
Nov 04 02:40:27.634403 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.634379    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istiod-ca-cert" pod "d7e95e09-f96e-4635-abe4-390c3fb16b6a" (UID: "d7e95e09-f96e-4635-abe4-390c3fb16b6a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:27.634606 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.634560    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-credential-socket" pod "d7e95e09-f96e-4635-abe4-390c3fb16b6a" (UID: "d7e95e09-f96e-4635-abe4-390c3fb16b6a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:27.634606 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.634572    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-workload-certs" pod "d7e95e09-f96e-4635-abe4-390c3fb16b6a" (UID: "d7e95e09-f96e-4635-abe4-390c3fb16b6a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:27.634827 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.634756    4548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-data\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:27.634913 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.634900    4548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-workload-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:27.634957 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.634919    4548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-credential-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:27.634957 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.634935    4548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istiod-ca-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:27.634957 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.634948    4548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-workload-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:27.636479 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.636450    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7e95e09-f96e-4635-abe4-390c3fb16b6a-kube-api-access-c869q" pod "d7e95e09-f96e-4635-abe4-390c3fb16b6a" (UID: "d7e95e09-f96e-4635-abe4-390c3fb16b6a"). InnerVolumeSpecName "kube-api-access-c869q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:27.636728 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.636706    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-podinfo" pod "d7e95e09-f96e-4635-abe4-390c3fb16b6a" (UID: "d7e95e09-f96e-4635-abe4-390c3fb16b6a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:40:27.636860 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.636726    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-envoy" pod "d7e95e09-f96e-4635-abe4-390c3fb16b6a" (UID: "d7e95e09-f96e-4635-abe4-390c3fb16b6a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:27.636999 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.636974    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-token" pod "d7e95e09-f96e-4635-abe4-390c3fb16b6a" (UID: "d7e95e09-f96e-4635-abe4-390c3fb16b6a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:27.642576 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.642543    4548 generic.go:356] "Generic (PLEG): container finished" podID="d7e95e09-f96e-4635-abe4-390c3fb16b6a" containerID="933aaa5c161baa6f6438081b90acb1fb2d5184bc270e3174bc0d17d2b2d2b174" exitCode=0
Nov 04 02:40:27.642717 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.642605    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"
Nov 04 02:40:27.642717 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.642624    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2" event={"ID":"d7e95e09-f96e-4635-abe4-390c3fb16b6a","Type":"ContainerDied","Data":"933aaa5c161baa6f6438081b90acb1fb2d5184bc270e3174bc0d17d2b2d2b174"}
Nov 04 02:40:27.642717 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.642692    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2" event={"ID":"d7e95e09-f96e-4635-abe4-390c3fb16b6a","Type":"ContainerDied","Data":"950a85c6b0472053165ed278449920bb6370e0b52c0083abdac944629e9b8729"}
Nov 04 02:40:27.642891 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.642721    4548 scope.go:122] "RemoveContainer" containerID="933aaa5c161baa6f6438081b90acb1fb2d5184bc270e3174bc0d17d2b2d2b174"
Nov 04 02:40:27.691834 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.691378    4548 scope.go:122] "RemoveContainer" containerID="154ccfe24de71b145b60c2e40759e5a15d405c77a29201d7493a09036702a6a6"
Nov 04 02:40:27.703304 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.703274    4548 scope.go:122] "RemoveContainer" containerID="933aaa5c161baa6f6438081b90acb1fb2d5184bc270e3174bc0d17d2b2d2b174"
Nov 04 02:40:27.703729 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:27.703696    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"933aaa5c161baa6f6438081b90acb1fb2d5184bc270e3174bc0d17d2b2d2b174\": container with ID starting with 933aaa5c161baa6f6438081b90acb1fb2d5184bc270e3174bc0d17d2b2d2b174 not found: ID does not exist" containerID="933aaa5c161baa6f6438081b90acb1fb2d5184bc270e3174bc0d17d2b2d2b174"
Nov 04 02:40:27.703843 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.703745    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"933aaa5c161baa6f6438081b90acb1fb2d5184bc270e3174bc0d17d2b2d2b174"} err="failed to get container status \"933aaa5c161baa6f6438081b90acb1fb2d5184bc270e3174bc0d17d2b2d2b174\": rpc error: code = NotFound desc = could not find container \"933aaa5c161baa6f6438081b90acb1fb2d5184bc270e3174bc0d17d2b2d2b174\": container with ID starting with 933aaa5c161baa6f6438081b90acb1fb2d5184bc270e3174bc0d17d2b2d2b174 not found: ID does not exist"
Nov 04 02:40:27.703843 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.703776    4548 scope.go:122] "RemoveContainer" containerID="154ccfe24de71b145b60c2e40759e5a15d405c77a29201d7493a09036702a6a6"
Nov 04 02:40:27.704153 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:27.704118    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"154ccfe24de71b145b60c2e40759e5a15d405c77a29201d7493a09036702a6a6\": container with ID starting with 154ccfe24de71b145b60c2e40759e5a15d405c77a29201d7493a09036702a6a6 not found: ID does not exist" containerID="154ccfe24de71b145b60c2e40759e5a15d405c77a29201d7493a09036702a6a6"
Nov 04 02:40:27.704302 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.704150    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"154ccfe24de71b145b60c2e40759e5a15d405c77a29201d7493a09036702a6a6"} err="failed to get container status \"154ccfe24de71b145b60c2e40759e5a15d405c77a29201d7493a09036702a6a6\": rpc error: code = NotFound desc = could not find container \"154ccfe24de71b145b60c2e40759e5a15d405c77a29201d7493a09036702a6a6\": container with ID starting with 154ccfe24de71b145b60c2e40759e5a15d405c77a29201d7493a09036702a6a6 not found: ID does not exist"
Nov 04 02:40:27.736023 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.735925    4548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-envoy\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:27.736023 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.735975    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c869q\" (UniqueName: \"kubernetes.io/projected/d7e95e09-f96e-4635-abe4-390c3fb16b6a-kube-api-access-c869q\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:27.736023 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.735992    4548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-podinfo\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:27.736023 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.736007    4548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d7e95e09-f96e-4635-abe4-390c3fb16b6a-istio-token\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:27.802447 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.802408    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"]
Nov 04 02:40:27.813524 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:27.807213    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-2ba6b8-openshift-default-bf9cd474c-5t4d2"]
Nov 04 02:40:28.285338 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:28.285295    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Nov 04 02:40:28.285618 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:28.285589    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng" podUID="07326a7b-ffa7-411e-9400-5af1b770d1e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Nov 04 02:40:28.527121 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:28.527080    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d7e95e09-f96e-4635-abe4-390c3fb16b6a" path="/var/lib/kubelet/pods/d7e95e09-f96e-4635-abe4-390c3fb16b6a/volumes"
Nov 04 02:40:29.276199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:29.274652    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Nov 04 02:40:29.276199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:29.274719    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng" podUID="07326a7b-ffa7-411e-9400-5af1b770d1e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Nov 04 02:40:30.264859 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:30.264817    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused" start-of-body=
Nov 04 02:40:30.265423 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:30.264906    4548 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng" podUID="07326a7b-ffa7-411e-9400-5af1b770d1e5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.94:15021/healthz/ready\": dial tcp 10.133.0.94:15021: connect: connection refused"
Nov 04 02:40:31.447004 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:31.446972    4548 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:31.447495 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:31.447413    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:31.448292 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:31.448273    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:31.564248 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:31.564204    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"]
Nov 04 02:40:31.564500 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:31.564475    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm" podUID="2e5e1352-41be-436c-bd26-7ef9a0e7a85d" containerName="istio-proxy" containerID="cri-o://63b87ae8b938d419966f75b56ff9a325d2365f4b6d8327472dc737a8ea2b9688" gracePeriod=30
Nov 04 02:40:36.543652 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:36.543617    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"]
Nov 04 02:40:36.544252 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:36.543809    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng" podUID="07326a7b-ffa7-411e-9400-5af1b770d1e5" containerName="istio-proxy" containerID="cri-o://07b79fbbbfba6ea19a00ec2bb57ba9d69c8d381886c2785fffcb7b903434c5e7" gracePeriod=30
Nov 04 02:40:36.562538 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:36.562493    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"]
Nov 04 02:40:36.562770 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:36.562744    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2" podUID="b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" containerName="istio-proxy" containerID="cri-o://4619c4ceaf5c665bee9d278f6e251a8898dab1ed5a8431020f121107d2cda04f" gracePeriod=30
Nov 04 02:40:36.569248 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:36.569215    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"]
Nov 04 02:40:36.569454 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:36.569434    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v" podUID="9fdd3326-be0a-4c70-bf81-07435dda05e3" containerName="istio-proxy" containerID="cri-o://2d6729c125568a7627c6bcc112d76aef4c24fc9672c2aa38e20890ec31f6e4b8" gracePeriod=30
Nov 04 02:40:36.759764 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:36.759729    4548 generic.go:356] "Generic (PLEG): container finished" podID="2e5e1352-41be-436c-bd26-7ef9a0e7a85d" containerID="63b87ae8b938d419966f75b56ff9a325d2365f4b6d8327472dc737a8ea2b9688" exitCode=0
Nov 04 02:40:36.759939 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:36.759823    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm" event={"ID":"2e5e1352-41be-436c-bd26-7ef9a0e7a85d","Type":"ContainerDied","Data":"63b87ae8b938d419966f75b56ff9a325d2365f4b6d8327472dc737a8ea2b9688"}
Nov 04 02:40:36.759989 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:36.759943    4548 scope.go:122] "RemoveContainer" containerID="ad5961bec1a656936b7698458d339bacece9bac61407b28afde89eb672c96e19"
Nov 04 02:40:36.897758 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:36.897726    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:40:37.093321 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.093286    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-token\" (UniqueName: \"kubernetes.io/projected/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-token\") pod \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") "
Nov 04 02:40:37.093532 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.093345    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-envoy\") pod \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") "
Nov 04 02:40:37.093532 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.093403    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istiod-ca-cert\") pod \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") "
Nov 04 02:40:37.093532 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.093429    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-data\") pod \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") "
Nov 04 02:40:37.093532 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.093460    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-kube-api-access-f8tqd\" (UniqueName: \"kubernetes.io/projected/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-kube-api-access-f8tqd\") pod \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") "
Nov 04 02:40:37.093743 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.093532    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-workload-socket\") pod \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") "
Nov 04 02:40:37.093743 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.093586    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-workload-certs\") pod \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") "
Nov 04 02:40:37.093743 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.093667    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-credential-socket\") pod \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") "
Nov 04 02:40:37.093904 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.093746    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-podinfo\") pod \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\" (UID: \"2e5e1352-41be-436c-bd26-7ef9a0e7a85d\") "
Nov 04 02:40:37.093970 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.093941    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-workload-socket" pod "2e5e1352-41be-436c-bd26-7ef9a0e7a85d" (UID: "2e5e1352-41be-436c-bd26-7ef9a0e7a85d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:37.094024 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.093961    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-workload-certs" pod "2e5e1352-41be-436c-bd26-7ef9a0e7a85d" (UID: "2e5e1352-41be-436c-bd26-7ef9a0e7a85d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:37.094024 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.093975    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-credential-socket" pod "2e5e1352-41be-436c-bd26-7ef9a0e7a85d" (UID: "2e5e1352-41be-436c-bd26-7ef9a0e7a85d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:37.094238 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.094214    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-data" pod "2e5e1352-41be-436c-bd26-7ef9a0e7a85d" (UID: "2e5e1352-41be-436c-bd26-7ef9a0e7a85d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:37.094578 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.094554    4548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-credential-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:37.094659 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.094586    4548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-workload-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:37.094659 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.094601    4548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-workload-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:37.094659 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.094319    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istiod-ca-cert" pod "2e5e1352-41be-436c-bd26-7ef9a0e7a85d" (UID: "2e5e1352-41be-436c-bd26-7ef9a0e7a85d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:37.096341 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.096303    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-token" pod "2e5e1352-41be-436c-bd26-7ef9a0e7a85d" (UID: "2e5e1352-41be-436c-bd26-7ef9a0e7a85d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:37.096568 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.096546    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-podinfo" pod "2e5e1352-41be-436c-bd26-7ef9a0e7a85d" (UID: "2e5e1352-41be-436c-bd26-7ef9a0e7a85d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:40:37.097080 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.097056    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-envoy" pod "2e5e1352-41be-436c-bd26-7ef9a0e7a85d" (UID: "2e5e1352-41be-436c-bd26-7ef9a0e7a85d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:37.102363 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.102324    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-kube-api-access-f8tqd" pod "2e5e1352-41be-436c-bd26-7ef9a0e7a85d" (UID: "2e5e1352-41be-436c-bd26-7ef9a0e7a85d"). InnerVolumeSpecName "kube-api-access-f8tqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:37.160616 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.160518    4548 patch_prober.go:29] interesting pod/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 02:40:37.160616 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.160594    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v" podUID="9fdd3326-be0a-4c70-bf81-07435dda05e3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 02:40:37.195930 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.195888    4548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-token\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:37.195930 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.195924    4548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-envoy\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:37.195930 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.195937    4548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istiod-ca-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:37.196217 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.195949    4548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-data\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:37.196217 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.195962    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f8tqd\" (UniqueName: \"kubernetes.io/projected/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-kube-api-access-f8tqd\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:37.196217 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.195976    4548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e5e1352-41be-436c-bd26-7ef9a0e7a85d-istio-podinfo\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:37.769572 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.769539    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"
Nov 04 02:40:37.770068 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.769567    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm" event={"ID":"2e5e1352-41be-436c-bd26-7ef9a0e7a85d","Type":"ContainerDied","Data":"ab068fd94f26d7ce9b699e511ca99c6a539b3d2b7f0717589cfd4ea7c3edea3f"}
Nov 04 02:40:37.770068 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.769633    4548 scope.go:122] "RemoveContainer" containerID="63b87ae8b938d419966f75b56ff9a325d2365f4b6d8327472dc737a8ea2b9688"
Nov 04 02:40:37.941460 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.941420    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"]
Nov 04 02:40:37.993557 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:37.993501    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-6c403f-openshift-default-78c4b9f87-j7vlm"]
Nov 04 02:40:38.525561 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:38.525526    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2e5e1352-41be-436c-bd26-7ef9a0e7a85d" path="/var/lib/kubelet/pods/2e5e1352-41be-436c-bd26-7ef9a0e7a85d/volumes"
Nov 04 02:40:40.611854 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:40.611819    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:40:41.805183 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.805135    4548 generic.go:356] "Generic (PLEG): container finished" podID="b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" containerID="4619c4ceaf5c665bee9d278f6e251a8898dab1ed5a8431020f121107d2cda04f" exitCode=0
Nov 04 02:40:41.805671 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.805227    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2" event={"ID":"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32","Type":"ContainerDied","Data":"4619c4ceaf5c665bee9d278f6e251a8898dab1ed5a8431020f121107d2cda04f"}
Nov 04 02:40:41.807427 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.807401    4548 generic.go:356] "Generic (PLEG): container finished" podID="07326a7b-ffa7-411e-9400-5af1b770d1e5" containerID="07b79fbbbfba6ea19a00ec2bb57ba9d69c8d381886c2785fffcb7b903434c5e7" exitCode=0
Nov 04 02:40:41.807560 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.807483    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng" event={"ID":"07326a7b-ffa7-411e-9400-5af1b770d1e5","Type":"ContainerDied","Data":"07b79fbbbfba6ea19a00ec2bb57ba9d69c8d381886c2785fffcb7b903434c5e7"}
Nov 04 02:40:41.809949 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.809922    4548 generic.go:356] "Generic (PLEG): container finished" podID="9fdd3326-be0a-4c70-bf81-07435dda05e3" containerID="2d6729c125568a7627c6bcc112d76aef4c24fc9672c2aa38e20890ec31f6e4b8" exitCode=0
Nov 04 02:40:41.810102 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.809965    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v" event={"ID":"9fdd3326-be0a-4c70-bf81-07435dda05e3","Type":"ContainerDied","Data":"2d6729c125568a7627c6bcc112d76aef4c24fc9672c2aa38e20890ec31f6e4b8"}
Nov 04 02:40:41.810102 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.810020    4548 scope.go:122] "RemoveContainer" containerID="838a10784b1323d09b399c253cc903ff28f7417f6e3143ae19da5acffa7dea00"
Nov 04 02:40:41.877187 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.877137    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:40:41.915992 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.915960    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:40:41.919516 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.919493    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:41.949507 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.949471    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-workload-socket\") pod \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") "
Nov 04 02:40:41.949713 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.949519    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07326a7b-ffa7-411e-9400-5af1b770d1e5-kube-api-access-7l64q\" (UniqueName: \"kubernetes.io/projected/07326a7b-ffa7-411e-9400-5af1b770d1e5-kube-api-access-7l64q\") pod \"07326a7b-ffa7-411e-9400-5af1b770d1e5\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") "
Nov 04 02:40:41.949713 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.949569    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-credential-socket\") pod \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") "
Nov 04 02:40:41.949713 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.949598    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-podinfo\") pod \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") "
Nov 04 02:40:41.949713 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.949628    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-token\" (UniqueName: \"kubernetes.io/projected/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-token\") pod \"07326a7b-ffa7-411e-9400-5af1b770d1e5\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") "
Nov 04 02:40:41.949713 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.949665    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-credential-socket\") pod \"07326a7b-ffa7-411e-9400-5af1b770d1e5\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") "
Nov 04 02:40:41.949713 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.949696    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-workload-certs\") pod \"9fdd3326-be0a-4c70-bf81-07435dda05e3\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") "
Nov 04 02:40:41.950046 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.949722    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-podinfo\") pod \"9fdd3326-be0a-4c70-bf81-07435dda05e3\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") "
Nov 04 02:40:41.950046 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.949776    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-token\" (UniqueName: \"kubernetes.io/projected/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-token\") pod \"9fdd3326-be0a-4c70-bf81-07435dda05e3\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") "
Nov 04 02:40:41.950046 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.949817    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-podinfo\") pod \"07326a7b-ffa7-411e-9400-5af1b770d1e5\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") "
Nov 04 02:40:41.950046 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.949837    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-workload-socket" pod "b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" (UID: "b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.950046 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.949877    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-credential-socket\") pod \"9fdd3326-be0a-4c70-bf81-07435dda05e3\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") "
Nov 04 02:40:41.950046 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.949910    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-envoy\") pod \"07326a7b-ffa7-411e-9400-5af1b770d1e5\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") "
Nov 04 02:40:41.950046 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.949967    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-envoy\") pod \"9fdd3326-be0a-4c70-bf81-07435dda05e3\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") "
Nov 04 02:40:41.950046 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.949999    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istiod-ca-cert\") pod \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") "
Nov 04 02:40:41.950469 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.950053    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-workload-certs\") pod \"07326a7b-ffa7-411e-9400-5af1b770d1e5\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") "
Nov 04 02:40:41.950469 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.950094    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-workload-certs" pod "9fdd3326-be0a-4c70-bf81-07435dda05e3" (UID: "9fdd3326-be0a-4c70-bf81-07435dda05e3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.950469 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.950099    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/07326a7b-ffa7-411e-9400-5af1b770d1e5-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07326a7b-ffa7-411e-9400-5af1b770d1e5-istiod-ca-cert\") pod \"07326a7b-ffa7-411e-9400-5af1b770d1e5\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") "
Nov 04 02:40:41.950469 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.950194    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-workload-socket\") pod \"07326a7b-ffa7-411e-9400-5af1b770d1e5\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") "
Nov 04 02:40:41.950469 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.950234    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-data\") pod \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") "
Nov 04 02:40:41.950469 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.950313    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-data\") pod \"9fdd3326-be0a-4c70-bf81-07435dda05e3\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") "
Nov 04 02:40:41.950469 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.950348    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-envoy\") pod \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") "
Nov 04 02:40:41.950469 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.950383    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-data\") pod \"07326a7b-ffa7-411e-9400-5af1b770d1e5\" (UID: \"07326a7b-ffa7-411e-9400-5af1b770d1e5\") "
Nov 04 02:40:41.950469 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.950436    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-kube-api-access-f5wrp\" (UniqueName: \"kubernetes.io/projected/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-kube-api-access-f5wrp\") pod \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") "
Nov 04 02:40:41.950889 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.950476    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/9fdd3326-be0a-4c70-bf81-07435dda05e3-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fdd3326-be0a-4c70-bf81-07435dda05e3-istiod-ca-cert\") pod \"9fdd3326-be0a-4c70-bf81-07435dda05e3\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") "
Nov 04 02:40:41.950889 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.950512    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9fdd3326-be0a-4c70-bf81-07435dda05e3-kube-api-access-qxwjx\" (UniqueName: \"kubernetes.io/projected/9fdd3326-be0a-4c70-bf81-07435dda05e3-kube-api-access-qxwjx\") pod \"9fdd3326-be0a-4c70-bf81-07435dda05e3\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") "
Nov 04 02:40:41.950889 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.950549    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-workload-certs\") pod \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") "
Nov 04 02:40:41.950889 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.950604    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-token\" (UniqueName: \"kubernetes.io/projected/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-token\") pod \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\" (UID: \"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32\") "
Nov 04 02:40:41.950889 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.950647    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-workload-socket\") pod \"9fdd3326-be0a-4c70-bf81-07435dda05e3\" (UID: \"9fdd3326-be0a-4c70-bf81-07435dda05e3\") "
Nov 04 02:40:41.951203 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.951162    4548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-workload-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:41.951297 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.951244    4548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-workload-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:41.951980 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.950230    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-credential-socket" pod "9fdd3326-be0a-4c70-bf81-07435dda05e3" (UID: "9fdd3326-be0a-4c70-bf81-07435dda05e3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.951980 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.950431    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-credential-socket" pod "07326a7b-ffa7-411e-9400-5af1b770d1e5" (UID: "07326a7b-ffa7-411e-9400-5af1b770d1e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.951980 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.950662    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-workload-socket" pod "07326a7b-ffa7-411e-9400-5af1b770d1e5" (UID: "07326a7b-ffa7-411e-9400-5af1b770d1e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.951980 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.951509    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-workload-socket" pod "9fdd3326-be0a-4c70-bf81-07435dda05e3" (UID: "9fdd3326-be0a-4c70-bf81-07435dda05e3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.952342 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.952135    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-credential-socket" pod "b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" (UID: "b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.952650 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.951631    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-data" pod "07326a7b-ffa7-411e-9400-5af1b770d1e5" (UID: "07326a7b-ffa7-411e-9400-5af1b770d1e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.952650 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.951760    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-workload-certs" pod "07326a7b-ffa7-411e-9400-5af1b770d1e5" (UID: "07326a7b-ffa7-411e-9400-5af1b770d1e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.952650 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.951900    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-data" pod "9fdd3326-be0a-4c70-bf81-07435dda05e3" (UID: "9fdd3326-be0a-4c70-bf81-07435dda05e3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.952650 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.952456    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07326a7b-ffa7-411e-9400-5af1b770d1e5-istiod-ca-cert" pod "07326a7b-ffa7-411e-9400-5af1b770d1e5" (UID: "07326a7b-ffa7-411e-9400-5af1b770d1e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:41.953150 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.952907    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-workload-certs" pod "b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" (UID: "b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.953150 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.952978    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-podinfo" pod "07326a7b-ffa7-411e-9400-5af1b770d1e5" (UID: "07326a7b-ffa7-411e-9400-5af1b770d1e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:40:41.953150 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.953066    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-token" pod "9fdd3326-be0a-4c70-bf81-07435dda05e3" (UID: "9fdd3326-be0a-4c70-bf81-07435dda05e3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:41.953546 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.953268    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istiod-ca-cert" pod "b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" (UID: "b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:41.953546 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.953523    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-data" pod "b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" (UID: "b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.953659 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.953591    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9fdd3326-be0a-4c70-bf81-07435dda05e3-istiod-ca-cert" pod "9fdd3326-be0a-4c70-bf81-07435dda05e3" (UID: "9fdd3326-be0a-4c70-bf81-07435dda05e3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:40:41.954750 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.954720    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-podinfo" pod "b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" (UID: "b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:40:41.955468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.955442    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-token" pod "b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" (UID: "b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:41.955740 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.955716    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-token" pod "07326a7b-ffa7-411e-9400-5af1b770d1e5" (UID: "07326a7b-ffa7-411e-9400-5af1b770d1e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:41.956044 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.956022    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-envoy" pod "07326a7b-ffa7-411e-9400-5af1b770d1e5" (UID: "07326a7b-ffa7-411e-9400-5af1b770d1e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.956223 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.956162    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-envoy" pod "9fdd3326-be0a-4c70-bf81-07435dda05e3" (UID: "9fdd3326-be0a-4c70-bf81-07435dda05e3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.956315 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.956267    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-envoy" pod "b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" (UID: "b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:40:41.956436 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.956419    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-kube-api-access-f5wrp" pod "b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" (UID: "b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32"). InnerVolumeSpecName "kube-api-access-f5wrp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:41.956585 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.956564    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07326a7b-ffa7-411e-9400-5af1b770d1e5-kube-api-access-7l64q" pod "07326a7b-ffa7-411e-9400-5af1b770d1e5" (UID: "07326a7b-ffa7-411e-9400-5af1b770d1e5"). InnerVolumeSpecName "kube-api-access-7l64q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:41.957992 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.957973    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-podinfo" pod "9fdd3326-be0a-4c70-bf81-07435dda05e3" (UID: "9fdd3326-be0a-4c70-bf81-07435dda05e3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:40:41.957992 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:41.957985    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9fdd3326-be0a-4c70-bf81-07435dda05e3-kube-api-access-qxwjx" pod "9fdd3326-be0a-4c70-bf81-07435dda05e3" (UID: "9fdd3326-be0a-4c70-bf81-07435dda05e3"). InnerVolumeSpecName "kube-api-access-qxwjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:40:42.052598 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052562    4548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-workload-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.052598 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052598    4548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-token\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.052598 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052612    4548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-workload-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.052598 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052624    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7l64q\" (UniqueName: \"kubernetes.io/projected/07326a7b-ffa7-411e-9400-5af1b770d1e5-kube-api-access-7l64q\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.052598 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052641    4548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-credential-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.052598 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052655    4548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-podinfo\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.052598 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052667    4548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-token\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.053468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052681    4548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-credential-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.053468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052694    4548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-podinfo\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.053468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052708    4548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-token\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.053468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052721    4548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-podinfo\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.053468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052734    4548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-credential-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.053468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052747    4548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-envoy\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.053468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052759    4548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-envoy\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.053468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052771    4548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istiod-ca-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.053468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052783    4548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-workload-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.053468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052795    4548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/07326a7b-ffa7-411e-9400-5af1b770d1e5-istiod-ca-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.053468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052808    4548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-workload-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.053468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052822    4548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-data\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.053468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052838    4548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9fdd3326-be0a-4c70-bf81-07435dda05e3-istio-data\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.053468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052852    4548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-istio-envoy\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.053468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052864    4548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/07326a7b-ffa7-411e-9400-5af1b770d1e5-istio-data\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.053468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052878    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5wrp\" (UniqueName: \"kubernetes.io/projected/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32-kube-api-access-f5wrp\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.053468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052890    4548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9fdd3326-be0a-4c70-bf81-07435dda05e3-istiod-ca-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.053468 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.052904    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxwjx\" (UniqueName: \"kubernetes.io/projected/9fdd3326-be0a-4c70-bf81-07435dda05e3-kube-api-access-qxwjx\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:40:42.557244 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:42.557210    4548 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-63866b33446b: secret "agc-cred-63866b33446b" not found
Nov 04 02:40:42.557244 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:42.557244    4548 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj: secret "agc-cred-63866b33446b" not found
Nov 04 02:40:42.557505 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:42.557324    4548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials podName:09e06531-bcdc-436a-91d9-9c8748ee248b nodeName:}" failed. No retries permitted until 2026-11-04 02:40:43.057303822 +0000 UTC m=+1476.662316820 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials") pod "payload-processing-external-model-54f9d586c7-9k9pj" (UID: "09e06531-bcdc-436a-91d9-9c8748ee248b") : secret "agc-cred-63866b33446b" not found
Nov 04 02:40:42.819105 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.819022    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"
Nov 04 02:40:42.819610 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.819022    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2" event={"ID":"b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32","Type":"ContainerDied","Data":"43354c37f206f8711b4eac1785dd8dd19f5ff124e06f8ff95d03c64ffa17b3fe"}
Nov 04 02:40:42.819610 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.819188    4548 scope.go:122] "RemoveContainer" containerID="4619c4ceaf5c665bee9d278f6e251a8898dab1ed5a8431020f121107d2cda04f"
Nov 04 02:40:42.820848 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.820812    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"
Nov 04 02:40:42.821769 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.821741    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng" event={"ID":"07326a7b-ffa7-411e-9400-5af1b770d1e5","Type":"ContainerDied","Data":"11ebfc540eb62984b53de483ca0652e1fc0501171df618df1c28e26feba16f0f"}
Nov 04 02:40:42.822884 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.822867    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"
Nov 04 02:40:42.822995 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.822905    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v" event={"ID":"9fdd3326-be0a-4c70-bf81-07435dda05e3","Type":"ContainerDied","Data":"78b23602cc9ba9dadc91b0457ee83ecfa7fe423df8ab28b109edd20eb254a658"}
Nov 04 02:40:42.831969 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.831940    4548 scope.go:122] "RemoveContainer" containerID="07b79fbbbfba6ea19a00ec2bb57ba9d69c8d381886c2785fffcb7b903434c5e7"
Nov 04 02:40:42.842142 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.842122    4548 scope.go:122] "RemoveContainer" containerID="2d6729c125568a7627c6bcc112d76aef4c24fc9672c2aa38e20890ec31f6e4b8"
Nov 04 02:40:42.986603 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.986563    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"]
Nov 04 02:40:42.992616 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:42.992585    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-n558v"]
Nov 04 02:40:43.062811 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:43.062770    4548 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-63866b33446b: secret "agc-cred-63866b33446b" not found
Nov 04 02:40:43.062811 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:43.062809    4548 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj: secret "agc-cred-63866b33446b" not found
Nov 04 02:40:43.063018 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:43.062868    4548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials podName:09e06531-bcdc-436a-91d9-9c8748ee248b nodeName:}" failed. No retries permitted until 2026-11-04 02:40:44.062851468 +0000 UTC m=+1477.667864467 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials") pod "payload-processing-external-model-54f9d586c7-9k9pj" (UID: "09e06531-bcdc-436a-91d9-9c8748ee248b") : secret "agc-cred-63866b33446b" not found
Nov 04 02:40:43.104861 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:43.104775    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"]
Nov 04 02:40:43.108564 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:43.108534    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-gz5m2"]
Nov 04 02:40:43.223323 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:43.220815    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"]
Nov 04 02:40:43.233153 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:43.233113    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-ab53c1-openshift-default-5dc69f9767-fjnng"]
Nov 04 02:40:44.074641 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:44.074606    4548 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-63866b33446b: secret "agc-cred-63866b33446b" not found
Nov 04 02:40:44.074641 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:44.074639    4548 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj: secret "agc-cred-63866b33446b" not found
Nov 04 02:40:44.075078 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:44.074695    4548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials podName:09e06531-bcdc-436a-91d9-9c8748ee248b nodeName:}" failed. No retries permitted until 2026-11-04 02:40:46.074681291 +0000 UTC m=+1479.679694268 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials") pod "payload-processing-external-model-54f9d586c7-9k9pj" (UID: "09e06531-bcdc-436a-91d9-9c8748ee248b") : secret "agc-cred-63866b33446b" not found
Nov 04 02:40:44.524843 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:44.524808    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="07326a7b-ffa7-411e-9400-5af1b770d1e5" path="/var/lib/kubelet/pods/07326a7b-ffa7-411e-9400-5af1b770d1e5/volumes"
Nov 04 02:40:44.525371 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:44.525347    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9fdd3326-be0a-4c70-bf81-07435dda05e3" path="/var/lib/kubelet/pods/9fdd3326-be0a-4c70-bf81-07435dda05e3/volumes"
Nov 04 02:40:44.525759 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:40:44.525746    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" path="/var/lib/kubelet/pods/b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32/volumes"
Nov 04 02:40:46.099240 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:46.099203    4548 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-63866b33446b: secret "agc-cred-63866b33446b" not found
Nov 04 02:40:46.099240 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:46.099241    4548 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj: secret "agc-cred-63866b33446b" not found
Nov 04 02:40:46.099791 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:46.099320    4548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials podName:09e06531-bcdc-436a-91d9-9c8748ee248b nodeName:}" failed. No retries permitted until 2026-11-04 02:40:50.099300279 +0000 UTC m=+1483.704313270 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials") pod "payload-processing-external-model-54f9d586c7-9k9pj" (UID: "09e06531-bcdc-436a-91d9-9c8748ee248b") : secret "agc-cred-63866b33446b" not found
Nov 04 02:40:50.145670 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:50.145627    4548 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-63866b33446b: secret "agc-cred-63866b33446b" not found
Nov 04 02:40:50.145670 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:50.145666    4548 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj: secret "agc-cred-63866b33446b" not found
Nov 04 02:40:50.146141 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:50.145725    4548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials podName:09e06531-bcdc-436a-91d9-9c8748ee248b nodeName:}" failed. No retries permitted until 2026-11-04 02:40:58.145709548 +0000 UTC m=+1491.750722525 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials") pod "payload-processing-external-model-54f9d586c7-9k9pj" (UID: "09e06531-bcdc-436a-91d9-9c8748ee248b") : secret "agc-cred-63866b33446b" not found
Nov 04 02:40:58.236343 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:58.236308    4548 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-63866b33446b: secret "agc-cred-63866b33446b" not found
Nov 04 02:40:58.236343 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:58.236344    4548 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj: secret "agc-cred-63866b33446b" not found
Nov 04 02:40:58.236833 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:40:58.236410    4548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials podName:09e06531-bcdc-436a-91d9-9c8748ee248b nodeName:}" failed. No retries permitted until 2026-11-04 02:41:14.236395024 +0000 UTC m=+1507.841408000 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials") pod "payload-processing-external-model-54f9d586c7-9k9pj" (UID: "09e06531-bcdc-436a-91d9-9c8748ee248b") : secret "agc-cred-63866b33446b" not found
Nov 04 02:41:06.800815 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:41:06.800782    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:41:06.806503 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:41:06.806474    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:41:06.905737 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:41:06.905689    4548 scope.go:122] "RemoveContainer" containerID="d8a6fdefd0e49f8275fd7401d1037cec78d3db17b6d2d2878039c7577445b43d"
Nov 04 02:41:06.918746 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:41:06.918721    4548 scope.go:122] "RemoveContainer" containerID="26b725cb6c79bea755724f0244024fa16ec9f4b7460817449c14025e286027d8"
Nov 04 02:41:06.931420 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:41:06.931393    4548 scope.go:122] "RemoveContainer" containerID="e29e9b9c9cf978dfc935ad08dfa8a6ce903f4f6368133a62db57dd825563158b"
Nov 04 02:41:10.612526 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:41:10.612486    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:41:14.321274 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:41:14.321234    4548 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-63866b33446b: secret "agc-cred-63866b33446b" not found
Nov 04 02:41:14.321274 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:41:14.321269    4548 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj: secret "agc-cred-63866b33446b" not found
Nov 04 02:41:14.321783 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:41:14.321339    4548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials podName:09e06531-bcdc-436a-91d9-9c8748ee248b nodeName:}" failed. No retries permitted until 2026-11-04 02:41:46.321323023 +0000 UTC m=+1539.926336000 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials") pod "payload-processing-external-model-54f9d586c7-9k9pj" (UID: "09e06531-bcdc-436a-91d9-9c8748ee248b") : secret "agc-cred-63866b33446b" not found
Nov 04 02:41:40.611757 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:41:40.611719    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:41:46.393998 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:41:46.393957    4548 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-63866b33446b: secret "agc-cred-63866b33446b" not found
Nov 04 02:41:46.393998 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:41:46.393996    4548 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj: secret "agc-cred-63866b33446b" not found
Nov 04 02:41:46.394602 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:41:46.394061    4548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials podName:09e06531-bcdc-436a-91d9-9c8748ee248b nodeName:}" failed. No retries permitted until 2026-11-04 02:42:50.394043884 +0000 UTC m=+1603.999056869 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials") pod "payload-processing-external-model-54f9d586c7-9k9pj" (UID: "09e06531-bcdc-436a-91d9-9c8748ee248b") : secret "agc-cred-63866b33446b" not found
Nov 04 02:41:59.051396 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:41:59.051362    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl"]
Nov 04 02:41:59.100978 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:41:59.100934    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-69cfda10-fr2hl"]
Nov 04 02:42:00.523680 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:42:00.523643    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="730b294f-8be4-4950-907a-cfb848d41dcf" path="/var/lib/kubelet/pods/730b294f-8be4-4950-907a-cfb848d41dcf/volumes"
Nov 04 02:42:10.616387 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:42:10.616345    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:42:12.053096 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:42:12.053060    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62"]
Nov 04 02:42:12.102918 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:42:12.102881    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4229a718-l9w62"]
Nov 04 02:42:12.523752 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:42:12.523718    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e04f4b82-f244-4314-b27d-51dfafee4e7f" path="/var/lib/kubelet/pods/e04f4b82-f244-4314-b27d-51dfafee4e7f/volumes"
Nov 04 02:42:40.611396 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:42:40.611304    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:42:50.427150 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:42:50.427105    4548 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-63866b33446b: secret "agc-cred-63866b33446b" not found
Nov 04 02:42:50.427150 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:42:50.427143    4548 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj: secret "agc-cred-63866b33446b" not found
Nov 04 02:42:50.427789 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:42:50.427239    4548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials podName:09e06531-bcdc-436a-91d9-9c8748ee248b nodeName:}" failed. No retries permitted until 2026-11-04 02:44:52.427224627 +0000 UTC m=+1726.032237616 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials") pod "payload-processing-external-model-54f9d586c7-9k9pj" (UID: "09e06531-bcdc-436a-91d9-9c8748ee248b") : secret "agc-cred-63866b33446b" not found
Nov 04 02:43:07.034160 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:43:07.034109    4548 scope.go:122] "RemoveContainer" containerID="2ff4232f44a8e7185637950f6336497c1a059878b2e1ff2b1d8826caf6baa4fe"
Nov 04 02:43:10.611076 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:43:10.611037    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:43:26.052497 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:43:26.052461    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9"]
Nov 04 02:43:26.102724 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:43:26.102677    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-db63b8d3-hmhq9"]
Nov 04 02:43:26.524227 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:43:26.524190    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6356dba0-549d-46d2-87f3-6fee2ddea239" path="/var/lib/kubelet/pods/6356dba0-549d-46d2-87f3-6fee2ddea239/volumes"
Nov 04 02:43:40.611846 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:43:40.611809    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:44:07.061232 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:07.061197    4548 scope.go:122] "RemoveContainer" containerID="57c15f2141561b6546707bb78b3d2954959ae7686fb4eb791f731348e118771b"
Nov 04 02:44:09.092222 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:09.092151    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"]
Nov 04 02:44:09.092680 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:09.092410    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb" podUID="7d3cf0be-0fae-4452-824e-2cf91e1232c2" containerName="istio-proxy" containerID="cri-o://21e1229ccd97f7c82f28a795a94f912238aa5d18d0bd49091112603da37d65b3" gracePeriod=30
Nov 04 02:44:10.611487 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:44:10.611441    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:44:14.240776 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.240738    4548 generic.go:356] "Generic (PLEG): container finished" podID="7d3cf0be-0fae-4452-824e-2cf91e1232c2" containerID="21e1229ccd97f7c82f28a795a94f912238aa5d18d0bd49091112603da37d65b3" exitCode=0
Nov 04 02:44:14.241352 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.240946    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb" event={"ID":"7d3cf0be-0fae-4452-824e-2cf91e1232c2","Type":"ContainerDied","Data":"21e1229ccd97f7c82f28a795a94f912238aa5d18d0bd49091112603da37d65b3"}
Nov 04 02:44:14.241352 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.241010    4548 scope.go:122] "RemoveContainer" containerID="33c7f9569bfb33e12cc627eb5309c14dcda87d56d7db7dc1da1efa7278e6400f"
Nov 04 02:44:14.365431 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.365345    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:44:14.469017 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.468979    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-token\" (UniqueName: \"kubernetes.io/projected/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-token\") pod \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") "
Nov 04 02:44:14.469260 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.469046    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-envoy\") pod \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") "
Nov 04 02:44:14.469260 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.469109    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-credential-socket\") pod \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") "
Nov 04 02:44:14.469260 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.469215    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-data\") pod \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") "
Nov 04 02:44:14.469260 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.469242    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-podinfo\") pod \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") "
Nov 04 02:44:14.469510 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.469272    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-workload-certs\") pod \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") "
Nov 04 02:44:14.469510 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.469298    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istiod-ca-cert\") pod \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") "
Nov 04 02:44:14.469510 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.469349    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7d3cf0be-0fae-4452-824e-2cf91e1232c2-kube-api-access-r8pmh\" (UniqueName: \"kubernetes.io/projected/7d3cf0be-0fae-4452-824e-2cf91e1232c2-kube-api-access-r8pmh\") pod \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") "
Nov 04 02:44:14.469510 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.469417    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-workload-socket\") pod \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\" (UID: \"7d3cf0be-0fae-4452-824e-2cf91e1232c2\") "
Nov 04 02:44:14.469725 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.469507    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-credential-socket" pod "7d3cf0be-0fae-4452-824e-2cf91e1232c2" (UID: "7d3cf0be-0fae-4452-824e-2cf91e1232c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:44:14.469725 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.469524    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-data" pod "7d3cf0be-0fae-4452-824e-2cf91e1232c2" (UID: "7d3cf0be-0fae-4452-824e-2cf91e1232c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:44:14.469921 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.469868    4548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-credential-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:44:14.469921 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.469892    4548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-data\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:44:14.469921 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.469902    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-workload-socket" pod "7d3cf0be-0fae-4452-824e-2cf91e1232c2" (UID: "7d3cf0be-0fae-4452-824e-2cf91e1232c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:44:14.470150 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.469998    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-workload-certs" pod "7d3cf0be-0fae-4452-824e-2cf91e1232c2" (UID: "7d3cf0be-0fae-4452-824e-2cf91e1232c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:44:14.470150 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.470006    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istiod-ca-cert" pod "7d3cf0be-0fae-4452-824e-2cf91e1232c2" (UID: "7d3cf0be-0fae-4452-824e-2cf91e1232c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:44:14.471534 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.471507    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-token" pod "7d3cf0be-0fae-4452-824e-2cf91e1232c2" (UID: "7d3cf0be-0fae-4452-824e-2cf91e1232c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:44:14.471949 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.471923    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d3cf0be-0fae-4452-824e-2cf91e1232c2-kube-api-access-r8pmh" pod "7d3cf0be-0fae-4452-824e-2cf91e1232c2" (UID: "7d3cf0be-0fae-4452-824e-2cf91e1232c2"). InnerVolumeSpecName "kube-api-access-r8pmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:44:14.472052 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.472036    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-envoy" pod "7d3cf0be-0fae-4452-824e-2cf91e1232c2" (UID: "7d3cf0be-0fae-4452-824e-2cf91e1232c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:44:14.472098 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.472046    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-podinfo" pod "7d3cf0be-0fae-4452-824e-2cf91e1232c2" (UID: "7d3cf0be-0fae-4452-824e-2cf91e1232c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:44:14.570726 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.570686    4548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-podinfo\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:44:14.570726 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.570719    4548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-workload-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:44:14.570726 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.570734    4548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istiod-ca-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:44:14.570980 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.570746    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r8pmh\" (UniqueName: \"kubernetes.io/projected/7d3cf0be-0fae-4452-824e-2cf91e1232c2-kube-api-access-r8pmh\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:44:14.570980 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.570756    4548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-workload-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:44:14.570980 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.570764    4548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-token\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:44:14.570980 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:14.570772    4548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d3cf0be-0fae-4452-824e-2cf91e1232c2-istio-envoy\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:44:15.248877 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:15.248846    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"
Nov 04 02:44:15.249423 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:15.248851    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb" event={"ID":"7d3cf0be-0fae-4452-824e-2cf91e1232c2","Type":"ContainerDied","Data":"11239ee7281a9a4eb2d494abf933a68ff790c7461b7ca5cf041919e69b1eb5a2"}
Nov 04 02:44:15.249423 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:15.248984    4548 scope.go:122] "RemoveContainer" containerID="21e1229ccd97f7c82f28a795a94f912238aa5d18d0bd49091112603da37d65b3"
Nov 04 02:44:15.467529 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:15.467484    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"]
Nov 04 02:44:15.522543 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:15.520236    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-1e4f1e-openshift-default-846f5ff6b5-295vb"]
Nov 04 02:44:16.523360 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:16.523314    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7d3cf0be-0fae-4452-824e-2cf91e1232c2" path="/var/lib/kubelet/pods/7d3cf0be-0fae-4452-824e-2cf91e1232c2/volumes"
Nov 04 02:44:26.054767 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:26.054731    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94"]
Nov 04 02:44:26.107928 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:26.107880    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-3f509dfe-49t94"]
Nov 04 02:44:26.524063 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:26.524033    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2d3a3a4f-8908-4d9a-9e13-647354d1557c" path="/var/lib/kubelet/pods/2d3a3a4f-8908-4d9a-9e13-647354d1557c/volumes"
Nov 04 02:44:36.064043 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:36.064001    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b"]
Nov 04 02:44:36.114084 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:36.114048    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-b789f6a8-cfz2b"]
Nov 04 02:44:36.532254 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:36.532217    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d4d5a9fc-e958-462f-8028-b9a9213b18a9" path="/var/lib/kubelet/pods/d4d5a9fc-e958-462f-8028-b9a9213b18a9/volumes"
Nov 04 02:44:40.615201 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:44:40.612155    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:44:44.964263 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964217    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k"]
Nov 04 02:44:44.964804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964701    4548 cpu_manager.go:414] "containerMap: removing container" podUID="d7e95e09-f96e-4635-abe4-390c3fb16b6a" containerName="istio-proxy"
Nov 04 02:44:44.964804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964714    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d7e95e09-f96e-4635-abe4-390c3fb16b6a" containerName="istio-proxy"
Nov 04 02:44:44.964804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964728    4548 cpu_manager.go:414] "containerMap: removing container" podUID="2e5e1352-41be-436c-bd26-7ef9a0e7a85d" containerName="istio-proxy"
Nov 04 02:44:44.964804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964733    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e5e1352-41be-436c-bd26-7ef9a0e7a85d" containerName="istio-proxy"
Nov 04 02:44:44.964804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964738    4548 cpu_manager.go:414] "containerMap: removing container" podUID="d7e95e09-f96e-4635-abe4-390c3fb16b6a" containerName="istio-proxy"
Nov 04 02:44:44.964804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964743    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d7e95e09-f96e-4635-abe4-390c3fb16b6a" containerName="istio-proxy"
Nov 04 02:44:44.964804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964750    4548 cpu_manager.go:414] "containerMap: removing container" podUID="9fdd3326-be0a-4c70-bf81-07435dda05e3" containerName="istio-proxy"
Nov 04 02:44:44.964804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964754    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9fdd3326-be0a-4c70-bf81-07435dda05e3" containerName="istio-proxy"
Nov 04 02:44:44.964804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964764    4548 cpu_manager.go:414] "containerMap: removing container" podUID="7d3cf0be-0fae-4452-824e-2cf91e1232c2" containerName="istio-proxy"
Nov 04 02:44:44.964804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964769    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d3cf0be-0fae-4452-824e-2cf91e1232c2" containerName="istio-proxy"
Nov 04 02:44:44.964804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964774    4548 cpu_manager.go:414] "containerMap: removing container" podUID="b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" containerName="istio-proxy"
Nov 04 02:44:44.964804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964778    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" containerName="istio-proxy"
Nov 04 02:44:44.964804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964794    4548 cpu_manager.go:414] "containerMap: removing container" podUID="07326a7b-ffa7-411e-9400-5af1b770d1e5" containerName="istio-proxy"
Nov 04 02:44:44.964804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964798    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="07326a7b-ffa7-411e-9400-5af1b770d1e5" containerName="istio-proxy"
Nov 04 02:44:44.964804 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964810    4548 cpu_manager.go:414] "containerMap: removing container" podUID="9fdd3326-be0a-4c70-bf81-07435dda05e3" containerName="istio-proxy"
Nov 04 02:44:44.965343 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964817    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9fdd3326-be0a-4c70-bf81-07435dda05e3" containerName="istio-proxy"
Nov 04 02:44:44.965343 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964904    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d3cf0be-0fae-4452-824e-2cf91e1232c2" containerName="istio-proxy"
Nov 04 02:44:44.965343 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964911    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e5e1352-41be-436c-bd26-7ef9a0e7a85d" containerName="istio-proxy"
Nov 04 02:44:44.965343 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964917    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="07326a7b-ffa7-411e-9400-5af1b770d1e5" containerName="istio-proxy"
Nov 04 02:44:44.965343 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964923    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="9fdd3326-be0a-4c70-bf81-07435dda05e3" containerName="istio-proxy"
Nov 04 02:44:44.965343 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964931    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="d7e95e09-f96e-4635-abe4-390c3fb16b6a" containerName="istio-proxy"
Nov 04 02:44:44.965343 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964935    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="2e5e1352-41be-436c-bd26-7ef9a0e7a85d" containerName="istio-proxy"
Nov 04 02:44:44.965343 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964940    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="9fdd3326-be0a-4c70-bf81-07435dda05e3" containerName="istio-proxy"
Nov 04 02:44:44.965343 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964946    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="7d3cf0be-0fae-4452-824e-2cf91e1232c2" containerName="istio-proxy"
Nov 04 02:44:44.965343 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.964950    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="b3ddabe8-3942-4edc-9bc5-3d3a8da8dd32" containerName="istio-proxy"
Nov 04 02:44:44.968638 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:44.968614    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k"
Nov 04 02:44:45.023775 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:45.023739    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k"]
Nov 04 02:44:45.069490 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:45.069452    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 02:44:45.069490 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:45.069476    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:44:45.069490 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:45.069476    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:44:45.069753 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:45.069504    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:44:45.111063 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:45.111020    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e0c33980-029c-47c2-9a85-4745b1255f6f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-1843228f-r9v4k\" (UID: \"e0c33980-029c-47c2-9a85-4745b1255f6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k"
Nov 04 02:44:45.111309 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:45.111084    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9ssl\" (UniqueName: \"kubernetes.io/projected/e0c33980-029c-47c2-9a85-4745b1255f6f-kube-api-access-l9ssl\") pod \"maas-api-revoke-sub-1843228f-r9v4k\" (UID: \"e0c33980-029c-47c2-9a85-4745b1255f6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k"
Nov 04 02:44:45.111309 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:45.111287    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e0c33980-029c-47c2-9a85-4745b1255f6f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-1843228f-r9v4k\" (UID: \"e0c33980-029c-47c2-9a85-4745b1255f6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k"
Nov 04 02:44:45.212754 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:45.212708    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e0c33980-029c-47c2-9a85-4745b1255f6f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-1843228f-r9v4k\" (UID: \"e0c33980-029c-47c2-9a85-4745b1255f6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k"
Nov 04 02:44:45.212954 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:45.212793    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e0c33980-029c-47c2-9a85-4745b1255f6f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-1843228f-r9v4k\" (UID: \"e0c33980-029c-47c2-9a85-4745b1255f6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k"
Nov 04 02:44:45.212954 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:45.212831    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9ssl\" (UniqueName: \"kubernetes.io/projected/e0c33980-029c-47c2-9a85-4745b1255f6f-kube-api-access-l9ssl\") pod \"maas-api-revoke-sub-1843228f-r9v4k\" (UID: \"e0c33980-029c-47c2-9a85-4745b1255f6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k"
Nov 04 02:44:45.213591 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:45.213520    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e0c33980-029c-47c2-9a85-4745b1255f6f-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-1843228f-r9v4k\" (UID: \"e0c33980-029c-47c2-9a85-4745b1255f6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k"
Nov 04 02:44:45.215362 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:45.215306    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e0c33980-029c-47c2-9a85-4745b1255f6f-maas-api-xks-ca\") pod \"maas-api-revoke-sub-1843228f-r9v4k\" (UID: \"e0c33980-029c-47c2-9a85-4745b1255f6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k"
Nov 04 02:44:45.274337 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:45.274298    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9ssl\" (UniqueName: \"kubernetes.io/projected/e0c33980-029c-47c2-9a85-4745b1255f6f-kube-api-access-l9ssl\") pod \"maas-api-revoke-sub-1843228f-r9v4k\" (UID: \"e0c33980-029c-47c2-9a85-4745b1255f6f\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k"
Nov 04 02:44:45.282549 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:45.282514    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k"
Nov 04 02:44:45.673833 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:45.673804    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k"]
Nov 04 02:44:46.446205 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:46.446131    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k" event={"ID":"e0c33980-029c-47c2-9a85-4745b1255f6f","Type":"ContainerStarted","Data":"e35abb307f8311fcbc34242b020c548d492c54ffc606fa7e5ff923dcf823310a"}
Nov 04 02:44:46.446641 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:46.446220    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k" event={"ID":"e0c33980-029c-47c2-9a85-4745b1255f6f","Type":"ContainerStarted","Data":"cd5b22afda7780c4b0e0fc2a8b87288441494bbefc43a0dca1e5afd2f833f3e5"}
Nov 04 02:44:46.562560 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:46.562492    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k" podStartSLOduration=2.562474665 podStartE2EDuration="2.562474665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:44:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:44:46.562147187 +0000 UTC m=+1720.167160188" watchObservedRunningTime="2026-11-04 02:44:46.562474665 +0000 UTC m=+1720.167487664"
Nov 04 02:44:47.454418 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:47.454382    4548 generic.go:356] "Generic (PLEG): container finished" podID="e0c33980-029c-47c2-9a85-4745b1255f6f" containerID="e35abb307f8311fcbc34242b020c548d492c54ffc606fa7e5ff923dcf823310a" exitCode=0
Nov 04 02:44:47.454858 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:47.454470    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k" event={"ID":"e0c33980-029c-47c2-9a85-4745b1255f6f","Type":"ContainerDied","Data":"e35abb307f8311fcbc34242b020c548d492c54ffc606fa7e5ff923dcf823310a"}
Nov 04 02:44:48.051721 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:48.051682    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt"]
Nov 04 02:44:48.054503 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:48.054479    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9788dfba-x94xt"]
Nov 04 02:44:48.527562 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:48.527525    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ada4b080-27f3-4520-ac57-8dd379d3af97" path="/var/lib/kubelet/pods/ada4b080-27f3-4520-ac57-8dd379d3af97/volumes"
Nov 04 02:44:48.609479 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:48.609454    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k"
Nov 04 02:44:48.753076 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:48.752968    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e0c33980-029c-47c2-9a85-4745b1255f6f-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e0c33980-029c-47c2-9a85-4745b1255f6f-maas-api-xks-ca\") pod \"e0c33980-029c-47c2-9a85-4745b1255f6f\" (UID: \"e0c33980-029c-47c2-9a85-4745b1255f6f\") "
Nov 04 02:44:48.753076 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:48.753043    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e0c33980-029c-47c2-9a85-4745b1255f6f-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e0c33980-029c-47c2-9a85-4745b1255f6f-maas-api-openshift-ca\") pod \"e0c33980-029c-47c2-9a85-4745b1255f6f\" (UID: \"e0c33980-029c-47c2-9a85-4745b1255f6f\") "
Nov 04 02:44:48.753329 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:48.753087    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e0c33980-029c-47c2-9a85-4745b1255f6f-kube-api-access-l9ssl\" (UniqueName: \"kubernetes.io/projected/e0c33980-029c-47c2-9a85-4745b1255f6f-kube-api-access-l9ssl\") pod \"e0c33980-029c-47c2-9a85-4745b1255f6f\" (UID: \"e0c33980-029c-47c2-9a85-4745b1255f6f\") "
Nov 04 02:44:48.753536 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:48.753480    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0c33980-029c-47c2-9a85-4745b1255f6f-maas-api-openshift-ca" pod "e0c33980-029c-47c2-9a85-4745b1255f6f" (UID: "e0c33980-029c-47c2-9a85-4745b1255f6f"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:44:48.753675 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:48.753632    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/e0c33980-029c-47c2-9a85-4745b1255f6f-maas-api-openshift-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:44:48.755508 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:48.755475    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0c33980-029c-47c2-9a85-4745b1255f6f-maas-api-xks-ca" pod "e0c33980-029c-47c2-9a85-4745b1255f6f" (UID: "e0c33980-029c-47c2-9a85-4745b1255f6f"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:44:48.755605 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:48.755520    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0c33980-029c-47c2-9a85-4745b1255f6f-kube-api-access-l9ssl" pod "e0c33980-029c-47c2-9a85-4745b1255f6f" (UID: "e0c33980-029c-47c2-9a85-4745b1255f6f"). InnerVolumeSpecName "kube-api-access-l9ssl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:44:48.855055 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:48.854996    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9ssl\" (UniqueName: \"kubernetes.io/projected/e0c33980-029c-47c2-9a85-4745b1255f6f-kube-api-access-l9ssl\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:44:48.855055 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:48.855048    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/e0c33980-029c-47c2-9a85-4745b1255f6f-maas-api-xks-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:44:49.468123 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:49.468081    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k" event={"ID":"e0c33980-029c-47c2-9a85-4745b1255f6f","Type":"ContainerDied","Data":"cd5b22afda7780c4b0e0fc2a8b87288441494bbefc43a0dca1e5afd2f833f3e5"}
Nov 04 02:44:49.468123 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:49.468113    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-1843228f-r9v4k"
Nov 04 02:44:49.468386 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:49.468134    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cd5b22afda7780c4b0e0fc2a8b87288441494bbefc43a0dca1e5afd2f833f3e5"
Nov 04 02:44:52.496881 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:44:52.496829    4548 projected.go:266] Couldn't get secret models-as-a-service/agc-cred-63866b33446b: secret "agc-cred-63866b33446b" not found
Nov 04 02:44:52.496881 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:44:52.496866    4548 projected.go:196] Error preparing data for projected volume provider-credentials for pod models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj: secret "agc-cred-63866b33446b" not found
Nov 04 02:44:52.497517 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:44:52.496923    4548 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials podName:09e06531-bcdc-436a-91d9-9c8748ee248b nodeName:}" failed. No retries permitted until 2026-11-04 02:46:54.496908321 +0000 UTC m=+1848.101921311 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "provider-credentials" (UniqueName: "kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials") pod "payload-processing-external-model-54f9d586c7-9k9pj" (UID: "09e06531-bcdc-436a-91d9-9c8748ee248b") : secret "agc-cred-63866b33446b" not found
Nov 04 02:44:53.049389 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:53.049344    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c"]
Nov 04 02:44:53.099870 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:53.099826    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-2747a4ad-vsv5c"]
Nov 04 02:44:54.523288 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:54.523249    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="4fed28ec-42fa-4ef4-b663-34aff2fea909" path="/var/lib/kubelet/pods/4fed28ec-42fa-4ef4-b663-34aff2fea909/volumes"
Nov 04 02:44:58.574155 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:44:58.574022    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"]
Nov 04 02:45:00.162639 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.162583    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22"]
Nov 04 02:45:00.163230 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.163212    4548 cpu_manager.go:414] "containerMap: removing container" podUID="2e5e1352-41be-436c-bd26-7ef9a0e7a85d" containerName="istio-proxy"
Nov 04 02:45:00.163282 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.163232    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2e5e1352-41be-436c-bd26-7ef9a0e7a85d" containerName="istio-proxy"
Nov 04 02:45:00.163282 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.163246    4548 cpu_manager.go:414] "containerMap: removing container" podUID="7d3cf0be-0fae-4452-824e-2cf91e1232c2" containerName="istio-proxy"
Nov 04 02:45:00.163282 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.163251    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7d3cf0be-0fae-4452-824e-2cf91e1232c2" containerName="istio-proxy"
Nov 04 02:45:00.163282 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.163262    4548 cpu_manager.go:414] "containerMap: removing container" podUID="e0c33980-029c-47c2-9a85-4745b1255f6f" containerName="revoke-keys"
Nov 04 02:45:00.163282 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.163268    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e0c33980-029c-47c2-9a85-4745b1255f6f" containerName="revoke-keys"
Nov 04 02:45:00.163441 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.163338    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="d7e95e09-f96e-4635-abe4-390c3fb16b6a" containerName="istio-proxy"
Nov 04 02:45:00.163441 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.163348    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="e0c33980-029c-47c2-9a85-4745b1255f6f" containerName="revoke-keys"
Nov 04 02:45:00.166472 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.166451    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts"]
Nov 04 02:45:00.166585 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.166568    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22"
Nov 04 02:45:00.170035 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.170014    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts"
Nov 04 02:45:00.170482 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.170457    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk"]
Nov 04 02:45:00.175985 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.175963    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk"
Nov 04 02:45:00.188628 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.188599    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a1fbbf2-0a43-4623-954c-b4f165987ab0-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22\" (UID: \"1a1fbbf2-0a43-4623-954c-b4f165987ab0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22"
Nov 04 02:45:00.188779 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.188639    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mhc2\" (UniqueName: \"kubernetes.io/projected/1a1fbbf2-0a43-4623-954c-b4f165987ab0-kube-api-access-8mhc2\") pod \"maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22\" (UID: \"1a1fbbf2-0a43-4623-954c-b4f165987ab0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22"
Nov 04 02:45:00.219149 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.219108    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:45:00.219367 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.219156    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:45:00.219367 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.219286    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:45:00.260455 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.260417    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22"]
Nov 04 02:45:00.275381 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.275350    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts"]
Nov 04 02:45:00.279269 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.279221    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk"]
Nov 04 02:45:00.290246 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.290216    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a1fbbf2-0a43-4623-954c-b4f165987ab0-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22\" (UID: \"1a1fbbf2-0a43-4623-954c-b4f165987ab0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22"
Nov 04 02:45:00.290418 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.290256    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02492a03-9e71-4280-9db9-75dcd25b3417-maas-api-service-ca\") pod \"maas-api-key-cleanup-29896005-b5stk\" (UID: \"02492a03-9e71-4280-9db9-75dcd25b3417\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk"
Nov 04 02:45:00.290418 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.290280    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mhc2\" (UniqueName: \"kubernetes.io/projected/1a1fbbf2-0a43-4623-954c-b4f165987ab0-kube-api-access-8mhc2\") pod \"maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22\" (UID: \"1a1fbbf2-0a43-4623-954c-b4f165987ab0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22"
Nov 04 02:45:00.290418 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.290309    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce058fc1-0235-4a1e-aea8-688df574bbcd-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts\" (UID: \"ce058fc1-0235-4a1e-aea8-688df574bbcd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts"
Nov 04 02:45:00.290556 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.290430    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mklb4\" (UniqueName: \"kubernetes.io/projected/02492a03-9e71-4280-9db9-75dcd25b3417-kube-api-access-mklb4\") pod \"maas-api-key-cleanup-29896005-b5stk\" (UID: \"02492a03-9e71-4280-9db9-75dcd25b3417\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk"
Nov 04 02:45:00.290556 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.290516    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dvzrz\" (UniqueName: \"kubernetes.io/projected/ce058fc1-0235-4a1e-aea8-688df574bbcd-kube-api-access-dvzrz\") pod \"maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts\" (UID: \"ce058fc1-0235-4a1e-aea8-688df574bbcd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts"
Nov 04 02:45:00.290954 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.290926    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a1fbbf2-0a43-4623-954c-b4f165987ab0-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22\" (UID: \"1a1fbbf2-0a43-4623-954c-b4f165987ab0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22"
Nov 04 02:45:00.351841 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.351812    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mhc2\" (UniqueName: \"kubernetes.io/projected/1a1fbbf2-0a43-4623-954c-b4f165987ab0-kube-api-access-8mhc2\") pod \"maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22\" (UID: \"1a1fbbf2-0a43-4623-954c-b4f165987ab0\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22"
Nov 04 02:45:00.391660 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.391612    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02492a03-9e71-4280-9db9-75dcd25b3417-maas-api-service-ca\") pod \"maas-api-key-cleanup-29896005-b5stk\" (UID: \"02492a03-9e71-4280-9db9-75dcd25b3417\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk"
Nov 04 02:45:00.391883 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.391674    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce058fc1-0235-4a1e-aea8-688df574bbcd-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts\" (UID: \"ce058fc1-0235-4a1e-aea8-688df574bbcd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts"
Nov 04 02:45:00.391883 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.391713    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mklb4\" (UniqueName: \"kubernetes.io/projected/02492a03-9e71-4280-9db9-75dcd25b3417-kube-api-access-mklb4\") pod \"maas-api-key-cleanup-29896005-b5stk\" (UID: \"02492a03-9e71-4280-9db9-75dcd25b3417\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk"
Nov 04 02:45:00.391883 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.391778    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dvzrz\" (UniqueName: \"kubernetes.io/projected/ce058fc1-0235-4a1e-aea8-688df574bbcd-kube-api-access-dvzrz\") pod \"maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts\" (UID: \"ce058fc1-0235-4a1e-aea8-688df574bbcd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts"
Nov 04 02:45:00.392521 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.392496    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02492a03-9e71-4280-9db9-75dcd25b3417-maas-api-service-ca\") pod \"maas-api-key-cleanup-29896005-b5stk\" (UID: \"02492a03-9e71-4280-9db9-75dcd25b3417\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk"
Nov 04 02:45:00.392613 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.392577    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce058fc1-0235-4a1e-aea8-688df574bbcd-maas-api-service-ca\") pod \"maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts\" (UID: \"ce058fc1-0235-4a1e-aea8-688df574bbcd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts"
Nov 04 02:45:00.453834 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.453753    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dvzrz\" (UniqueName: \"kubernetes.io/projected/ce058fc1-0235-4a1e-aea8-688df574bbcd-kube-api-access-dvzrz\") pod \"maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts\" (UID: \"ce058fc1-0235-4a1e-aea8-688df574bbcd\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts"
Nov 04 02:45:00.453834 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.453799    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mklb4\" (UniqueName: \"kubernetes.io/projected/02492a03-9e71-4280-9db9-75dcd25b3417-kube-api-access-mklb4\") pod \"maas-api-key-cleanup-29896005-b5stk\" (UID: \"02492a03-9e71-4280-9db9-75dcd25b3417\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk"
Nov 04 02:45:00.483958 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.483915    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22"
Nov 04 02:45:00.492344 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.492317    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts"
Nov 04 02:45:00.498536 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.498512    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk"
Nov 04 02:45:00.879716 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.879683    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22"]
Nov 04 02:45:00.880887 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:45:00.880851    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1fbbf2_0a43_4623_954c_b4f165987ab0.slice/crio-44a7b59d18671b779095a4ce50d6b8c86e5a49464eb640ea708b840bd98440af WatchSource:0}: Error finding container 44a7b59d18671b779095a4ce50d6b8c86e5a49464eb640ea708b840bd98440af: Status 404 returned error can't find the container with id 44a7b59d18671b779095a4ce50d6b8c86e5a49464eb640ea708b840bd98440af
Nov 04 02:45:00.928290 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.928257    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts"]
Nov 04 02:45:00.929632 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:45:00.929606    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce058fc1_0235_4a1e_aea8_688df574bbcd.slice/crio-f0aade86a4a8560e2f2c26fe5c008c7957ed452d337b43e48058358e523dd4da WatchSource:0}: Error finding container f0aade86a4a8560e2f2c26fe5c008c7957ed452d337b43e48058358e523dd4da: Status 404 returned error can't find the container with id f0aade86a4a8560e2f2c26fe5c008c7957ed452d337b43e48058358e523dd4da
Nov 04 02:45:00.931579 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:00.931558    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk"]
Nov 04 02:45:00.931812 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:45:00.931790    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02492a03_9e71_4280_9db9_75dcd25b3417.slice/crio-a33bab81b5595f4cf9681e31edac59d08a16285bf7ed9920979d44ba595f35be WatchSource:0}: Error finding container a33bab81b5595f4cf9681e31edac59d08a16285bf7ed9920979d44ba595f35be: Status 404 returned error can't find the container with id a33bab81b5595f4cf9681e31edac59d08a16285bf7ed9920979d44ba595f35be
Nov 04 02:45:01.556563 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:01.556519    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk" event={"ID":"02492a03-9e71-4280-9db9-75dcd25b3417","Type":"ContainerStarted","Data":"0f3575637fa1c590fc006d0e4f13cd8ce62129a258c4a3e51b5c907d305a968e"}
Nov 04 02:45:01.557007 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:01.556584    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk" event={"ID":"02492a03-9e71-4280-9db9-75dcd25b3417","Type":"ContainerStarted","Data":"a33bab81b5595f4cf9681e31edac59d08a16285bf7ed9920979d44ba595f35be"}
Nov 04 02:45:01.558382 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:01.558355    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts" event={"ID":"ce058fc1-0235-4a1e-aea8-688df574bbcd","Type":"ContainerStarted","Data":"520bd8f22cd2033f0d12c06530fd7c132383244dd72fc797802af7a9adca8c2d"}
Nov 04 02:45:01.558535 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:01.558411    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts" event={"ID":"ce058fc1-0235-4a1e-aea8-688df574bbcd","Type":"ContainerStarted","Data":"f0aade86a4a8560e2f2c26fe5c008c7957ed452d337b43e48058358e523dd4da"}
Nov 04 02:45:01.560021 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:01.559997    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22" event={"ID":"1a1fbbf2-0a43-4623-954c-b4f165987ab0","Type":"ContainerStarted","Data":"64503f750be43d34c7f62e3eb95b7e7068bfe2efa71a04e5896715e5b49f3d07"}
Nov 04 02:45:01.560130 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:01.560036    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22" event={"ID":"1a1fbbf2-0a43-4623-954c-b4f165987ab0","Type":"ContainerStarted","Data":"44a7b59d18671b779095a4ce50d6b8c86e5a49464eb640ea708b840bd98440af"}
Nov 04 02:45:01.675049 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:01.674988    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk" podStartSLOduration=1.674972533 podStartE2EDuration="1.674972533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:45:01.672328319 +0000 UTC m=+1735.277341318" watchObservedRunningTime="2026-11-04 02:45:01.674972533 +0000 UTC m=+1735.279985544"
Nov 04 02:45:01.790602 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:01.790543    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22" podStartSLOduration=1.7905262199999998 podStartE2EDuration="1.79052622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:45:01.787705367 +0000 UTC m=+1735.392718367" watchObservedRunningTime="2026-11-04 02:45:01.79052622 +0000 UTC m=+1735.395539218"
Nov 04 02:45:01.903762 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:01.903652    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts" podStartSLOduration=1.9036366500000002 podStartE2EDuration="1.90363665s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:45:01.903387776 +0000 UTC m=+1735.508400773" watchObservedRunningTime="2026-11-04 02:45:01.90363665 +0000 UTC m=+1735.508649648"
Nov 04 02:45:02.569349 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:02.569305    4548 generic.go:356] "Generic (PLEG): container finished" podID="ce058fc1-0235-4a1e-aea8-688df574bbcd" containerID="520bd8f22cd2033f0d12c06530fd7c132383244dd72fc797802af7a9adca8c2d" exitCode=60
Nov 04 02:45:02.569887 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:02.569415    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts" event={"ID":"ce058fc1-0235-4a1e-aea8-688df574bbcd","Type":"ContainerDied","Data":"520bd8f22cd2033f0d12c06530fd7c132383244dd72fc797802af7a9adca8c2d"}
Nov 04 02:45:02.569887 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:02.569750    4548 scope.go:122] "RemoveContainer" containerID="520bd8f22cd2033f0d12c06530fd7c132383244dd72fc797802af7a9adca8c2d"
Nov 04 02:45:02.571592 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:02.571484    4548 generic.go:356] "Generic (PLEG): container finished" podID="1a1fbbf2-0a43-4623-954c-b4f165987ab0" containerID="64503f750be43d34c7f62e3eb95b7e7068bfe2efa71a04e5896715e5b49f3d07" exitCode=60
Nov 04 02:45:02.571592 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:02.571571    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22" event={"ID":"1a1fbbf2-0a43-4623-954c-b4f165987ab0","Type":"ContainerDied","Data":"64503f750be43d34c7f62e3eb95b7e7068bfe2efa71a04e5896715e5b49f3d07"}
Nov 04 02:45:02.571849 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:02.571828    4548 scope.go:122] "RemoveContainer" containerID="64503f750be43d34c7f62e3eb95b7e7068bfe2efa71a04e5896715e5b49f3d07"
Nov 04 02:45:02.573800 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:02.573778    4548 generic.go:356] "Generic (PLEG): container finished" podID="02492a03-9e71-4280-9db9-75dcd25b3417" containerID="0f3575637fa1c590fc006d0e4f13cd8ce62129a258c4a3e51b5c907d305a968e" exitCode=60
Nov 04 02:45:02.573935 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:02.573902    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk" event={"ID":"02492a03-9e71-4280-9db9-75dcd25b3417","Type":"ContainerDied","Data":"0f3575637fa1c590fc006d0e4f13cd8ce62129a258c4a3e51b5c907d305a968e"}
Nov 04 02:45:02.574095 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:02.574078    4548 scope.go:122] "RemoveContainer" containerID="0f3575637fa1c590fc006d0e4f13cd8ce62129a258c4a3e51b5c907d305a968e"
Nov 04 02:45:03.574412 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.574365    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj" podUID="09e06531-bcdc-436a-91d9-9c8748ee248b" containerName="payload-processing" containerID="cri-o://0fce57d390289e303b8868af15306c918637d07e44541b65e4ab91312d3d3700" gracePeriod=25
Nov 04 02:45:03.584906 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.584863    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk" event={"ID":"02492a03-9e71-4280-9db9-75dcd25b3417","Type":"ContainerStarted","Data":"603f03e3dcf648d636efbb5675fb19563760adaeaa5fb3668b02f8b1b9e1ff5f"}
Nov 04 02:45:03.587620 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.587587    4548 generic.go:356] "Generic (PLEG): container finished" podID="ce058fc1-0235-4a1e-aea8-688df574bbcd" containerID="9976b894cb506ab9d464fff145cf8f196c6a17e8d9f8a7d6f1770b7856fff304" exitCode=60
Nov 04 02:45:03.587784 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.587670    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts" event={"ID":"ce058fc1-0235-4a1e-aea8-688df574bbcd","Type":"ContainerDied","Data":"9976b894cb506ab9d464fff145cf8f196c6a17e8d9f8a7d6f1770b7856fff304"}
Nov 04 02:45:03.587784 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.587731    4548 scope.go:122] "RemoveContainer" containerID="520bd8f22cd2033f0d12c06530fd7c132383244dd72fc797802af7a9adca8c2d"
Nov 04 02:45:03.588013 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.587994    4548 scope.go:122] "RemoveContainer" containerID="9976b894cb506ab9d464fff145cf8f196c6a17e8d9f8a7d6f1770b7856fff304"
Nov 04 02:45:03.588313 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:45:03.588293    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts_odh-ai-gateway-infra(ce058fc1-0235-4a1e-aea8-688df574bbcd)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts" podUID="ce058fc1-0235-4a1e-aea8-688df574bbcd"
Nov 04 02:45:03.590199 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.590158    4548 generic.go:356] "Generic (PLEG): container finished" podID="1a1fbbf2-0a43-4623-954c-b4f165987ab0" containerID="ac3f03046bf85629edb6ae0e26b605d518b9678389d68c392c60f093f41915f7" exitCode=60
Nov 04 02:45:03.590314 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.590227    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22" event={"ID":"1a1fbbf2-0a43-4623-954c-b4f165987ab0","Type":"ContainerDied","Data":"ac3f03046bf85629edb6ae0e26b605d518b9678389d68c392c60f093f41915f7"}
Nov 04 02:45:03.590534 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.590518    4548 scope.go:122] "RemoveContainer" containerID="ac3f03046bf85629edb6ae0e26b605d518b9678389d68c392c60f093f41915f7"
Nov 04 02:45:03.590806 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:45:03.590789    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22_odh-ai-gateway-infra(1a1fbbf2-0a43-4623-954c-b4f165987ab0)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22" podUID="1a1fbbf2-0a43-4623-954c-b4f165987ab0"
Nov 04 02:45:03.799740 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.798320    4548 scope.go:122] "RemoveContainer" containerID="64503f750be43d34c7f62e3eb95b7e7068bfe2efa71a04e5896715e5b49f3d07"
Nov 04 02:45:03.857267 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.857240    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"
Nov 04 02:45:03.938365 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.938327    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/09e06531-bcdc-436a-91d9-9c8748ee248b-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09e06531-bcdc-436a-91d9-9c8748ee248b-plugins-config-volume\") pod \"09e06531-bcdc-436a-91d9-9c8748ee248b\" (UID: \"09e06531-bcdc-436a-91d9-9c8748ee248b\") "
Nov 04 02:45:03.938592 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.938413    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials\" (UniqueName: \"kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials\") pod \"09e06531-bcdc-436a-91d9-9c8748ee248b\" (UID: \"09e06531-bcdc-436a-91d9-9c8748ee248b\") "
Nov 04 02:45:03.938592 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.938482    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/09e06531-bcdc-436a-91d9-9c8748ee248b-routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/09e06531-bcdc-436a-91d9-9c8748ee248b-routing-overlay-volume\") pod \"09e06531-bcdc-436a-91d9-9c8748ee248b\" (UID: \"09e06531-bcdc-436a-91d9-9c8748ee248b\") "
Nov 04 02:45:03.938729 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.938631    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-kube-api-access-lmnnr\" (UniqueName: \"kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-kube-api-access-lmnnr\") pod \"09e06531-bcdc-436a-91d9-9c8748ee248b\" (UID: \"09e06531-bcdc-436a-91d9-9c8748ee248b\") "
Nov 04 02:45:03.939210 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.939125    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09e06531-bcdc-436a-91d9-9c8748ee248b-routing-overlay-volume" pod "09e06531-bcdc-436a-91d9-9c8748ee248b" (UID: "09e06531-bcdc-436a-91d9-9c8748ee248b"). InnerVolumeSpecName "routing-overlay-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:45:03.939631 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.939603    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09e06531-bcdc-436a-91d9-9c8748ee248b-plugins-config-volume" pod "09e06531-bcdc-436a-91d9-9c8748ee248b" (UID: "09e06531-bcdc-436a-91d9-9c8748ee248b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:45:03.941581 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.941556    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-kube-api-access-lmnnr" pod "09e06531-bcdc-436a-91d9-9c8748ee248b" (UID: "09e06531-bcdc-436a-91d9-9c8748ee248b"). InnerVolumeSpecName "kube-api-access-lmnnr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:45:03.941707 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:03.941621    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials" pod "09e06531-bcdc-436a-91d9-9c8748ee248b" (UID: "09e06531-bcdc-436a-91d9-9c8748ee248b"). InnerVolumeSpecName "provider-credentials". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:45:04.040832 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.040790    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lmnnr\" (UniqueName: \"kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-kube-api-access-lmnnr\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:04.041226 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.041204    4548 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/09e06531-bcdc-436a-91d9-9c8748ee248b-plugins-config-volume\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:04.041559 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.041537    4548 reconciler_common.go:299] "Volume detached for volume \"provider-credentials\" (UniqueName: \"kubernetes.io/projected/09e06531-bcdc-436a-91d9-9c8748ee248b-provider-credentials\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:04.041682 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.041670    4548 reconciler_common.go:299] "Volume detached for volume \"routing-overlay-volume\" (UniqueName: \"kubernetes.io/configmap/09e06531-bcdc-436a-91d9-9c8748ee248b-routing-overlay-volume\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:04.065394 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.065232    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2"]
Nov 04 02:45:04.065394 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.065301    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-9859d220-x6zz2"]
Nov 04 02:45:04.529336 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.529306    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d276ead2-d5ad-445a-b0f1-61390b3c6afd" path="/var/lib/kubelet/pods/d276ead2-d5ad-445a-b0f1-61390b3c6afd/volumes"
Nov 04 02:45:04.607198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.604563    4548 generic.go:356] "Generic (PLEG): container finished" podID="02492a03-9e71-4280-9db9-75dcd25b3417" containerID="603f03e3dcf648d636efbb5675fb19563760adaeaa5fb3668b02f8b1b9e1ff5f" exitCode=60
Nov 04 02:45:04.607198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.604781    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk" event={"ID":"02492a03-9e71-4280-9db9-75dcd25b3417","Type":"ContainerDied","Data":"603f03e3dcf648d636efbb5675fb19563760adaeaa5fb3668b02f8b1b9e1ff5f"}
Nov 04 02:45:04.607198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.604884    4548 scope.go:122] "RemoveContainer" containerID="0f3575637fa1c590fc006d0e4f13cd8ce62129a258c4a3e51b5c907d305a968e"
Nov 04 02:45:04.607198 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.605533    4548 scope.go:122] "RemoveContainer" containerID="603f03e3dcf648d636efbb5675fb19563760adaeaa5fb3668b02f8b1b9e1ff5f"
Nov 04 02:45:04.607198 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:45:04.605873    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29896005-b5stk_odh-ai-gateway-infra(02492a03-9e71-4280-9db9-75dcd25b3417)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk" podUID="02492a03-9e71-4280-9db9-75dcd25b3417"
Nov 04 02:45:04.609722 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.609689    4548 generic.go:356] "Generic (PLEG): container finished" podID="09e06531-bcdc-436a-91d9-9c8748ee248b" containerID="0fce57d390289e303b8868af15306c918637d07e44541b65e4ab91312d3d3700" exitCode=0
Nov 04 02:45:04.609995 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.609969    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj" event={"ID":"09e06531-bcdc-436a-91d9-9c8748ee248b","Type":"ContainerDied","Data":"0fce57d390289e303b8868af15306c918637d07e44541b65e4ab91312d3d3700"}
Nov 04 02:45:04.610200 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.610157    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj" event={"ID":"09e06531-bcdc-436a-91d9-9c8748ee248b","Type":"ContainerDied","Data":"48d1a7a6532aa143fb5ebd3eef20b9571a0b58fe0cde63c73c14b6cb9a541bd2"}
Nov 04 02:45:04.610410 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.610393    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"
Nov 04 02:45:04.628205 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.628153    4548 scope.go:122] "RemoveContainer" containerID="9976b894cb506ab9d464fff145cf8f196c6a17e8d9f8a7d6f1770b7856fff304"
Nov 04 02:45:04.628915 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:45:04.628867    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts_odh-ai-gateway-infra(ce058fc1-0235-4a1e-aea8-688df574bbcd)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts" podUID="ce058fc1-0235-4a1e-aea8-688df574bbcd"
Nov 04 02:45:04.632969 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.632941    4548 scope.go:122] "RemoveContainer" containerID="ac3f03046bf85629edb6ae0e26b605d518b9678389d68c392c60f093f41915f7"
Nov 04 02:45:04.633751 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:45:04.633722    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22_odh-ai-gateway-infra(1a1fbbf2-0a43-4623-954c-b4f165987ab0)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22" podUID="1a1fbbf2-0a43-4623-954c-b4f165987ab0"
Nov 04 02:45:04.644435 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.644406    4548 scope.go:122] "RemoveContainer" containerID="0fce57d390289e303b8868af15306c918637d07e44541b65e4ab91312d3d3700"
Nov 04 02:45:04.655843 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.655819    4548 scope.go:122] "RemoveContainer" containerID="0fce57d390289e303b8868af15306c918637d07e44541b65e4ab91312d3d3700"
Nov 04 02:45:04.656284 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:45:04.656249    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fce57d390289e303b8868af15306c918637d07e44541b65e4ab91312d3d3700\": container with ID starting with 0fce57d390289e303b8868af15306c918637d07e44541b65e4ab91312d3d3700 not found: ID does not exist" containerID="0fce57d390289e303b8868af15306c918637d07e44541b65e4ab91312d3d3700"
Nov 04 02:45:04.656379 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:04.656302    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fce57d390289e303b8868af15306c918637d07e44541b65e4ab91312d3d3700"} err="failed to get container status \"0fce57d390289e303b8868af15306c918637d07e44541b65e4ab91312d3d3700\": rpc error: code = NotFound desc = could not find container \"0fce57d390289e303b8868af15306c918637d07e44541b65e4ab91312d3d3700\": container with ID starting with 0fce57d390289e303b8868af15306c918637d07e44541b65e4ab91312d3d3700 not found: ID does not exist"
Nov 04 02:45:05.088202 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:05.087223    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"]
Nov 04 02:45:05.093230 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:05.092628    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["models-as-a-service/payload-processing-external-model-54f9d586c7-9k9pj"]
Nov 04 02:45:05.657196 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:05.656936    4548 scope.go:122] "RemoveContainer" containerID="603f03e3dcf648d636efbb5675fb19563760adaeaa5fb3668b02f8b1b9e1ff5f"
Nov 04 02:45:05.657756 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:45:05.657291    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-29896005-b5stk_odh-ai-gateway-infra(02492a03-9e71-4280-9db9-75dcd25b3417)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk" podUID="02492a03-9e71-4280-9db9-75dcd25b3417"
Nov 04 02:45:06.549601 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:06.549559    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="09e06531-bcdc-436a-91d9-9c8748ee248b" path="/var/lib/kubelet/pods/09e06531-bcdc-436a-91d9-9c8748ee248b/volumes"
Nov 04 02:45:07.102753 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:07.102702    4548 scope.go:122] "RemoveContainer" containerID="72ca8a6ae1fec78ab453e1dda62ff2b3c2e5f86e1cd2fa74d7c8b409180962e6"
Nov 04 02:45:09.075220 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:09.070550    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22"]
Nov 04 02:45:09.117930 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:09.117889    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-17f11f27-jcf22"]
Nov 04 02:45:10.524091 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:10.524054    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="17c94039-ee51-461e-ac27-94bbb01d9f79" path="/var/lib/kubelet/pods/17c94039-ee51-461e-ac27-94bbb01d9f79/volumes"
Nov 04 02:45:10.611187 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:45:10.611135    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:45:14.517535 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:14.517496    4548 scope.go:122] "RemoveContainer" containerID="603f03e3dcf648d636efbb5675fb19563760adaeaa5fb3668b02f8b1b9e1ff5f"
Nov 04 02:45:15.517113 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:15.517085    4548 scope.go:122] "RemoveContainer" containerID="9976b894cb506ab9d464fff145cf8f196c6a17e8d9f8a7d6f1770b7856fff304"
Nov 04 02:45:15.749193 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:15.749146    4548 generic.go:356] "Generic (PLEG): container finished" podID="02492a03-9e71-4280-9db9-75dcd25b3417" containerID="ceb58a97b803a51109e4d29f71bbac2aeafa6f37ad70f6f72730fbb95ce1d6b3" exitCode=60
Nov 04 02:45:15.749630 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:15.749210    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk" event={"ID":"02492a03-9e71-4280-9db9-75dcd25b3417","Type":"ContainerDied","Data":"ceb58a97b803a51109e4d29f71bbac2aeafa6f37ad70f6f72730fbb95ce1d6b3"}
Nov 04 02:45:15.749630 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:15.749273    4548 scope.go:122] "RemoveContainer" containerID="603f03e3dcf648d636efbb5675fb19563760adaeaa5fb3668b02f8b1b9e1ff5f"
Nov 04 02:45:15.749729 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:15.749667    4548 scope.go:122] "RemoveContainer" containerID="ceb58a97b803a51109e4d29f71bbac2aeafa6f37ad70f6f72730fbb95ce1d6b3"
Nov 04 02:45:15.749971 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:45:15.749945    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-29896005-b5stk_odh-ai-gateway-infra(02492a03-9e71-4280-9db9-75dcd25b3417)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk" podUID="02492a03-9e71-4280-9db9-75dcd25b3417"
Nov 04 02:45:16.758469 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:16.758372    4548 generic.go:356] "Generic (PLEG): container finished" podID="ce058fc1-0235-4a1e-aea8-688df574bbcd" containerID="add20cacd64ffb7032ae90c0d41b4b0411c2219fa35dfc7911502d739d2da114" exitCode=60
Nov 04 02:45:16.758469 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:16.758453    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts" event={"ID":"ce058fc1-0235-4a1e-aea8-688df574bbcd","Type":"ContainerDied","Data":"add20cacd64ffb7032ae90c0d41b4b0411c2219fa35dfc7911502d739d2da114"}
Nov 04 02:45:16.758986 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:16.758525    4548 scope.go:122] "RemoveContainer" containerID="9976b894cb506ab9d464fff145cf8f196c6a17e8d9f8a7d6f1770b7856fff304"
Nov 04 02:45:16.758986 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:16.758905    4548 scope.go:122] "RemoveContainer" containerID="add20cacd64ffb7032ae90c0d41b4b0411c2219fa35dfc7911502d739d2da114"
Nov 04 02:45:16.759292 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:45:16.759265    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts_odh-ai-gateway-infra(ce058fc1-0235-4a1e-aea8-688df574bbcd)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts" podUID="ce058fc1-0235-4a1e-aea8-688df574bbcd"
Nov 04 02:45:16.875780 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:16.875741    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk"]
Nov 04 02:45:17.025976 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:17.025942    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk"
Nov 04 02:45:17.081425 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:17.081391    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/02492a03-9e71-4280-9db9-75dcd25b3417-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02492a03-9e71-4280-9db9-75dcd25b3417-maas-api-service-ca\") pod \"02492a03-9e71-4280-9db9-75dcd25b3417\" (UID: \"02492a03-9e71-4280-9db9-75dcd25b3417\") "
Nov 04 02:45:17.081646 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:17.081540    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/02492a03-9e71-4280-9db9-75dcd25b3417-kube-api-access-mklb4\" (UniqueName: \"kubernetes.io/projected/02492a03-9e71-4280-9db9-75dcd25b3417-kube-api-access-mklb4\") pod \"02492a03-9e71-4280-9db9-75dcd25b3417\" (UID: \"02492a03-9e71-4280-9db9-75dcd25b3417\") "
Nov 04 02:45:17.081801 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:17.081776    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02492a03-9e71-4280-9db9-75dcd25b3417-maas-api-service-ca" pod "02492a03-9e71-4280-9db9-75dcd25b3417" (UID: "02492a03-9e71-4280-9db9-75dcd25b3417"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:45:17.081895 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:17.081882    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02492a03-9e71-4280-9db9-75dcd25b3417-maas-api-service-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:17.083798 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:17.083770    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02492a03-9e71-4280-9db9-75dcd25b3417-kube-api-access-mklb4" pod "02492a03-9e71-4280-9db9-75dcd25b3417" (UID: "02492a03-9e71-4280-9db9-75dcd25b3417"). InnerVolumeSpecName "kube-api-access-mklb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:45:17.183362 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:17.183329    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mklb4\" (UniqueName: \"kubernetes.io/projected/02492a03-9e71-4280-9db9-75dcd25b3417-kube-api-access-mklb4\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:17.517103 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:17.517027    4548 scope.go:122] "RemoveContainer" containerID="ac3f03046bf85629edb6ae0e26b605d518b9678389d68c392c60f093f41915f7"
Nov 04 02:45:17.768695 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:17.768621    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk"
Nov 04 02:45:17.768695 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:17.768642    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk" event={"ID":"02492a03-9e71-4280-9db9-75dcd25b3417","Type":"ContainerDied","Data":"a33bab81b5595f4cf9681e31edac59d08a16285bf7ed9920979d44ba595f35be"}
Nov 04 02:45:17.769211 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:17.768741    4548 scope.go:122] "RemoveContainer" containerID="ceb58a97b803a51109e4d29f71bbac2aeafa6f37ad70f6f72730fbb95ce1d6b3"
Nov 04 02:45:17.905299 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:17.905261    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts"]
Nov 04 02:45:17.985744 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:17.985704    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk"]
Nov 04 02:45:17.998009 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:17.997974    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29896005-b5stk"]
Nov 04 02:45:18.056545 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:18.056506    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts"
Nov 04 02:45:18.194251 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:18.194210    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ce058fc1-0235-4a1e-aea8-688df574bbcd-kube-api-access-dvzrz\" (UniqueName: \"kubernetes.io/projected/ce058fc1-0235-4a1e-aea8-688df574bbcd-kube-api-access-dvzrz\") pod \"ce058fc1-0235-4a1e-aea8-688df574bbcd\" (UID: \"ce058fc1-0235-4a1e-aea8-688df574bbcd\") "
Nov 04 02:45:18.194446 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:18.194280    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ce058fc1-0235-4a1e-aea8-688df574bbcd-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce058fc1-0235-4a1e-aea8-688df574bbcd-maas-api-service-ca\") pod \"ce058fc1-0235-4a1e-aea8-688df574bbcd\" (UID: \"ce058fc1-0235-4a1e-aea8-688df574bbcd\") "
Nov 04 02:45:18.194668 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:18.194640    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce058fc1-0235-4a1e-aea8-688df574bbcd-maas-api-service-ca" pod "ce058fc1-0235-4a1e-aea8-688df574bbcd" (UID: "ce058fc1-0235-4a1e-aea8-688df574bbcd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:45:18.197026 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:18.196967    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce058fc1-0235-4a1e-aea8-688df574bbcd-kube-api-access-dvzrz" pod "ce058fc1-0235-4a1e-aea8-688df574bbcd" (UID: "ce058fc1-0235-4a1e-aea8-688df574bbcd"). InnerVolumeSpecName "kube-api-access-dvzrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:45:18.295461 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:18.295384    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dvzrz\" (UniqueName: \"kubernetes.io/projected/ce058fc1-0235-4a1e-aea8-688df574bbcd-kube-api-access-dvzrz\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:18.295461 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:18.295413    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce058fc1-0235-4a1e-aea8-688df574bbcd-maas-api-service-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:18.523918 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:18.523884    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="02492a03-9e71-4280-9db9-75dcd25b3417" path="/var/lib/kubelet/pods/02492a03-9e71-4280-9db9-75dcd25b3417/volumes"
Nov 04 02:45:18.778959 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:18.778927    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts"
Nov 04 02:45:18.778959 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:18.778943    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts" event={"ID":"ce058fc1-0235-4a1e-aea8-688df574bbcd","Type":"ContainerDied","Data":"f0aade86a4a8560e2f2c26fe5c008c7957ed452d337b43e48058358e523dd4da"}
Nov 04 02:45:18.779548 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:18.779013    4548 scope.go:122] "RemoveContainer" containerID="add20cacd64ffb7032ae90c0d41b4b0411c2219fa35dfc7911502d739d2da114"
Nov 04 02:45:18.781482 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:18.781453    4548 generic.go:356] "Generic (PLEG): container finished" podID="1a1fbbf2-0a43-4623-954c-b4f165987ab0" containerID="a2d9daf0ca7f6e2be8eb91a20c2e0a2f9773792e97aee1ad9ece4757f3160313" exitCode=60
Nov 04 02:45:18.781668 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:18.781547    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22" event={"ID":"1a1fbbf2-0a43-4623-954c-b4f165987ab0","Type":"ContainerDied","Data":"a2d9daf0ca7f6e2be8eb91a20c2e0a2f9773792e97aee1ad9ece4757f3160313"}
Nov 04 02:45:18.782080 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:18.782061    4548 scope.go:122] "RemoveContainer" containerID="a2d9daf0ca7f6e2be8eb91a20c2e0a2f9773792e97aee1ad9ece4757f3160313"
Nov 04 02:45:18.782409 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:45:18.782389    4548 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 20s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22_odh-ai-gateway-infra(1a1fbbf2-0a43-4623-954c-b4f165987ab0)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22" podUID="1a1fbbf2-0a43-4623-954c-b4f165987ab0"
Nov 04 02:45:18.789257 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:18.789235    4548 scope.go:122] "RemoveContainer" containerID="ac3f03046bf85629edb6ae0e26b605d518b9678389d68c392c60f093f41915f7"
Nov 04 02:45:19.062478 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:19.062393    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts"]
Nov 04 02:45:19.066442 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:19.066414    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-b-3353a6-29896005-plrts"]
Nov 04 02:45:19.163877 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:19.163840    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22"]
Nov 04 02:45:19.937591 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:19.937563    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22"
Nov 04 02:45:20.027448 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:20.027412    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1a1fbbf2-0a43-4623-954c-b4f165987ab0-kube-api-access-8mhc2\" (UniqueName: \"kubernetes.io/projected/1a1fbbf2-0a43-4623-954c-b4f165987ab0-kube-api-access-8mhc2\") pod \"1a1fbbf2-0a43-4623-954c-b4f165987ab0\" (UID: \"1a1fbbf2-0a43-4623-954c-b4f165987ab0\") "
Nov 04 02:45:20.028240 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:20.028151    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1a1fbbf2-0a43-4623-954c-b4f165987ab0-maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a1fbbf2-0a43-4623-954c-b4f165987ab0-maas-api-service-ca\") pod \"1a1fbbf2-0a43-4623-954c-b4f165987ab0\" (UID: \"1a1fbbf2-0a43-4623-954c-b4f165987ab0\") "
Nov 04 02:45:20.028799 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:20.028752    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a1fbbf2-0a43-4623-954c-b4f165987ab0-maas-api-service-ca" pod "1a1fbbf2-0a43-4623-954c-b4f165987ab0" (UID: "1a1fbbf2-0a43-4623-954c-b4f165987ab0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:45:20.032434 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:20.032402    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1a1fbbf2-0a43-4623-954c-b4f165987ab0-maas-api-service-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:20.034459 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:20.034419    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a1fbbf2-0a43-4623-954c-b4f165987ab0-kube-api-access-8mhc2" pod "1a1fbbf2-0a43-4623-954c-b4f165987ab0" (UID: "1a1fbbf2-0a43-4623-954c-b4f165987ab0"). InnerVolumeSpecName "kube-api-access-8mhc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:45:20.133656 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:20.133563    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mhc2\" (UniqueName: \"kubernetes.io/projected/1a1fbbf2-0a43-4623-954c-b4f165987ab0-kube-api-access-8mhc2\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:20.523055 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:20.523024    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ce058fc1-0235-4a1e-aea8-688df574bbcd" path="/var/lib/kubelet/pods/ce058fc1-0235-4a1e-aea8-688df574bbcd/volumes"
Nov 04 02:45:20.807558 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:20.807462    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22" event={"ID":"1a1fbbf2-0a43-4623-954c-b4f165987ab0","Type":"ContainerDied","Data":"44a7b59d18671b779095a4ce50d6b8c86e5a49464eb640ea708b840bd98440af"}
Nov 04 02:45:20.807706 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:20.807558    4548 scope.go:122] "RemoveContainer" containerID="a2d9daf0ca7f6e2be8eb91a20c2e0a2f9773792e97aee1ad9ece4757f3160313"
Nov 04 02:45:20.807706 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:20.807484    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22"
Nov 04 02:45:20.973798 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:20.973759    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22"]
Nov 04 02:45:21.024195 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:21.024147    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-extmod-a-80b404-29896005-5lr22"]
Nov 04 02:45:22.523240 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:22.523161    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1a1fbbf2-0a43-4623-954c-b4f165987ab0" path="/var/lib/kubelet/pods/1a1fbbf2-0a43-4623-954c-b4f165987ab0/volumes"
Nov 04 02:45:30.430899 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:30.430853    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"]
Nov 04 02:45:30.431432 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:30.431144    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd" podUID="ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" containerName="istio-proxy" containerID="cri-o://98f7d8ecbeb06601663ba4b2c214c8830224c407f2dfdb985ffd339a28425029" gracePeriod=30
Nov 04 02:45:34.213126 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:34.213022    4548 patch_prober.go:29] interesting pod/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Nov 04 02:45:34.213126 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:34.213110    4548 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd" podUID="ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Nov 04 02:45:35.691458 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.691383    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:45:35.810605 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.810562    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-workload-certs\") pod \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") "
Nov 04 02:45:35.810789 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.810622    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istiod-ca-cert\") pod \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") "
Nov 04 02:45:35.810789 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.810670    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-workload-socket\") pod \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") "
Nov 04 02:45:35.810789 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.810728    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-data\") pod \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") "
Nov 04 02:45:35.810789 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.810766    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-envoy\") pod \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") "
Nov 04 02:45:35.811017 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.810801    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-credential-socket\") pod \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") "
Nov 04 02:45:35.811017 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.810827    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-token\" (UniqueName: \"kubernetes.io/projected/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-token\") pod \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") "
Nov 04 02:45:35.811017 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.810894    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-workload-certs" pod "ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" (UID: "ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:45:35.811017 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.810922    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-podinfo\") pod \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") "
Nov 04 02:45:35.811017 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.810977    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-kube-api-access-pl8zz\" (UniqueName: \"kubernetes.io/projected/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-kube-api-access-pl8zz\") pod \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\" (UID: \"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6\") "
Nov 04 02:45:35.811312 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.811092    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-workload-socket" pod "ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" (UID: "ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:45:35.811312 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.811104    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-data" pod "ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" (UID: "ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:45:35.811312 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.811145    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-credential-socket" pod "ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" (UID: "ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:45:35.811312 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.811217    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istiod-ca-cert" pod "ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" (UID: "ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:45:35.811508 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.811428    4548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-credential-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:35.811508 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.811446    4548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-workload-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:35.811508 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.811454    4548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istiod-ca-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:35.811508 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.811463    4548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-workload-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:35.811508 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.811472    4548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-data\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:35.813271 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.813239    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-envoy" pod "ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" (UID: "ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:45:35.813397 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.813273    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-token" pod "ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" (UID: "ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:45:35.813727 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.813704    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-podinfo" pod "ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" (UID: "ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:45:35.813727 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.813717    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-kube-api-access-pl8zz" pod "ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" (UID: "ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6"). InnerVolumeSpecName "kube-api-access-pl8zz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:45:35.912487 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.912450    4548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-podinfo\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:35.912487 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.912481    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl8zz\" (UniqueName: \"kubernetes.io/projected/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-kube-api-access-pl8zz\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:35.912487 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.912492    4548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-envoy\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:35.912733 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.912501    4548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6-istio-token\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:35.915543 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.915507    4548 generic.go:356] "Generic (PLEG): container finished" podID="ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" containerID="98f7d8ecbeb06601663ba4b2c214c8830224c407f2dfdb985ffd339a28425029" exitCode=0
Nov 04 02:45:35.915692 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.915566    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"
Nov 04 02:45:35.915692 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.915606    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd" event={"ID":"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6","Type":"ContainerDied","Data":"98f7d8ecbeb06601663ba4b2c214c8830224c407f2dfdb985ffd339a28425029"}
Nov 04 02:45:35.915692 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.915670    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd" event={"ID":"ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6","Type":"ContainerDied","Data":"b7f15936b46995aa05d2a455bdff8769b3fb288356050e101d9cc403f671a8ca"}
Nov 04 02:45:35.915799 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.915694    4548 scope.go:122] "RemoveContainer" containerID="98f7d8ecbeb06601663ba4b2c214c8830224c407f2dfdb985ffd339a28425029"
Nov 04 02:45:35.926488 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.926465    4548 scope.go:122] "RemoveContainer" containerID="14646dc3bf7c708df4b510f5a26d5c9db4b2ec8092c11872257095fc89a4ff5b"
Nov 04 02:45:35.939512 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.939492    4548 scope.go:122] "RemoveContainer" containerID="98f7d8ecbeb06601663ba4b2c214c8830224c407f2dfdb985ffd339a28425029"
Nov 04 02:45:35.940134 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:45:35.940106    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"98f7d8ecbeb06601663ba4b2c214c8830224c407f2dfdb985ffd339a28425029\": container with ID starting with 98f7d8ecbeb06601663ba4b2c214c8830224c407f2dfdb985ffd339a28425029 not found: ID does not exist" containerID="98f7d8ecbeb06601663ba4b2c214c8830224c407f2dfdb985ffd339a28425029"
Nov 04 02:45:35.940272 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.940142    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"98f7d8ecbeb06601663ba4b2c214c8830224c407f2dfdb985ffd339a28425029"} err="failed to get container status \"98f7d8ecbeb06601663ba4b2c214c8830224c407f2dfdb985ffd339a28425029\": rpc error: code = NotFound desc = could not find container \"98f7d8ecbeb06601663ba4b2c214c8830224c407f2dfdb985ffd339a28425029\": container with ID starting with 98f7d8ecbeb06601663ba4b2c214c8830224c407f2dfdb985ffd339a28425029 not found: ID does not exist"
Nov 04 02:45:35.940272 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.940161    4548 scope.go:122] "RemoveContainer" containerID="14646dc3bf7c708df4b510f5a26d5c9db4b2ec8092c11872257095fc89a4ff5b"
Nov 04 02:45:35.940523 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:45:35.940500    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14646dc3bf7c708df4b510f5a26d5c9db4b2ec8092c11872257095fc89a4ff5b\": container with ID starting with 14646dc3bf7c708df4b510f5a26d5c9db4b2ec8092c11872257095fc89a4ff5b not found: ID does not exist" containerID="14646dc3bf7c708df4b510f5a26d5c9db4b2ec8092c11872257095fc89a4ff5b"
Nov 04 02:45:35.940564 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:35.940530    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14646dc3bf7c708df4b510f5a26d5c9db4b2ec8092c11872257095fc89a4ff5b"} err="failed to get container status \"14646dc3bf7c708df4b510f5a26d5c9db4b2ec8092c11872257095fc89a4ff5b\": rpc error: code = NotFound desc = could not find container \"14646dc3bf7c708df4b510f5a26d5c9db4b2ec8092c11872257095fc89a4ff5b\": container with ID starting with 14646dc3bf7c708df4b510f5a26d5c9db4b2ec8092c11872257095fc89a4ff5b not found: ID does not exist"
Nov 04 02:45:36.083943 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:36.083906    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"]
Nov 04 02:45:36.087207 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:36.087161    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-a-80b404-openshift-default-78c74d5ccc-8nzfd"]
Nov 04 02:45:36.527504 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:36.527465    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" path="/var/lib/kubelet/pods/ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6/volumes"
Nov 04 02:45:40.612260 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:45:40.612223    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:45:51.920636 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:51.920591    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"]
Nov 04 02:45:51.921202 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:51.920825    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t" podUID="765164d9-fde8-43e6-bd5d-527b9bd69a23" containerName="istio-proxy" containerID="cri-o://77e19eb247aceea07a2486c2acaac15ce25d956ad6d15d2bbb19db27dcfea8e2" gracePeriod=30
Nov 04 02:45:53.145466 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145430    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw"]
Nov 04 02:45:53.145875 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145837    4548 cpu_manager.go:414] "containerMap: removing container" podUID="ce058fc1-0235-4a1e-aea8-688df574bbcd" containerName="cleanup"
Nov 04 02:45:53.145875 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145847    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce058fc1-0235-4a1e-aea8-688df574bbcd" containerName="cleanup"
Nov 04 02:45:53.145875 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145856    4548 cpu_manager.go:414] "containerMap: removing container" podUID="1a1fbbf2-0a43-4623-954c-b4f165987ab0" containerName="cleanup"
Nov 04 02:45:53.145875 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145861    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a1fbbf2-0a43-4623-954c-b4f165987ab0" containerName="cleanup"
Nov 04 02:45:53.145875 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145867    4548 cpu_manager.go:414] "containerMap: removing container" podUID="02492a03-9e71-4280-9db9-75dcd25b3417" containerName="cleanup"
Nov 04 02:45:53.145875 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145872    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="02492a03-9e71-4280-9db9-75dcd25b3417" containerName="cleanup"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145881    4548 cpu_manager.go:414] "containerMap: removing container" podUID="1a1fbbf2-0a43-4623-954c-b4f165987ab0" containerName="cleanup"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145885    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a1fbbf2-0a43-4623-954c-b4f165987ab0" containerName="cleanup"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145900    4548 cpu_manager.go:414] "containerMap: removing container" podUID="09e06531-bcdc-436a-91d9-9c8748ee248b" containerName="payload-processing"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145905    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="09e06531-bcdc-436a-91d9-9c8748ee248b" containerName="payload-processing"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145915    4548 cpu_manager.go:414] "containerMap: removing container" podUID="02492a03-9e71-4280-9db9-75dcd25b3417" containerName="cleanup"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145919    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="02492a03-9e71-4280-9db9-75dcd25b3417" containerName="cleanup"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145927    4548 cpu_manager.go:414] "containerMap: removing container" podUID="ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" containerName="istio-proxy"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145933    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" containerName="istio-proxy"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145943    4548 cpu_manager.go:414] "containerMap: removing container" podUID="ce058fc1-0235-4a1e-aea8-688df574bbcd" containerName="cleanup"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145948    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce058fc1-0235-4a1e-aea8-688df574bbcd" containerName="cleanup"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145954    4548 cpu_manager.go:414] "containerMap: removing container" podUID="ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" containerName="istio-proxy"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145958    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" containerName="istio-proxy"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145971    4548 cpu_manager.go:414] "containerMap: removing container" podUID="1a1fbbf2-0a43-4623-954c-b4f165987ab0" containerName="cleanup"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.145975    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1a1fbbf2-0a43-4623-954c-b4f165987ab0" containerName="cleanup"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.146027    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce058fc1-0235-4a1e-aea8-688df574bbcd" containerName="cleanup"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.146033    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" containerName="istio-proxy"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.146041    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="02492a03-9e71-4280-9db9-75dcd25b3417" containerName="cleanup"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.146047    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a1fbbf2-0a43-4623-954c-b4f165987ab0" containerName="cleanup"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.146053    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce058fc1-0235-4a1e-aea8-688df574bbcd" containerName="cleanup"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.146058    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a1fbbf2-0a43-4623-954c-b4f165987ab0" containerName="cleanup"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.146063    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="02492a03-9e71-4280-9db9-75dcd25b3417" containerName="cleanup"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.146068    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="1a1fbbf2-0a43-4623-954c-b4f165987ab0" containerName="cleanup"
Nov 04 02:45:53.146067 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.146077    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="09e06531-bcdc-436a-91d9-9c8748ee248b" containerName="payload-processing"
Nov 04 02:45:53.147026 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.146081    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="ce058fc1-0235-4a1e-aea8-688df574bbcd" containerName="cleanup"
Nov 04 02:45:53.150743 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.150722    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw"
Nov 04 02:45:53.204800 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.204767    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw"]
Nov 04 02:45:53.251777 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.251733    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 02:45:53.251777 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.251755    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:45:53.252001 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.251789    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:45:53.253309 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.253285    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:45:53.303604 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.303558    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/00f20d1c-c37b-49db-9466-70fcce6b03af-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f00adea7-2zhhw\" (UID: \"00f20d1c-c37b-49db-9466-70fcce6b03af\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw"
Nov 04 02:45:53.303792 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.303726    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztpcz\" (UniqueName: \"kubernetes.io/projected/00f20d1c-c37b-49db-9466-70fcce6b03af-kube-api-access-ztpcz\") pod \"maas-api-revoke-sub-f00adea7-2zhhw\" (UID: \"00f20d1c-c37b-49db-9466-70fcce6b03af\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw"
Nov 04 02:45:53.303792 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.303773    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/00f20d1c-c37b-49db-9466-70fcce6b03af-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f00adea7-2zhhw\" (UID: \"00f20d1c-c37b-49db-9466-70fcce6b03af\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw"
Nov 04 02:45:53.405118 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.405003    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztpcz\" (UniqueName: \"kubernetes.io/projected/00f20d1c-c37b-49db-9466-70fcce6b03af-kube-api-access-ztpcz\") pod \"maas-api-revoke-sub-f00adea7-2zhhw\" (UID: \"00f20d1c-c37b-49db-9466-70fcce6b03af\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw"
Nov 04 02:45:53.405118 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.405078    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/00f20d1c-c37b-49db-9466-70fcce6b03af-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f00adea7-2zhhw\" (UID: \"00f20d1c-c37b-49db-9466-70fcce6b03af\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw"
Nov 04 02:45:53.405487 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.405163    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/00f20d1c-c37b-49db-9466-70fcce6b03af-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f00adea7-2zhhw\" (UID: \"00f20d1c-c37b-49db-9466-70fcce6b03af\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw"
Nov 04 02:45:53.405889 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.405865    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/00f20d1c-c37b-49db-9466-70fcce6b03af-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-f00adea7-2zhhw\" (UID: \"00f20d1c-c37b-49db-9466-70fcce6b03af\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw"
Nov 04 02:45:53.407653 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.407633    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/00f20d1c-c37b-49db-9466-70fcce6b03af-maas-api-xks-ca\") pod \"maas-api-revoke-sub-f00adea7-2zhhw\" (UID: \"00f20d1c-c37b-49db-9466-70fcce6b03af\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw"
Nov 04 02:45:53.467025 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.466984    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztpcz\" (UniqueName: \"kubernetes.io/projected/00f20d1c-c37b-49db-9466-70fcce6b03af-kube-api-access-ztpcz\") pod \"maas-api-revoke-sub-f00adea7-2zhhw\" (UID: \"00f20d1c-c37b-49db-9466-70fcce6b03af\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw"
Nov 04 02:45:53.764327 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:53.764235    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw"
Nov 04 02:45:54.142868 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:54.142841    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw"]
Nov 04 02:45:54.144640 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:45:54.144612    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00f20d1c_c37b_49db_9466_70fcce6b03af.slice/crio-7ec123901ad5fac26938fe5c7e34b91117717582f1c399f94f938b77a79748ab WatchSource:0}: Error finding container 7ec123901ad5fac26938fe5c7e34b91117717582f1c399f94f938b77a79748ab: Status 404 returned error can't find the container with id 7ec123901ad5fac26938fe5c7e34b91117717582f1c399f94f938b77a79748ab
Nov 04 02:45:55.055940 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:55.055905    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw" event={"ID":"00f20d1c-c37b-49db-9466-70fcce6b03af","Type":"ContainerStarted","Data":"21f0283323e3d6722e9ba429014a9d23104f76d54c239ac0b71e38110ac61038"}
Nov 04 02:45:55.056387 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:55.055957    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw" event={"ID":"00f20d1c-c37b-49db-9466-70fcce6b03af","Type":"ContainerStarted","Data":"7ec123901ad5fac26938fe5c7e34b91117717582f1c399f94f938b77a79748ab"}
Nov 04 02:45:55.173182 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:55.173098    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw" podStartSLOduration=2.173082738 podStartE2EDuration="2.173082738s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:45:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:45:55.172395948 +0000 UTC m=+1788.777408955" watchObservedRunningTime="2026-11-04 02:45:55.173082738 +0000 UTC m=+1788.778095736"
Nov 04 02:45:56.065130 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:56.065096    4548 generic.go:356] "Generic (PLEG): container finished" podID="00f20d1c-c37b-49db-9466-70fcce6b03af" containerID="21f0283323e3d6722e9ba429014a9d23104f76d54c239ac0b71e38110ac61038" exitCode=0
Nov 04 02:45:56.065615 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:56.065199    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw" event={"ID":"00f20d1c-c37b-49db-9466-70fcce6b03af","Type":"ContainerDied","Data":"21f0283323e3d6722e9ba429014a9d23104f76d54c239ac0b71e38110ac61038"}
Nov 04 02:45:57.078860 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.078825    4548 generic.go:356] "Generic (PLEG): container finished" podID="765164d9-fde8-43e6-bd5d-527b9bd69a23" containerID="77e19eb247aceea07a2486c2acaac15ce25d956ad6d15d2bbb19db27dcfea8e2" exitCode=0
Nov 04 02:45:57.079308 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.078900    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t" event={"ID":"765164d9-fde8-43e6-bd5d-527b9bd69a23","Type":"ContainerDied","Data":"77e19eb247aceea07a2486c2acaac15ce25d956ad6d15d2bbb19db27dcfea8e2"}
Nov 04 02:45:57.079308 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.078969    4548 scope.go:122] "RemoveContainer" containerID="315a2e4a441b117ad00e0eb07c1b6753ad74567fa6c6d28d74dd9952cda2e393"
Nov 04 02:45:57.226145 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.226116    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:45:57.269563 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.269529    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw"
Nov 04 02:45:57.349508 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.349466    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-workload-socket\") pod \"765164d9-fde8-43e6-bd5d-527b9bd69a23\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") "
Nov 04 02:45:57.349508 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.349510    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-token\" (UniqueName: \"kubernetes.io/projected/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-token\") pod \"765164d9-fde8-43e6-bd5d-527b9bd69a23\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") "
Nov 04 02:45:57.349782 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.349546    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-data\") pod \"765164d9-fde8-43e6-bd5d-527b9bd69a23\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") "
Nov 04 02:45:57.349782 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.349570    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-envoy\") pod \"765164d9-fde8-43e6-bd5d-527b9bd69a23\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") "
Nov 04 02:45:57.349782 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.349605    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/00f20d1c-c37b-49db-9466-70fcce6b03af-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/00f20d1c-c37b-49db-9466-70fcce6b03af-maas-api-openshift-ca\") pod \"00f20d1c-c37b-49db-9466-70fcce6b03af\" (UID: \"00f20d1c-c37b-49db-9466-70fcce6b03af\") "
Nov 04 02:45:57.349782 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.349647    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-workload-certs\") pod \"765164d9-fde8-43e6-bd5d-527b9bd69a23\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") "
Nov 04 02:45:57.350008 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.349793    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-data" pod "765164d9-fde8-43e6-bd5d-527b9bd69a23" (UID: "765164d9-fde8-43e6-bd5d-527b9bd69a23"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:45:57.350008 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.349827    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-workload-socket" pod "765164d9-fde8-43e6-bd5d-527b9bd69a23" (UID: "765164d9-fde8-43e6-bd5d-527b9bd69a23"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:45:57.350008 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.349854    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/00f20d1c-c37b-49db-9466-70fcce6b03af-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/00f20d1c-c37b-49db-9466-70fcce6b03af-maas-api-xks-ca\") pod \"00f20d1c-c37b-49db-9466-70fcce6b03af\" (UID: \"00f20d1c-c37b-49db-9466-70fcce6b03af\") "
Nov 04 02:45:57.350008 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.349908    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-credential-socket\") pod \"765164d9-fde8-43e6-bd5d-527b9bd69a23\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") "
Nov 04 02:45:57.350008 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.349963    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/00f20d1c-c37b-49db-9466-70fcce6b03af-kube-api-access-ztpcz\" (UniqueName: \"kubernetes.io/projected/00f20d1c-c37b-49db-9466-70fcce6b03af-kube-api-access-ztpcz\") pod \"00f20d1c-c37b-49db-9466-70fcce6b03af\" (UID: \"00f20d1c-c37b-49db-9466-70fcce6b03af\") "
Nov 04 02:45:57.350300 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.350019    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/765164d9-fde8-43e6-bd5d-527b9bd69a23-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/765164d9-fde8-43e6-bd5d-527b9bd69a23-istiod-ca-cert\") pod \"765164d9-fde8-43e6-bd5d-527b9bd69a23\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") "
Nov 04 02:45:57.350300 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.350027    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00f20d1c-c37b-49db-9466-70fcce6b03af-maas-api-openshift-ca" pod "00f20d1c-c37b-49db-9466-70fcce6b03af" (UID: "00f20d1c-c37b-49db-9466-70fcce6b03af"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:45:57.350300 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.350059    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-podinfo\") pod \"765164d9-fde8-43e6-bd5d-527b9bd69a23\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") "
Nov 04 02:45:57.350300 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.350216    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-credential-socket" pod "765164d9-fde8-43e6-bd5d-527b9bd69a23" (UID: "765164d9-fde8-43e6-bd5d-527b9bd69a23"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:45:57.350300 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.350283    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/765164d9-fde8-43e6-bd5d-527b9bd69a23-kube-api-access-469c2\" (UniqueName: \"kubernetes.io/projected/765164d9-fde8-43e6-bd5d-527b9bd69a23-kube-api-access-469c2\") pod \"765164d9-fde8-43e6-bd5d-527b9bd69a23\" (UID: \"765164d9-fde8-43e6-bd5d-527b9bd69a23\") "
Nov 04 02:45:57.350570 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.350498    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-workload-certs" pod "765164d9-fde8-43e6-bd5d-527b9bd69a23" (UID: "765164d9-fde8-43e6-bd5d-527b9bd69a23"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:45:57.350570 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.350461    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/765164d9-fde8-43e6-bd5d-527b9bd69a23-istiod-ca-cert" pod "765164d9-fde8-43e6-bd5d-527b9bd69a23" (UID: "765164d9-fde8-43e6-bd5d-527b9bd69a23"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:45:57.350998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.350922    4548 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/765164d9-fde8-43e6-bd5d-527b9bd69a23-istiod-ca-cert\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:57.350998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.350954    4548 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-workload-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:57.350998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.350969    4548 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-data\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:57.350998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.350983    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/00f20d1c-c37b-49db-9466-70fcce6b03af-maas-api-openshift-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:57.350998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.350998    4548 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-workload-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:57.350998 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.351012    4548 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-credential-socket\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:57.352302 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.352276    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-envoy" pod "765164d9-fde8-43e6-bd5d-527b9bd69a23" (UID: "765164d9-fde8-43e6-bd5d-527b9bd69a23"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:45:57.352576 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.352559    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-token" pod "765164d9-fde8-43e6-bd5d-527b9bd69a23" (UID: "765164d9-fde8-43e6-bd5d-527b9bd69a23"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:45:57.352786 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.352764    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/00f20d1c-c37b-49db-9466-70fcce6b03af-maas-api-xks-ca" pod "00f20d1c-c37b-49db-9466-70fcce6b03af" (UID: "00f20d1c-c37b-49db-9466-70fcce6b03af"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:45:57.352883 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.352866    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00f20d1c-c37b-49db-9466-70fcce6b03af-kube-api-access-ztpcz" pod "00f20d1c-c37b-49db-9466-70fcce6b03af" (UID: "00f20d1c-c37b-49db-9466-70fcce6b03af"). InnerVolumeSpecName "kube-api-access-ztpcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:45:57.352951 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.352913    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-podinfo" pod "765164d9-fde8-43e6-bd5d-527b9bd69a23" (UID: "765164d9-fde8-43e6-bd5d-527b9bd69a23"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Nov 04 02:45:57.352991 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.352981    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/765164d9-fde8-43e6-bd5d-527b9bd69a23-kube-api-access-469c2" pod "765164d9-fde8-43e6-bd5d-527b9bd69a23" (UID: "765164d9-fde8-43e6-bd5d-527b9bd69a23"). InnerVolumeSpecName "kube-api-access-469c2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:45:57.371973 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.371935    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"]
Nov 04 02:45:57.381924 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.381887    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"]
Nov 04 02:45:57.452145 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.452104    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-469c2\" (UniqueName: \"kubernetes.io/projected/765164d9-fde8-43e6-bd5d-527b9bd69a23-kube-api-access-469c2\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:57.452145 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.452138    4548 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-token\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:57.452145 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.452149    4548 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-envoy\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:57.452437 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.452159    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/00f20d1c-c37b-49db-9466-70fcce6b03af-maas-api-xks-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:57.452437 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.452182    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztpcz\" (UniqueName: \"kubernetes.io/projected/00f20d1c-c37b-49db-9466-70fcce6b03af-kube-api-access-ztpcz\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:57.452437 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:57.452191    4548 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/765164d9-fde8-43e6-bd5d-527b9bd69a23-istio-podinfo\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:45:58.088109 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:58.088074    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"
Nov 04 02:45:58.088602 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:58.088110    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t" event={"ID":"765164d9-fde8-43e6-bd5d-527b9bd69a23","Type":"ContainerDied","Data":"44a05aa9041adb7f83574fbf4b8986e8a6fc74ba23a2f57c6b4a7746542dc55c"}
Nov 04 02:45:58.088602 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:58.088186    4548 scope.go:122] "RemoveContainer" containerID="77e19eb247aceea07a2486c2acaac15ce25d956ad6d15d2bbb19db27dcfea8e2"
Nov 04 02:45:58.089986 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:58.089960    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw" event={"ID":"00f20d1c-c37b-49db-9466-70fcce6b03af","Type":"ContainerDied","Data":"7ec123901ad5fac26938fe5c7e34b91117717582f1c399f94f938b77a79748ab"}
Nov 04 02:45:58.090080 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:58.090010    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7ec123901ad5fac26938fe5c7e34b91117717582f1c399f94f938b77a79748ab"
Nov 04 02:45:58.090080 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:58.089966    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-f00adea7-2zhhw"
Nov 04 02:45:58.311250 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:58.311212    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"]
Nov 04 02:45:58.317159 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:58.317122    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-extmod-b-3353a6-openshift-default-5b5476986f-bdf5t"]
Nov 04 02:45:58.530551 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:45:58.530517    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="765164d9-fde8-43e6-bd5d-527b9bd69a23" path="/var/lib/kubelet/pods/765164d9-fde8-43e6-bd5d-527b9bd69a23/volumes"
Nov 04 02:46:04.786525 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.786487    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl"]
Nov 04 02:46:04.786950 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.786925    4548 cpu_manager.go:414] "containerMap: removing container" podUID="ce058fc1-0235-4a1e-aea8-688df574bbcd" containerName="cleanup"
Nov 04 02:46:04.786950 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.786942    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ce058fc1-0235-4a1e-aea8-688df574bbcd" containerName="cleanup"
Nov 04 02:46:04.787024 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.786952    4548 cpu_manager.go:414] "containerMap: removing container" podUID="765164d9-fde8-43e6-bd5d-527b9bd69a23" containerName="istio-proxy"
Nov 04 02:46:04.787024 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.786958    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="765164d9-fde8-43e6-bd5d-527b9bd69a23" containerName="istio-proxy"
Nov 04 02:46:04.787024 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.786973    4548 cpu_manager.go:414] "containerMap: removing container" podUID="00f20d1c-c37b-49db-9466-70fcce6b03af" containerName="revoke-keys"
Nov 04 02:46:04.787024 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.786979    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="00f20d1c-c37b-49db-9466-70fcce6b03af" containerName="revoke-keys"
Nov 04 02:46:04.787024 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.786991    4548 cpu_manager.go:414] "containerMap: removing container" podUID="765164d9-fde8-43e6-bd5d-527b9bd69a23" containerName="istio-proxy"
Nov 04 02:46:04.787024 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.786995    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="765164d9-fde8-43e6-bd5d-527b9bd69a23" containerName="istio-proxy"
Nov 04 02:46:04.787024 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.787001    4548 cpu_manager.go:414] "containerMap: removing container" podUID="02492a03-9e71-4280-9db9-75dcd25b3417" containerName="cleanup"
Nov 04 02:46:04.787024 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.787005    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="02492a03-9e71-4280-9db9-75dcd25b3417" containerName="cleanup"
Nov 04 02:46:04.787323 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.787083    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="765164d9-fde8-43e6-bd5d-527b9bd69a23" containerName="istio-proxy"
Nov 04 02:46:04.787323 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.787091    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="02492a03-9e71-4280-9db9-75dcd25b3417" containerName="cleanup"
Nov 04 02:46:04.787323 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.787108    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="ede38477-3c2a-4aa8-8f7d-dadfd75bdfa6" containerName="istio-proxy"
Nov 04 02:46:04.787323 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.787115    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="00f20d1c-c37b-49db-9466-70fcce6b03af" containerName="revoke-keys"
Nov 04 02:46:04.791775 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.791751    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl"
Nov 04 02:46:04.824908 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.824871    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtg72\" (UniqueName: \"kubernetes.io/projected/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-kube-api-access-jtg72\") pod \"maas-api-revoke-sub-4e663206-96kzl\" (UID: \"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl"
Nov 04 02:46:04.825109 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.824933    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4e663206-96kzl\" (UID: \"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl"
Nov 04 02:46:04.825109 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.825087    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4e663206-96kzl\" (UID: \"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl"
Nov 04 02:46:04.845779 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.845739    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl"]
Nov 04 02:46:04.892409 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.892360    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Nov 04 02:46:04.892409 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.892369    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Nov 04 02:46:04.892640 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.892435    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Nov 04 02:46:04.894564 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.894538    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-6gszf\""
Nov 04 02:46:04.925880 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.925837    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtg72\" (UniqueName: \"kubernetes.io/projected/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-kube-api-access-jtg72\") pod \"maas-api-revoke-sub-4e663206-96kzl\" (UID: \"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl"
Nov 04 02:46:04.926146 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.925906    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4e663206-96kzl\" (UID: \"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl"
Nov 04 02:46:04.926146 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.925946    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4e663206-96kzl\" (UID: \"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl"
Nov 04 02:46:04.926613 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.926584    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-4e663206-96kzl\" (UID: \"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl"
Nov 04 02:46:04.928594 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.928575    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-maas-api-xks-ca\") pod \"maas-api-revoke-sub-4e663206-96kzl\" (UID: \"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl"
Nov 04 02:46:04.987144 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:04.987114    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtg72\" (UniqueName: \"kubernetes.io/projected/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-kube-api-access-jtg72\") pod \"maas-api-revoke-sub-4e663206-96kzl\" (UID: \"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl"
Nov 04 02:46:05.105840 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:05.105747    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl"
Nov 04 02:46:05.486538 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:05.486503    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl"]
Nov 04 02:46:05.488195 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:46:05.488152    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb0388a8_3ab7_41e4_99e7_3e1e58c2c47d.slice/crio-f5586d50971e12da41f2e92a71f18682f8604ebbcade3355a48abb255b52545b WatchSource:0}: Error finding container f5586d50971e12da41f2e92a71f18682f8604ebbcade3355a48abb255b52545b: Status 404 returned error can't find the container with id f5586d50971e12da41f2e92a71f18682f8604ebbcade3355a48abb255b52545b
Nov 04 02:46:06.150382 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:06.150345    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl" event={"ID":"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d","Type":"ContainerStarted","Data":"4717f9592b1813345f7111b5f32db897b2cbda148065d44db11f98bbd1c1c449"}
Nov 04 02:46:06.150833 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:06.150399    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl" event={"ID":"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d","Type":"ContainerStarted","Data":"f5586d50971e12da41f2e92a71f18682f8604ebbcade3355a48abb255b52545b"}
Nov 04 02:46:06.268685 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:06.268619    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl" podStartSLOduration=2.268598023 podStartE2EDuration="2.268598023s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:46:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:46:06.266973693 +0000 UTC m=+1799.871986691" watchObservedRunningTime="2026-11-04 02:46:06.268598023 +0000 UTC m=+1799.873611022"
Nov 04 02:46:06.844116 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:06.844083    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:46:06.851147 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:06.851122    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g86jv_50068ac4-0a6a-48ca-84dd-611fc3a87b65/ovn-acl-logging/0.log"
Nov 04 02:46:07.160194 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:07.160081    4548 generic.go:356] "Generic (PLEG): container finished" podID="eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d" containerID="4717f9592b1813345f7111b5f32db897b2cbda148065d44db11f98bbd1c1c449" exitCode=0
Nov 04 02:46:07.160588 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:07.160183    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl" event={"ID":"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d","Type":"ContainerDied","Data":"4717f9592b1813345f7111b5f32db897b2cbda148065d44db11f98bbd1c1c449"}
Nov 04 02:46:07.233722 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:07.233689    4548 scope.go:122] "RemoveContainer" containerID="15e798363a516c42f863698490c5892a7698b9df994151a682684acc559eb1c0"
Nov 04 02:46:07.244430 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:07.244406    4548 scope.go:122] "RemoveContainer" containerID="a2a519f36611e8e2b26f057aff336c910c9b11343d9f85126ecf4f05f2112c7f"
Nov 04 02:46:07.253982 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:07.253955    4548 scope.go:122] "RemoveContainer" containerID="7817fcced66b76a05ba7da55dab7c95e03b75d989b8cb9bd3fe575f67e3c299e"
Nov 04 02:46:07.263833 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:07.263803    4548 scope.go:122] "RemoveContainer" containerID="ebaa2b4ad1d19c30d94965fe2949a075e74be81155281bdf19bc689baa95036c"
Nov 04 02:46:07.275701 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:07.275132    4548 scope.go:122] "RemoveContainer" containerID="8dbf462cd7a8517919a271e2aa8761101a75437c0bad7e8da6da99fe58305610"
Nov 04 02:46:07.303900 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:07.303863    4548 scope.go:122] "RemoveContainer" containerID="86bba3150f44efc7813df111b579df850e3a93a016774958b64e236c0d3dd77d"
Nov 04 02:46:08.319511 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:08.319482    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl"
Nov 04 02:46:08.365886 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:08.365845    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-maas-api-xks-ca\") pod \"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d\" (UID: \"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d\") "
Nov 04 02:46:08.366070 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:08.365934    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-kube-api-access-jtg72\" (UniqueName: \"kubernetes.io/projected/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-kube-api-access-jtg72\") pod \"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d\" (UID: \"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d\") "
Nov 04 02:46:08.366070 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:08.365963    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-maas-api-openshift-ca\") pod \"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d\" (UID: \"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d\") "
Nov 04 02:46:08.366495 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:08.366461    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-maas-api-openshift-ca" pod "eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d" (UID: "eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Nov 04 02:46:08.368358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:08.368336    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-maas-api-xks-ca" pod "eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d" (UID: "eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:46:08.368358 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:08.368353    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-kube-api-access-jtg72" pod "eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d" (UID: "eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d"). InnerVolumeSpecName "kube-api-access-jtg72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:46:08.467951 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:08.467868    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-maas-api-xks-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:08.467951 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:08.467903    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtg72\" (UniqueName: \"kubernetes.io/projected/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-kube-api-access-jtg72\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:08.467951 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:08.467914    4548 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d-maas-api-openshift-ca\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:09.175426 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:09.175393    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl"
Nov 04 02:46:09.175426 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:09.175406    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-4e663206-96kzl" event={"ID":"eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d","Type":"ContainerDied","Data":"f5586d50971e12da41f2e92a71f18682f8604ebbcade3355a48abb255b52545b"}
Nov 04 02:46:09.175708 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:09.175468    4548 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f5586d50971e12da41f2e92a71f18682f8604ebbcade3355a48abb255b52545b"
Nov 04 02:46:10.611912 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:46:10.611872    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:46:12.393596 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.393534    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt" podUID="7bea1b32-d4ba-496c-b17d-b0b2d459010f" containerName="main" containerID="cri-o://e1ac7b1c7be78b93aa162191dd04b8b391296ac20007bea5b60e9d6dc1041218" gracePeriod=45
Nov 04 02:46:12.403455 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.403406    4548 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874" podUID="9a38c5ae-db84-40c1-bb28-e7f7e7842b4a" containerName="main" containerID="cri-o://fa25256ad34b502006b026966d79aa65ec72ec9c90e92f823b57d83acfed95c1" gracePeriod=45
Nov 04 02:46:12.676507 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.676477    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:46:12.706738 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.706710    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:46:12.720474 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.720441    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-home\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-home\") pod \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") "
Nov 04 02:46:12.720474 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.720479    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-tmp-dir\") pod \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") "
Nov 04 02:46:12.720740 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.720536    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-model-cache\") pod \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") "
Nov 04 02:46:12.720740 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.720624    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/7bea1b32-d4ba-496c-b17d-b0b2d459010f-tls-certs\" (UniqueName: \"kubernetes.io/secret/7bea1b32-d4ba-496c-b17d-b0b2d459010f-tls-certs\") pod \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") "
Nov 04 02:46:12.720740 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.720652    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-dshm\") pod \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") "
Nov 04 02:46:12.720740 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.720699    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/7bea1b32-d4ba-496c-b17d-b0b2d459010f-kube-api-access-cpx78\" (UniqueName: \"kubernetes.io/projected/7bea1b32-d4ba-496c-b17d-b0b2d459010f-kube-api-access-cpx78\") pod \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\" (UID: \"7bea1b32-d4ba-496c-b17d-b0b2d459010f\") "
Nov 04 02:46:12.720927 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.720774    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-home" pod "7bea1b32-d4ba-496c-b17d-b0b2d459010f" (UID: "7bea1b32-d4ba-496c-b17d-b0b2d459010f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:12.720927 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.720834    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-tmp-dir" pod "7bea1b32-d4ba-496c-b17d-b0b2d459010f" (UID: "7bea1b32-d4ba-496c-b17d-b0b2d459010f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:12.720927 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.720859    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-model-cache" pod "7bea1b32-d4ba-496c-b17d-b0b2d459010f" (UID: "7bea1b32-d4ba-496c-b17d-b0b2d459010f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:12.721162 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.721137    4548 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-model-cache\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.721285 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.721190    4548 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-home\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.721285 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.721208    4548 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-tmp-dir\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.723342 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.723304    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7bea1b32-d4ba-496c-b17d-b0b2d459010f-tls-certs" pod "7bea1b32-d4ba-496c-b17d-b0b2d459010f" (UID: "7bea1b32-d4ba-496c-b17d-b0b2d459010f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:46:12.723584 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.723565    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7bea1b32-d4ba-496c-b17d-b0b2d459010f-kube-api-access-cpx78" pod "7bea1b32-d4ba-496c-b17d-b0b2d459010f" (UID: "7bea1b32-d4ba-496c-b17d-b0b2d459010f"). InnerVolumeSpecName "kube-api-access-cpx78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:46:12.723630 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.723573    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-dshm" pod "7bea1b32-d4ba-496c-b17d-b0b2d459010f" (UID: "7bea1b32-d4ba-496c-b17d-b0b2d459010f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:12.822425 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.822384    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-model-cache\") pod \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") "
Nov 04 02:46:12.822640 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.822479    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-tmp-dir\") pod \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") "
Nov 04 02:46:12.822640 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.822557    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-home\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-home\") pod \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") "
Nov 04 02:46:12.822758 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.822644    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-tls-certs\" (UniqueName: \"kubernetes.io/secret/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-tls-certs\") pod \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") "
Nov 04 02:46:12.822758 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.822672    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-kube-api-access-s2ts4\" (UniqueName: \"kubernetes.io/projected/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-kube-api-access-s2ts4\") pod \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") "
Nov 04 02:46:12.822758 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.822713    4548 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-dshm\") pod \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\" (UID: \"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a\") "
Nov 04 02:46:12.822928 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.822754    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-model-cache" pod "9a38c5ae-db84-40c1-bb28-e7f7e7842b4a" (UID: "9a38c5ae-db84-40c1-bb28-e7f7e7842b4a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:12.822928 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.822822    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-tmp-dir" pod "9a38c5ae-db84-40c1-bb28-e7f7e7842b4a" (UID: "9a38c5ae-db84-40c1-bb28-e7f7e7842b4a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:12.823082 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.823061    4548 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7bea1b32-d4ba-496c-b17d-b0b2d459010f-tls-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.823143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.823088    4548 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7bea1b32-d4ba-496c-b17d-b0b2d459010f-dshm\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.823143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.823104    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpx78\" (UniqueName: \"kubernetes.io/projected/7bea1b32-d4ba-496c-b17d-b0b2d459010f-kube-api-access-cpx78\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.823143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.823119    4548 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-tmp-dir\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.823143 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.823133    4548 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-model-cache\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.823399 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.823376    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-home" pod "9a38c5ae-db84-40c1-bb28-e7f7e7842b4a" (UID: "9a38c5ae-db84-40c1-bb28-e7f7e7842b4a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:12.825688 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.825660    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-dshm" pod "9a38c5ae-db84-40c1-bb28-e7f7e7842b4a" (UID: "9a38c5ae-db84-40c1-bb28-e7f7e7842b4a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Nov 04 02:46:12.826159 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.826126    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-kube-api-access-s2ts4" pod "9a38c5ae-db84-40c1-bb28-e7f7e7842b4a" (UID: "9a38c5ae-db84-40c1-bb28-e7f7e7842b4a"). InnerVolumeSpecName "kube-api-access-s2ts4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Nov 04 02:46:12.827440 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.827411    4548 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-tls-certs" pod "9a38c5ae-db84-40c1-bb28-e7f7e7842b4a" (UID: "9a38c5ae-db84-40c1-bb28-e7f7e7842b4a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Nov 04 02:46:12.923896 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.923800    4548 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-home\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.923896 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.923842    4548 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-tls-certs\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.923896 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.923856    4548 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2ts4\" (UniqueName: \"kubernetes.io/projected/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-kube-api-access-s2ts4\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:12.923896 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:12.923871    4548 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a-dshm\") on node \"ip-10-0-130-155.us-west-2.compute.internal\" DevicePath \"\""
Nov 04 02:46:13.204643 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:13.204554    4548 generic.go:356] "Generic (PLEG): container finished" podID="7bea1b32-d4ba-496c-b17d-b0b2d459010f" containerID="e1ac7b1c7be78b93aa162191dd04b8b391296ac20007bea5b60e9d6dc1041218" exitCode=0
Nov 04 02:46:13.204643 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:13.204624    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"
Nov 04 02:46:13.204878 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:13.204637    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt" event={"ID":"7bea1b32-d4ba-496c-b17d-b0b2d459010f","Type":"ContainerDied","Data":"e1ac7b1c7be78b93aa162191dd04b8b391296ac20007bea5b60e9d6dc1041218"}
Nov 04 02:46:13.204878 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:13.204680    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt" event={"ID":"7bea1b32-d4ba-496c-b17d-b0b2d459010f","Type":"ContainerDied","Data":"90302b5d824ab72133092ca4911c9dc9c1003b76acfb24ea3f25d614d77e52d7"}
Nov 04 02:46:13.204878 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:13.204696    4548 scope.go:122] "RemoveContainer" containerID="e1ac7b1c7be78b93aa162191dd04b8b391296ac20007bea5b60e9d6dc1041218"
Nov 04 02:46:13.206803 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:13.206776    4548 generic.go:356] "Generic (PLEG): container finished" podID="9a38c5ae-db84-40c1-bb28-e7f7e7842b4a" containerID="fa25256ad34b502006b026966d79aa65ec72ec9c90e92f823b57d83acfed95c1" exitCode=0
Nov 04 02:46:13.206956 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:13.206820    4548 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"
Nov 04 02:46:13.206956 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:13.206833    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874" event={"ID":"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a","Type":"ContainerDied","Data":"fa25256ad34b502006b026966d79aa65ec72ec9c90e92f823b57d83acfed95c1"}
Nov 04 02:46:13.206956 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:13.206860    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874" event={"ID":"9a38c5ae-db84-40c1-bb28-e7f7e7842b4a","Type":"ContainerDied","Data":"b2d00f1a586703c84a07a6cc21071f3c32c0d169ccae47d60eec504a8d493531"}
Nov 04 02:46:13.215434 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:13.215387    4548 scope.go:122] "RemoveContainer" containerID="e1ac7b1c7be78b93aa162191dd04b8b391296ac20007bea5b60e9d6dc1041218"
Nov 04 02:46:13.215830 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:46:13.215797    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1ac7b1c7be78b93aa162191dd04b8b391296ac20007bea5b60e9d6dc1041218\": container with ID starting with e1ac7b1c7be78b93aa162191dd04b8b391296ac20007bea5b60e9d6dc1041218 not found: ID does not exist" containerID="e1ac7b1c7be78b93aa162191dd04b8b391296ac20007bea5b60e9d6dc1041218"
Nov 04 02:46:13.215941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:13.215842    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1ac7b1c7be78b93aa162191dd04b8b391296ac20007bea5b60e9d6dc1041218"} err="failed to get container status \"e1ac7b1c7be78b93aa162191dd04b8b391296ac20007bea5b60e9d6dc1041218\": rpc error: code = NotFound desc = could not find container \"e1ac7b1c7be78b93aa162191dd04b8b391296ac20007bea5b60e9d6dc1041218\": container with ID starting with e1ac7b1c7be78b93aa162191dd04b8b391296ac20007bea5b60e9d6dc1041218 not found: ID does not exist"
Nov 04 02:46:13.215941 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:13.215870    4548 scope.go:122] "RemoveContainer" containerID="fa25256ad34b502006b026966d79aa65ec72ec9c90e92f823b57d83acfed95c1"
Nov 04 02:46:13.227961 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:13.227935    4548 scope.go:122] "RemoveContainer" containerID="fa25256ad34b502006b026966d79aa65ec72ec9c90e92f823b57d83acfed95c1"
Nov 04 02:46:13.228381 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:46:13.228359    4548 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa25256ad34b502006b026966d79aa65ec72ec9c90e92f823b57d83acfed95c1\": container with ID starting with fa25256ad34b502006b026966d79aa65ec72ec9c90e92f823b57d83acfed95c1 not found: ID does not exist" containerID="fa25256ad34b502006b026966d79aa65ec72ec9c90e92f823b57d83acfed95c1"
Nov 04 02:46:13.228467 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:13.228394    4548 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa25256ad34b502006b026966d79aa65ec72ec9c90e92f823b57d83acfed95c1"} err="failed to get container status \"fa25256ad34b502006b026966d79aa65ec72ec9c90e92f823b57d83acfed95c1\": rpc error: code = NotFound desc = could not find container \"fa25256ad34b502006b026966d79aa65ec72ec9c90e92f823b57d83acfed95c1\": container with ID starting with fa25256ad34b502006b026966d79aa65ec72ec9c90e92f823b57d83acfed95c1 not found: ID does not exist"
Nov 04 02:46:13.371558 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:13.371521    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"]
Nov 04 02:46:13.379035 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:13.378996    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/premium-w2-1e4f1e-kserve-5f794bc898-s4874"]
Nov 04 02:46:13.488557 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:13.488470    4548 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"]
Nov 04 02:46:13.495302 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:13.495265    4548 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w2-1e4f1e/distinct-w2-1e4f1e-kserve-5bb69d5f8f-9lcrt"]
Nov 04 02:46:14.522818 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:14.522790    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="7bea1b32-d4ba-496c-b17d-b0b2d459010f" path="/var/lib/kubelet/pods/7bea1b32-d4ba-496c-b17d-b0b2d459010f/volumes"
Nov 04 02:46:14.523272 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:14.523225    4548 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="9a38c5ae-db84-40c1-bb28-e7f7e7842b4a" path="/var/lib/kubelet/pods/9a38c5ae-db84-40c1-bb28-e7f7e7842b4a/volumes"
Nov 04 02:46:31.491833 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:31.491785    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-785f46d47c-6xj7p_eaed5222-8ec7-4d25-aa3f-9246c736643f/authorino/0.log"
Nov 04 02:46:31.878418 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:31.878383    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-fswlr_f2850da4-b47d-4643-b196-e916720d8e05/manager/0.log"
Nov 04 02:46:32.125662 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:32.125629    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-ll6br_b71cf041-25c1-4269-b62d-48aec85bf660/manager/0.log"
Nov 04 02:46:33.532680 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:33.532631    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-f9kjr_51a542d5-9e7d-43c6-894e-effabe622978/manager/0.log"
Nov 04 02:46:33.995474 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:33.995377    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-b2r9v_a269fbce-7da0-4be1-b18e-2b571e1a870a/manager/0.log"
Nov 04 02:46:35.052433 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:35.052381    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-f6fb8bb7-gkb7n_c75bb18b-ba06-4a79-9839-e2ac02ef62d1/manager/0.log"
Nov 04 02:46:40.612502 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:46:40.612375    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:46:42.106916 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:42.106873    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-785f46d47c-6xj7p_eaed5222-8ec7-4d25-aa3f-9246c736643f/authorino/0.log"
Nov 04 02:46:54.418212 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:54.418104    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-f6fb8bb7-gkb7n_c75bb18b-ba06-4a79-9839-e2ac02ef62d1/manager/0.log"
Nov 04 02:46:58.072582 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:58.072555    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-1843228f-r9v4k_e0c33980-029c-47c2-9a85-4745b1255f6f/revoke-keys/0.log"
Nov 04 02:46:58.325161 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:58.325074    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-4e663206-96kzl_eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d/revoke-keys/0.log"
Nov 04 02:46:58.562696 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:46:58.562667    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-sub-f00adea7-2zhhw_00f20d1c-c37b-49db-9466-70fcce6b03af/revoke-keys/0.log"
Nov 04 02:47:00.833090 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:00.833053    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-785f46d47c-6xj7p_eaed5222-8ec7-4d25-aa3f-9246c736643f/authorino/0.log"
Nov 04 02:47:01.183420 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:01.183337    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-fswlr_f2850da4-b47d-4643-b196-e916720d8e05/manager/0.log"
Nov 04 02:47:01.429643 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:01.429487    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-ll6br_b71cf041-25c1-4269-b62d-48aec85bf660/manager/0.log"
Nov 04 02:47:02.436431 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:02.436383    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-f9kjr_51a542d5-9e7d-43c6-894e-effabe622978/manager/0.log"
Nov 04 02:47:02.913490 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:02.913444    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-b2r9v_a269fbce-7da0-4be1-b18e-2b571e1a870a/manager/0.log"
Nov 04 02:47:03.953637 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:03.953602    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-79f98cb86f2b78h_51bb2c26-5dfb-442e-9653-ce7e01362efa/istio-proxy/0.log"
Nov 04 02:47:05.396021 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:05.395991    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-8qbmc_81770132-1880-4850-8c83-ac484d671ba5/istio-proxy/0.log"
Nov 04 02:47:05.627978 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:05.627940    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-9rmjg_a8df164d-d2b2-469b-8203-cb157a218c8a/istio-proxy/0.log"
Nov 04 02:47:06.119322 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:06.119290    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-fm8nm_23147413-4835-469c-8d48-a9e14776d20c/istio-proxy/0.log"
Nov 04 02:47:06.652687 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:06.652652    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-q7hnw_0f11c2f4-cf3d-4a32-af0d-2eb177b7264d/istio-proxy/0.log"
Nov 04 02:47:07.403277 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:07.403245    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w_ea254707-d181-4b6b-8982-afeabe972d09/istio-proxy/0.log"
Nov 04 02:47:09.303232 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:09.303198    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-9fhrc_4175a613-1eb4-468b-b609-e32980da64dc/main/0.log"
Nov 04 02:47:09.864610 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:09.864576    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-fcdkx_1e43f9ba-e833-466b-bc3e-c2e9792a7fd0/main/0.log"
Nov 04 02:47:10.146951 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:10.146859    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-rtvdm_a0e47877-89f0-49db-a246-af40154deacc/main/0.log"
Nov 04 02:47:10.611108 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:47:10.611070    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:47:10.952327 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:10.952243    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-wqtpd_984140c9-4374-48c2-ba1e-2f784c87abb7/main/0.log"
Nov 04 02:47:11.223141 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:11.223049    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5f5c4b459f-s752z_8eafd96d-c3bb-494f-9b45-96c2d1d7bc00/main/0.log"
Nov 04 02:47:22.147700 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.147661    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-svbl4/must-gather-pt8xd"]
Nov 04 02:47:22.148111 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.148067    4548 cpu_manager.go:414] "containerMap: removing container" podUID="7bea1b32-d4ba-496c-b17d-b0b2d459010f" containerName="main"
Nov 04 02:47:22.148111 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.148077    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="7bea1b32-d4ba-496c-b17d-b0b2d459010f" containerName="main"
Nov 04 02:47:22.148111 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.148097    4548 cpu_manager.go:414] "containerMap: removing container" podUID="9a38c5ae-db84-40c1-bb28-e7f7e7842b4a" containerName="main"
Nov 04 02:47:22.148111 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.148102    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="9a38c5ae-db84-40c1-bb28-e7f7e7842b4a" containerName="main"
Nov 04 02:47:22.148111 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.148111    4548 cpu_manager.go:414] "containerMap: removing container" podUID="eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d" containerName="revoke-keys"
Nov 04 02:47:22.148291 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.148116    4548 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d" containerName="revoke-keys"
Nov 04 02:47:22.148291 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.148213    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="7bea1b32-d4ba-496c-b17d-b0b2d459010f" containerName="main"
Nov 04 02:47:22.148291 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.148221    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="9a38c5ae-db84-40c1-bb28-e7f7e7842b4a" containerName="main"
Nov 04 02:47:22.148291 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.148229    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="eb0388a8-3ab7-41e4-99e7-3e1e58c2c47d" containerName="revoke-keys"
Nov 04 02:47:22.148291 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.148235    4548 memory_manager.go:365] "RemoveStaleState removing state" podUID="765164d9-fde8-43e6-bd5d-527b9bd69a23" containerName="istio-proxy"
Nov 04 02:47:22.152895 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.152871    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-svbl4/must-gather-pt8xd"
Nov 04 02:47:22.209760 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.209718    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-svbl4/must-gather-pt8xd"]
Nov 04 02:47:22.217327 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.217293    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99pck\" (UniqueName: \"kubernetes.io/projected/c3ea1057-0183-46bd-ba20-250b0ec35b3a-kube-api-access-99pck\") pod \"must-gather-pt8xd\" (UID: \"c3ea1057-0183-46bd-ba20-250b0ec35b3a\") " pod="openshift-must-gather-svbl4/must-gather-pt8xd"
Nov 04 02:47:22.217505 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.217352    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c3ea1057-0183-46bd-ba20-250b0ec35b3a-must-gather-output\") pod \"must-gather-pt8xd\" (UID: \"c3ea1057-0183-46bd-ba20-250b0ec35b3a\") " pod="openshift-must-gather-svbl4/must-gather-pt8xd"
Nov 04 02:47:22.256821 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.256775    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-svbl4\"/\"openshift-service-ca.crt\""
Nov 04 02:47:22.256821 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.256785    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-svbl4\"/\"kube-root-ca.crt\""
Nov 04 02:47:22.257051 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.256787    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-svbl4\"/\"default-dockercfg-xwwgz\""
Nov 04 02:47:22.318578 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.318542    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99pck\" (UniqueName: \"kubernetes.io/projected/c3ea1057-0183-46bd-ba20-250b0ec35b3a-kube-api-access-99pck\") pod \"must-gather-pt8xd\" (UID: \"c3ea1057-0183-46bd-ba20-250b0ec35b3a\") " pod="openshift-must-gather-svbl4/must-gather-pt8xd"
Nov 04 02:47:22.318744 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.318631    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c3ea1057-0183-46bd-ba20-250b0ec35b3a-must-gather-output\") pod \"must-gather-pt8xd\" (UID: \"c3ea1057-0183-46bd-ba20-250b0ec35b3a\") " pod="openshift-must-gather-svbl4/must-gather-pt8xd"
Nov 04 02:47:22.319000 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.318979    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/c3ea1057-0183-46bd-ba20-250b0ec35b3a-must-gather-output\") pod \"must-gather-pt8xd\" (UID: \"c3ea1057-0183-46bd-ba20-250b0ec35b3a\") " pod="openshift-must-gather-svbl4/must-gather-pt8xd"
Nov 04 02:47:22.379887 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.379854    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99pck\" (UniqueName: \"kubernetes.io/projected/c3ea1057-0183-46bd-ba20-250b0ec35b3a-kube-api-access-99pck\") pod \"must-gather-pt8xd\" (UID: \"c3ea1057-0183-46bd-ba20-250b0ec35b3a\") " pod="openshift-must-gather-svbl4/must-gather-pt8xd"
Nov 04 02:47:22.468469 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.468377    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-svbl4/must-gather-pt8xd"
Nov 04 02:47:22.891789 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.891757    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-svbl4/must-gather-pt8xd"]
Nov 04 02:47:22.893068 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:47:22.893036    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3ea1057_0183_46bd_ba20_250b0ec35b3a.slice/crio-551fc6f5fbafcb9cfb3426890d2a2555cafd997b6dfbbfc8d0c84881a5ccacbf WatchSource:0}: Error finding container 551fc6f5fbafcb9cfb3426890d2a2555cafd997b6dfbbfc8d0c84881a5ccacbf: Status 404 returned error can't find the container with id 551fc6f5fbafcb9cfb3426890d2a2555cafd997b6dfbbfc8d0c84881a5ccacbf
Nov 04 02:47:22.894928 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:22.894912    4548 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Nov 04 02:47:23.636215 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:23.636160    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-svbl4/must-gather-pt8xd" event={"ID":"c3ea1057-0183-46bd-ba20-250b0ec35b3a","Type":"ContainerStarted","Data":"551fc6f5fbafcb9cfb3426890d2a2555cafd997b6dfbbfc8d0c84881a5ccacbf"}
Nov 04 02:47:30.687717 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:30.687670    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-svbl4/must-gather-pt8xd" event={"ID":"c3ea1057-0183-46bd-ba20-250b0ec35b3a","Type":"ContainerStarted","Data":"c692655e46beb5331af7b4b6d90f713590529972c58ec21f7e530bbe770dea29"}
Nov 04 02:47:30.688261 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:30.687729    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-svbl4/must-gather-pt8xd" event={"ID":"c3ea1057-0183-46bd-ba20-250b0ec35b3a","Type":"ContainerStarted","Data":"7fb3d3892b8732f43153d5496565a1a55796d73c745b9adab8c82948f7d6b11e"}
Nov 04 02:47:30.805107 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:30.805050    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-svbl4/must-gather-pt8xd" podStartSLOduration=1.922661626 podStartE2EDuration="8.805036587s" totalImagesPullingTime="6.882374961s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-11-04 02:47:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:47:30.804163026 +0000 UTC m=+1884.409176024" watchObservedRunningTime="2026-11-04 02:47:30.805036587 +0000 UTC m=+1884.410049602"
Nov 04 02:47:31.687910 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:31.687880    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bfrx9_c36eb6b7-750c-49f0-a11d-5a168f75eb29/global-pull-secret-syncer/0.log"
Nov 04 02:47:34.136530 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:34.136494    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-f6fb8bb7-gkb7n_c75bb18b-ba06-4a79-9839-e2ac02ef62d1/manager/0.log"
Nov 04 02:47:35.379742 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:35.379702    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-g4rp8_7a5c331c-c911-474a-b893-f39e9285a677/konnectivity-agent/0.log"
Nov 04 02:47:36.229217 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:36.229153    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-155.us-west-2.compute.internal_9e236c28d3c011f48f26e1ef488876d0/haproxy/0.log"
Nov 04 02:47:39.056079 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:39.056043    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-f6fb8bb7-gkb7n_c75bb18b-ba06-4a79-9839-e2ac02ef62d1/manager/0.log"
Nov 04 02:47:40.037280 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:40.037241    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-785f46d47c-6xj7p_eaed5222-8ec7-4d25-aa3f-9246c736643f/authorino/0.log"
Nov 04 02:47:40.341580 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:40.341491    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-fswlr_f2850da4-b47d-4643-b196-e916720d8e05/manager/0.log"
Nov 04 02:47:40.611569 ip-10-0-130-155 kubenswrapper[4548]: E1104 02:47:40.611470    4548 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-xctgd" containerName="extractor"
Nov 04 02:47:40.734689 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:40.734656    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-ll6br_b71cf041-25c1-4269-b62d-48aec85bf660/manager/0.log"
Nov 04 02:47:41.781005 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:41.780966    4548 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"]
Nov 04 02:47:41.789608 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:41.789580    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:41.841878 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:41.841848    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"]
Nov 04 02:47:41.888180 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:41.888143    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpqsl\"/\"openshift-service-ca.crt\""
Nov 04 02:47:41.888180 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:41.888160    4548 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wpqsl\"/\"default-dockercfg-qfzcp\""
Nov 04 02:47:41.888488 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:41.888292    4548 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpqsl\"/\"kube-root-ca.crt\""
Nov 04 02:47:41.928383 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:41.928324    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87c20942-c79c-4a8b-aad4-a6bc2a96187f-sys\") pod \"perf-node-gather-daemonset-dsdp6\" (UID: \"87c20942-c79c-4a8b-aad4-a6bc2a96187f\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:41.928608 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:41.928476    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m79bx\" (UniqueName: \"kubernetes.io/projected/87c20942-c79c-4a8b-aad4-a6bc2a96187f-kube-api-access-m79bx\") pod \"perf-node-gather-daemonset-dsdp6\" (UID: \"87c20942-c79c-4a8b-aad4-a6bc2a96187f\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:41.928608 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:41.928555    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87c20942-c79c-4a8b-aad4-a6bc2a96187f-lib-modules\") pod \"perf-node-gather-daemonset-dsdp6\" (UID: \"87c20942-c79c-4a8b-aad4-a6bc2a96187f\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:41.928736 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:41.928613    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/87c20942-c79c-4a8b-aad4-a6bc2a96187f-proc\") pod \"perf-node-gather-daemonset-dsdp6\" (UID: \"87c20942-c79c-4a8b-aad4-a6bc2a96187f\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:41.928736 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:41.928719    4548 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/87c20942-c79c-4a8b-aad4-a6bc2a96187f-podres\") pod \"perf-node-gather-daemonset-dsdp6\" (UID: \"87c20942-c79c-4a8b-aad4-a6bc2a96187f\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:41.997056 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:41.997021    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-f9kjr_51a542d5-9e7d-43c6-894e-effabe622978/manager/0.log"
Nov 04 02:47:42.029878 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:42.029833    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87c20942-c79c-4a8b-aad4-a6bc2a96187f-sys\") pod \"perf-node-gather-daemonset-dsdp6\" (UID: \"87c20942-c79c-4a8b-aad4-a6bc2a96187f\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:42.030092 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:42.029917    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m79bx\" (UniqueName: \"kubernetes.io/projected/87c20942-c79c-4a8b-aad4-a6bc2a96187f-kube-api-access-m79bx\") pod \"perf-node-gather-daemonset-dsdp6\" (UID: \"87c20942-c79c-4a8b-aad4-a6bc2a96187f\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:42.030092 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:42.029955    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87c20942-c79c-4a8b-aad4-a6bc2a96187f-lib-modules\") pod \"perf-node-gather-daemonset-dsdp6\" (UID: \"87c20942-c79c-4a8b-aad4-a6bc2a96187f\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:42.030092 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:42.029986    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/87c20942-c79c-4a8b-aad4-a6bc2a96187f-proc\") pod \"perf-node-gather-daemonset-dsdp6\" (UID: \"87c20942-c79c-4a8b-aad4-a6bc2a96187f\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:42.030092 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:42.029980    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/87c20942-c79c-4a8b-aad4-a6bc2a96187f-sys\") pod \"perf-node-gather-daemonset-dsdp6\" (UID: \"87c20942-c79c-4a8b-aad4-a6bc2a96187f\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:42.030092 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:42.030070    4548 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/87c20942-c79c-4a8b-aad4-a6bc2a96187f-podres\") pod \"perf-node-gather-daemonset-dsdp6\" (UID: \"87c20942-c79c-4a8b-aad4-a6bc2a96187f\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:42.030092 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:42.030074    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/87c20942-c79c-4a8b-aad4-a6bc2a96187f-lib-modules\") pod \"perf-node-gather-daemonset-dsdp6\" (UID: \"87c20942-c79c-4a8b-aad4-a6bc2a96187f\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:42.030092 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:42.030072    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/87c20942-c79c-4a8b-aad4-a6bc2a96187f-proc\") pod \"perf-node-gather-daemonset-dsdp6\" (UID: \"87c20942-c79c-4a8b-aad4-a6bc2a96187f\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:42.030427 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:42.030118    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/87c20942-c79c-4a8b-aad4-a6bc2a96187f-podres\") pod \"perf-node-gather-daemonset-dsdp6\" (UID: \"87c20942-c79c-4a8b-aad4-a6bc2a96187f\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:42.092490 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:42.092408    4548 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m79bx\" (UniqueName: \"kubernetes.io/projected/87c20942-c79c-4a8b-aad4-a6bc2a96187f-kube-api-access-m79bx\") pod \"perf-node-gather-daemonset-dsdp6\" (UID: \"87c20942-c79c-4a8b-aad4-a6bc2a96187f\") " pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:42.105515 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:42.105478    4548 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:42.487764 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:42.487737    4548 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"]
Nov 04 02:47:42.489734 ip-10-0-130-155 kubenswrapper[4548]: W1104 02:47:42.489703    4548 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod87c20942_c79c_4a8b_aad4_a6bc2a96187f.slice/crio-e0d3447a5e2cfb5bcbfdb61731edc250522e895820935c44a5a7de269afbff21 WatchSource:0}: Error finding container e0d3447a5e2cfb5bcbfdb61731edc250522e895820935c44a5a7de269afbff21: Status 404 returned error can't find the container with id e0d3447a5e2cfb5bcbfdb61731edc250522e895820935c44a5a7de269afbff21
Nov 04 02:47:42.753927 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:42.753824    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-b2r9v_a269fbce-7da0-4be1-b18e-2b571e1a870a/manager/0.log"
Nov 04 02:47:42.761957 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:42.761918    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6" event={"ID":"87c20942-c79c-4a8b-aad4-a6bc2a96187f","Type":"ContainerStarted","Data":"fc8b831bb28dc2ca172931e0e8d0480e2861c0a5e22c5081335b121f051adc26"}
Nov 04 02:47:42.762164 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:42.761975    4548 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6" event={"ID":"87c20942-c79c-4a8b-aad4-a6bc2a96187f","Type":"ContainerStarted","Data":"e0d3447a5e2cfb5bcbfdb61731edc250522e895820935c44a5a7de269afbff21"}
Nov 04 02:47:42.762164 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:42.761998    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:42.880362 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:42.880301    4548 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6" podStartSLOduration=1.880282062 podStartE2EDuration="1.880282062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-11-04 02:47:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-11-04 02:47:42.879500862 +0000 UTC m=+1896.484513861" watchObservedRunningTime="2026-11-04 02:47:42.880282062 +0000 UTC m=+1896.485295059"
Nov 04 02:47:44.045352 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:44.045319    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_ai-gateway-controller-f6fb8bb7-gkb7n_c75bb18b-ba06-4a79-9839-e2ac02ef62d1/manager/0.log"
Nov 04 02:47:48.779488 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:48.779458    4548 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wpqsl/perf-node-gather-daemonset-dsdp6"
Nov 04 02:47:49.348926 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:49.348888    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-79f98cb86f2b78h_51bb2c26-5dfb-442e-9653-ce7e01362efa/istio-proxy/0.log"
Nov 04 02:47:51.392555 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:51.392517    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-8qbmc_81770132-1880-4850-8c83-ac484d671ba5/istio-proxy/0.log"
Nov 04 02:47:51.613935 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:51.613894    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-9rmjg_a8df164d-d2b2-469b-8203-cb157a218c8a/istio-proxy/0.log"
Nov 04 02:47:51.843572 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:51.843534    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fbjpj_6d947c81-33f3-4b2c-88f2-cc9a842d240d/node-exporter/0.log"
Nov 04 02:47:52.046821 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:52.046790    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-fm8nm_23147413-4835-469c-8d48-a9e14776d20c/istio-proxy/0.log"
Nov 04 02:47:52.234745 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:52.234661    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fbjpj_6d947c81-33f3-4b2c-88f2-cc9a842d240d/kube-rbac-proxy/0.log"
Nov 04 02:47:52.491214 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:52.491102    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-fd4b99879-q7hnw_0f11c2f4-cf3d-4a32-af0d-2eb177b7264d/istio-proxy/0.log"
Nov 04 02:47:52.627427 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:52.627397    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fbjpj_6d947c81-33f3-4b2c-88f2-cc9a842d240d/init-textfile/0.log"
Nov 04 02:47:53.166425 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:53.166387    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_openshift-ai-inference-openshift-ai-inference-666dbc6559-sdd6w_ea254707-d181-4b6b-8982-afeabe972d09/istio-proxy/0.log"
Nov 04 02:47:58.174796 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:58.174752    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-785f46d47c-6xj7p_eaed5222-8ec7-4d25-aa3f-9246c736643f/authorino/0.log"
Nov 04 02:47:58.288091 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:58.288054    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-7b7bb4bc77-fswlr_f2850da4-b47d-4643-b196-e916720d8e05/manager/0.log"
Nov 04 02:47:58.493698 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:58.493611    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-8557cbdb84-ll6br_b71cf041-25c1-4269-b62d-48aec85bf660/manager/0.log"
Nov 04 02:47:59.333136 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:59.333095    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-678d87766f-f9kjr_51a542d5-9e7d-43c6-894e-effabe622978/manager/0.log"
Nov 04 02:47:59.700418 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:47:59.700334    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-5778bb4449-b2r9v_a269fbce-7da0-4be1-b18e-2b571e1a870a/manager/0.log"
Nov 04 02:48:00.926967 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:48:00.926934    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b8865689d-rmzbk_8f256b50-7193-4e27-9edd-340c99f0384e/thanos-query/0.log"
Nov 04 02:48:01.323745 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:48:01.323706    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b8865689d-rmzbk_8f256b50-7193-4e27-9edd-340c99f0384e/kube-rbac-proxy-web/0.log"
Nov 04 02:48:01.716251 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:48:01.716153    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b8865689d-rmzbk_8f256b50-7193-4e27-9edd-340c99f0384e/kube-rbac-proxy/0.log"
Nov 04 02:48:02.109965 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:48:02.109938    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b8865689d-rmzbk_8f256b50-7193-4e27-9edd-340c99f0384e/prom-label-proxy/0.log"
Nov 04 02:48:02.502717 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:48:02.502620    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b8865689d-rmzbk_8f256b50-7193-4e27-9edd-340c99f0384e/kube-rbac-proxy-rules/0.log"
Nov 04 02:48:02.897652 ip-10-0-130-155 kubenswrapper[4548]: I1104 02:48:02.897619    4548 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5b8865689d-rmzbk_8f256b50-7193-4e27-9edd-340c99f0384e/kube-rbac-proxy-metrics/0.log"