Oct 31 00:33:06.609469 ip-10-0-143-7 systemd[1]: Starting Kubernetes Kubelet...
Oct 31 00:33:06.983250 ip-10-0-143-7 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 00:33:06.983250 ip-10-0-143-7 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 31 00:33:06.983250 ip-10-0-143-7 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 00:33:06.983250 ip-10-0-143-7 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 00:33:06.986186 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986102    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:33:06.986186 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986185    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:33:06.986186 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986189    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986193    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986197    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986200    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986202    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986206    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986208    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986211    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986214    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986230    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986233    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986235    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986238    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986241    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986244    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986246    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986251    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986255    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986267    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:33:06.986290 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986271    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986274    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986278    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986281    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986284    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986287    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986290    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986292    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986295    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986298    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986301    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986304    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986307    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986309    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986312    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986314    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986317    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986319    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986322    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986324    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:33:06.986721 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986326    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986329    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986331    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986334    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986337    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986339    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986342    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986345    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986347    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986350    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986353    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986357    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986360    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986363    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986368    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986371    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986373    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986376    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986379    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:33:06.987185 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986382    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986384    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986387    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986390    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986393    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986396    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986398    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986401    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986404    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986406    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986409    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986411    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986414    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986417    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986419    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986422    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986424    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986427    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986430    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986432    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:33:06.987624 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986436    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986438    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986441    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986443    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986446    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986448    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986451    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986454    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986457    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986459    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986462    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986465    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986468    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986470    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986473    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986475    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986478    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986480    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986483    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:33:06.988094 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986485    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986488    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986491    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986494    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986496    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986499    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.986502    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987328    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987335    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987339    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987342    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987345    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987347    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987351    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987354    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987357    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987360    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987362    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987365    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987368    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:33:06.988588 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987371    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987374    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987377    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987379    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987382    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987384    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987387    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987389    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987392    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987394    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987397    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987400    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987403    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987405    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987408    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987410    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987413    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987416    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987418    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987420    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:33:06.989074 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987423    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987425    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987428    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987431    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987433    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987436    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987439    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987442    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987445    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987448    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987450    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987453    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987456    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987459    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987462    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987464    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987467    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987469    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987472    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987475    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:33:06.989559 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987477    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987480    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987482    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987485    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987487    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987490    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987492    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987496    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987501    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987505    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987509    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987512    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987515    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987518    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987521    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987524    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987526    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987529    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987532    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:33:06.990048 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987535    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987538    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987541    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987545    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987547    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987550    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987553    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987556    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987558    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987560    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987563    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987566    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987568    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987571    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987574    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987576    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987579    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987582    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987584    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:33:06.990590 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987587    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987589    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987592    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987595    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987597    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987600    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987603    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987605    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987608    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987612    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987615    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987618    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987620    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987623    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.987625    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988107    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988112    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988115    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988118    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988120    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:33:06.991043 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988123    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988126    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988128    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988131    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988134    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988136    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988139    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988142    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988145    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988147    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988150    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988152    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988155    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988158    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988161    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988163    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988167    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988169    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988172    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988175    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:33:06.991528 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988177    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988180    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988183    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988185    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988188    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988190    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988193    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988196    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988198    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988201    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988203    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988206    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988208    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988211    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988213    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988230    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988233    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988236    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988239    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:33:06.992006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988242    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988245    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988247    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988250    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988253    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988255    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988258    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988261    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988263    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988266    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988269    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988272    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988275    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988278    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988280    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988283    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988286    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988288    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988291    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988293    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:33:06.992467 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988296    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988299    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988301    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988304    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988307    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988310    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988312    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988314    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988317    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988320    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988322    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988327    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988330    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988334    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988337    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988340    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988343    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988345    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988349    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:33:06.992977 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988352    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988355    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988357    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988360    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988362    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988365    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988368    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988371    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988373    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988376    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988379    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988381    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988384    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988387    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988390    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988393    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988395    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988400    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988404    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:33:06.993431 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988407    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988410    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988412    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.988415    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990369    2581 flags.go:64] FLAG: --address="0.0.0.0"
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990381    2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990389    2581 flags.go:64] FLAG: --anonymous-auth="true"
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990393    2581 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990398    2581 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990401    2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990408    2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990413    2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990416    2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990419    2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990423    2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990426    2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990429    2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990432    2581 flags.go:64] FLAG: --cgroup-root=""
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990435    2581 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990438    2581 flags.go:64] FLAG: --client-ca-file=""
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990441    2581 flags.go:64] FLAG: --cloud-provider="external"
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990444    2581 flags.go:64] FLAG: --cluster-dns="[]"
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990448    2581 flags.go:64] FLAG: --cluster-domain=""
Oct 31 00:33:06.993885 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990451    2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990454    2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990458    2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990461    2581 flags.go:64] FLAG: --container-log-max-files="5"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990465    2581 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990468    2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990472    2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990475    2581 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990479    2581 flags.go:64] FLAG: --contention-profiling="false"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990482    2581 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990484    2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990487    2581 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990490    2581 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990494    2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990498    2581 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990501    2581 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990503    2581 flags.go:64] FLAG: --enable-load-reader="false"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990506    2581 flags.go:64] FLAG: --enable-server="true"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990509    2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990514    2581 flags.go:64] FLAG: --event-burst="100"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990517    2581 flags.go:64] FLAG: --event-qps="50"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990520    2581 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990523    2581 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990526    2581 flags.go:64] FLAG: --eviction-hard=""
Oct 31 00:33:06.994438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990531    2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990534    2581 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990537    2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990540    2581 flags.go:64] FLAG: --eviction-soft=""
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990543    2581 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990547    2581 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990550    2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990553    2581 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990555    2581 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990558    2581 flags.go:64] FLAG: --fail-swap-on="true"
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990561    2581 flags.go:64] FLAG: --feature-gates=""
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990566    2581 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990569    2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990572    2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990575    2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990579    2581 flags.go:64] FLAG: --healthz-port="10248"
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990582    2581 flags.go:64] FLAG: --help="false"
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990585    2581 flags.go:64] FLAG: --hostname-override="ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990588    2581 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990591    2581 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990594    2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990598    2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990601    2581 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 31 00:33:06.995022 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990604    2581 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990607    2581 flags.go:64] FLAG: --image-service-endpoint=""
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990610    2581 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990613    2581 flags.go:64] FLAG: --kube-api-burst="100"
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990616    2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990619    2581 flags.go:64] FLAG: --kube-api-qps="50"
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990622    2581 flags.go:64] FLAG: --kube-reserved=""
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990625    2581 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990628    2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990631    2581 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990634    2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990637    2581 flags.go:64] FLAG: --lock-file=""
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990640    2581 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990643    2581 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990646    2581 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990652    2581 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990655    2581 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990658    2581 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990661    2581 flags.go:64] FLAG: --logging-format="text"
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990665    2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990668    2581 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990671    2581 flags.go:64] FLAG: --manifest-url=""
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990674    2581 flags.go:64] FLAG: --manifest-url-header=""
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990679    2581 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990682    2581 flags.go:64] FLAG: --max-open-files="1000000"
Oct 31 00:33:06.995576 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990686    2581 flags.go:64] FLAG: --max-pods="110"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990690    2581 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990693    2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990696    2581 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990699    2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990702    2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990705    2581 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990708    2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990719    2581 flags.go:64] FLAG: --node-status-max-images="50"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990722    2581 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990725    2581 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990728    2581 flags.go:64] FLAG: --pod-cidr=""
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990731    2581 flags.go:64] FLAG: --pod-manifest-path=""
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990734    2581 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990737    2581 flags.go:64] FLAG: --pods-per-core="0"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990740    2581 flags.go:64] FLAG: --port="10250"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990744    2581 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990746    2581 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-04763f1704efb3225"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990750    2581 flags.go:64] FLAG: --qos-reserved=""
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990753    2581 flags.go:64] FLAG: --read-only-port="10255"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990756    2581 flags.go:64] FLAG: --register-node="true"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990759    2581 flags.go:64] FLAG: --register-with-taints=""
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990762    2581 flags.go:64] FLAG: --registry-burst="10"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990767    2581 flags.go:64] FLAG: --registry-qps="5"
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990770    2581 flags.go:64] FLAG: --reserved-cpus=""
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990773    2581 flags.go:64] FLAG: --reserved-memory=""
Oct 31 00:33:06.996183 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990777    2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990781    2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990784    2581 flags.go:64] FLAG: --rotate-certificates="false"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990786    2581 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990789    2581 flags.go:64] FLAG: --runonce="false"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990792    2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990796    2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990799    2581 flags.go:64] FLAG: --seccomp-default="false"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990802    2581 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990805    2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990808    2581 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990811    2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990816    2581 flags.go:64] FLAG: --storage-driver-password="root"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990819    2581 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990822    2581 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990825    2581 flags.go:64] FLAG: --storage-driver-user="root"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990828    2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990831    2581 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990834    2581 flags.go:64] FLAG: --system-cgroups=""
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990837    2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990842    2581 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990845    2581 flags.go:64] FLAG: --tls-cert-file=""
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990848    2581 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990853    2581 flags.go:64] FLAG: --tls-min-version=""
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990855    2581 flags.go:64] FLAG: --tls-private-key-file=""
Oct 31 00:33:06.997399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990858    2581 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990861    2581 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990864    2581 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990867    2581 flags.go:64] FLAG: --v="2"
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990873    2581 flags.go:64] FLAG: --version="false"
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990877    2581 flags.go:64] FLAG: --vmodule=""
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990881    2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.990884    2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991023    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991027    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991029    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991032    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991035    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991037    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991040    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991043    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991046    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991048    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991051    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991055    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991058    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:33:06.997988 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991060    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991063    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991066    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991068    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991071    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991073    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991076    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991079    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991081    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991084    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991087    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991090    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991092    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991095    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991098    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991101    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991104    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991107    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991109    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991112    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:33:06.998560 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991114    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991117    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991120    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991123    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991125    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991128    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991130    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991133    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991136    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991138    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991142    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991144    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991147    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991150    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991152    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991156    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991158    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991161    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991164    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991166    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:33:06.999049 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991169    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991171    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991174    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991176    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991179    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991181    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991184    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991188    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991190    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991193    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991195    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991198    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991201    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991203    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991206    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991208    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991210    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991213    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991227    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991230    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:33:06.999535 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991233    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991235    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991239    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991242    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991245    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991247    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991250    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991253    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991255    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991258    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991262    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991266    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991270    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991273    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991276    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991279    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991281    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991284    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991286    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:33:06.999994 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991291    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:33:07.000539 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991293    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:33:07.000539 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991297    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:33:07.000539 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991301    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:33:07.000539 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991304    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:33:07.000539 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991307    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:33:07.000539 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991310    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:33:07.000539 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991312    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:33:07.000539 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991315    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:33:07.000539 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991318    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:33:07.000539 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991320    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:33:07.000539 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991323    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:33:07.000539 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991325    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:33:07.000539 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991328    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:33:07.000539 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.991355    2581 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 00:33:07.000539 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991391    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991396    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991399    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991402    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991405    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991407    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991410    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991412    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991415    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991417    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991420    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991423    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991425    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991428    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991430    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991433    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991436    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991439    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991442    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991445    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:33:07.001156 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991448    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991450    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991453    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991455    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991458    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991460    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991463    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991466    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991468    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991471    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991473    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991476    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991479    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991483    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991486    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991488    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991491    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991494    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991496    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991499    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:33:07.001962 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991502    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991504    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991507    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991509    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991512    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991514    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991517    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991519    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991522    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991526    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991528    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991531    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991534    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991537    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991539    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991542    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991545    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991547    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991550    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:33:07.002482 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991552    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991555    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991557    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991560    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991562    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991565    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991569    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991572    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991575    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991577    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991580    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991582    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991585    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991587    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991590    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991593    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991595    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991598    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991602    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:33:07.002964 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991606    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991609    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991611    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991615    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991618    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991620    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991623    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991625    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991628    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991631    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991635    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991639    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991641    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991644    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991647    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991649    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991652    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991656    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991658    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:33:07.003495 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991662    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991665    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991668    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991671    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991673    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991676    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991678    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991681    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.991684    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.997908    2581 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.997923    2581 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.997939    2581 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.997944    2581 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.997999    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998004    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998008    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998011    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998014    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998017    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998020    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:33:07.003941 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998023    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998027    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998031    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998034    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998037    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998040    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998042    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998045    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998048    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998050    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998054    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998057    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998060    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998063    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998065    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998068    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998071    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998073    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998076    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:33:07.004452 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998079    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998081    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998084    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998088    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998091    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998094    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998096    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998099    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998102    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998104    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998107    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998110    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998112    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998115    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998117    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998120    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998123    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998141    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998145    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998148    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:33:07.004897 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998151    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998154    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998156    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998159    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998162    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998164    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998167    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998169    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998172    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998174    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998177    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998180    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998183    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998185    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998188    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998191    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998195    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998197    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998200    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998203    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:33:07.005475 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998206    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998208    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998211    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998214    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998230    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998233    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998236    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998238    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998241    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998244    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998246    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998249    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998252    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998255    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998258    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998260    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998263    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998265    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998268    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998271    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:33:07.005960 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998273    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998276    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998278    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998281    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998284    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998286    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998289    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998292    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998295    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998298    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998301    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998304    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998307    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998309    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998312    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998315    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998317    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998320    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998322    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:33:07.006443 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998325    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:33:07.006880 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.998352    2581 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 00:33:07.006880 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998507    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:33:07.006880 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998512    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:33:07.006880 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998515    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:33:07.006880 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998518    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:33:07.006880 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998521    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:33:07.006880 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998524    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:33:07.006880 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998526    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:33:07.006880 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998529    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:33:07.006880 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998531    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:33:07.006880 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998534    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:33:07.006880 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998536    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:33:07.006880 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998539    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:33:07.006880 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998542    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:33:07.006880 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998545    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:33:07.006880 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998548    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998551    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998553    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998556    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998559    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998562    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998564    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998568    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998571    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998574    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998576    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998579    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998581    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998584    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998587    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998590    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998593    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998595    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998597    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:33:07.007265 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998611    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998615    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998618    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998621    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998624    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998626    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998629    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998632    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998634    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998637    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998640    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998642    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998646    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998648    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998651    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998653    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998656    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998659    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998661    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998664    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:33:07.007710 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998666    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998669    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998672    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998675    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998677    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998680    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998682    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998685    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998688    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998690    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998693    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998695    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998698    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998701    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998703    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998707    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998711    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998714    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998717    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:33:07.008187 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998720    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998723    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998725    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998729    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998732    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998736    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998739    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998742    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998744    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998747    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998750    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998752    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998755    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998757    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998760    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998763    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998766    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998768    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998771    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:33:07.008672 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998773    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:33:07.009129 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998776    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:33:07.009129 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998778    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:33:07.009129 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998781    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:33:07.009129 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998783    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:33:07.009129 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998786    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:33:07.009129 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998788    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:33:07.009129 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998791    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:33:07.009129 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998793    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:33:07.009129 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998796    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:33:07.009129 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998798    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:33:07.009129 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998801    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:33:07.009129 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998803    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:33:07.009129 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998806    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:33:07.009129 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998808    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:33:07.009129 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.998830    2581 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 00:33:07.009129 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998860    2581 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998864    2581 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998867    2581 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998871    2581 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998873    2581 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998876    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998878    2581 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998881    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998884    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998886    2581 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998889    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998892    2581 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998895    2581 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998898    2581 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998900    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998903    2581 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998905    2581 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998908    2581 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998910    2581 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998912    2581 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:33:07.009518 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998915    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998917    2581 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998920    2581 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998922    2581 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998925    2581 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998927    2581 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998930    2581 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998932    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998935    2581 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998937    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998940    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998942    2581 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998945    2581 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998947    2581 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998950    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998952    2581 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998955    2581 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998957    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998960    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998962    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:33:07.010006 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998965    2581 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998967    2581 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998970    2581 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998972    2581 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998975    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998977    2581 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998980    2581 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998983    2581 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998986    2581 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998988    2581 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998991    2581 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998993    2581 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998995    2581 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.998998    2581 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999000    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999003    2581 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999005    2581 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999007    2581 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999010    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999012    2581 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:33:07.010531 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999015    2581 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:33:07.011000 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999018    2581 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:33:07.011000 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999020    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:33:07.011000 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999023    2581 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:33:07.011000 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999025    2581 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:33:07.011000 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999028    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:33:07.011000 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999030    2581 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:33:07.011000 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999033    2581 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:33:07.011000 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999037    2581 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:33:07.011000 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999040    2581 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:33:07.011000 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999044    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:33:07.011000 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999047    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:33:07.011000 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999049    2581 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:33:07.011000 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999052    2581 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:33:07.011000 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999055    2581 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:33:07.011000 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999058    2581 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:33:07.011000 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999062    2581 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:33:07.011000 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999065    2581 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:33:07.011000 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999068    2581 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999071    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999073    2581 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999076    2581 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999078    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999081    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999083    2581 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999086    2581 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999088    2581 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999091    2581 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999093    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999096    2581 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999098    2581 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999101    2581 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999104    2581 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999106    2581 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999109    2581 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999111    2581 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999114    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:33:07.011544 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999116    2581 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:33:07.012065 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999119    2581 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:33:07.012065 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999121    2581 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:33:07.012065 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999124    2581 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:33:07.012065 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999126    2581 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:33:07.012065 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999129    2581 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:33:07.012065 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999131    2581 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:33:07.012065 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999134    2581 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:33:07.012065 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:06.999136    2581 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:33:07.012065 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:06.999199    2581 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 31 00:33:07.012065 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.002339    2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Oct 31 00:33:07.012065 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.003198    2581 server.go:1014] "Starting client certificate rotation"
Oct 31 00:33:07.012065 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.003244    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 00:33:07.012065 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.003286    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 00:33:07.012065 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.005126    2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 00:33:07.012065 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.008373    2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 00:33:07.020248 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.020231    2581 log.go:25] "Validated CRI v1 runtime API"
Oct 31 00:33:07.024860 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.024839    2581 log.go:25] "Validated CRI v1 image API"
Oct 31 00:33:07.025690 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.025659    2581 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 31 00:33:07.027803 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.027786    2581 fs.go:135] Filesystem UUIDs: map[2b5a8051-3cdc-4ec6-8e19-ed00e6f78f54:/dev/nvme0n1p4 5ec7ac56-1aaf-4e6f-bf06-73d4edae3578:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Oct 31 00:33:07.027861 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.027803    2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0}]
Oct 31 00:33:07.033688 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.033545    2581 manager.go:217] Machine: {Timestamp:2026-10-31 00:33:07.032270869 +0000 UTC m=+0.318036335 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101623 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23696cce784fc6b37b0ac6eec84b73 SystemUUID:ec23696c-ce78-4fc6-b37b-0ac6eec84b73 BootID:16f837e7-c902-479b-9f27-3d9ac09de4f0 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:d1:5f:c9:37 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:d1:5f:c9:37 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:06:d1:ae:69:3e:e5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 31 00:33:07.033760 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.033692    2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 31 00:33:07.033787 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.033775    2581 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 31 00:33:07.035973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.035947    2581 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 31 00:33:07.036129 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.035975    2581 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-7.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 31 00:33:07.036170 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.036131    2581 topology_manager.go:143] "Creating topology manager with none policy"
Oct 31 00:33:07.036170 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.036140    2581 container_manager_linux.go:311] "Creating device plugin manager"
Oct 31 00:33:07.036170 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.036165    2581 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 00:33:07.036259 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.036182    2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 00:33:07.036864 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.036854    2581 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 31 00:33:07.038493 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.038472    2581 reflector.go:446] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 31 00:33:07.040613 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.040601    2581 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 31 00:33:07.040753 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.040744    2581 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 31 00:33:07.040788 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.040774    2581 kubelet.go:493] "Attempting to sync node with API server"
Oct 31 00:33:07.040818 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.040792    2581 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 31 00:33:07.040869 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.040860    2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 31 00:33:07.040900 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.040876    2581 kubelet.go:405] "Adding apiserver pod source"
Oct 31 00:33:07.040927 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.040901    2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 31 00:33:07.041328 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.041316    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 00:33:07.044249 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.044185    2581 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 31 00:33:07.049817 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.049802    2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 00:33:07.050569 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.050556    2581 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 31 00:33:07.050618 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.050591    2581 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 31 00:33:07.050744 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.050734    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 31 00:33:07.050779 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.050750    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 31 00:33:07.050779 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.050756    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 31 00:33:07.050779 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.050761    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 31 00:33:07.050779 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.050767    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 31 00:33:07.050779 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.050773    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 31 00:33:07.051209 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.051199    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 31 00:33:07.051209 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.051209    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 31 00:33:07.051288 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.051229    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 31 00:33:07.051288 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.051236    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 31 00:33:07.051288 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.051245    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 31 00:33:07.051288 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.051253    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 31 00:33:07.051858 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.051847    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 31 00:33:07.051858 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.051856    2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 31 00:33:07.055208 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.055190    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bc4nq"
Oct 31 00:33:07.055893 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.055880    2581 server.go:1263] "Started kubelet"
Oct 31 00:33:07.056013 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.055963    2581 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 31 00:33:07.056196 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.055970    2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 31 00:33:07.056301 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.056188    2581 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 31 00:33:07.056824 ip-10-0-143-7 systemd[1]: Started Kubernetes Kubelet.
Oct 31 00:33:07.057195 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.057178    2581 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 31 00:33:07.058482 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.058374    2581 server.go:317] "Adding debug handlers to kubelet server"
Oct 31 00:33:07.061820 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.061784    2581 kubelet.go:1679] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Oct 31 00:33:07.062482 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.062463    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bc4nq"
Oct 31 00:33:07.062611 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.062593    2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 31 00:33:07.063665 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.063641    2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-7.us-east-2.compute.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Oct 31 00:33:07.064012 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.063994    2581 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 31 00:33:07.064528 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.064484    2581 reflector.go:204] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Service"
Oct 31 00:33:07.064632 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.063569    2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-7.us-east-2.compute.internal.18e375f8903d1930  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-7.us-east-2.compute.internal,UID:,APIVersion:v1,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-7.us-east-2.compute.internal,},FirstTimestamp:2026-10-31 00:33:07.055851824 +0000 UTC m=+0.341617290,LastTimestamp:2026-10-31 00:33:07.055851824 +0000 UTC m=+0.341617290,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-7.us-east-2.compute.internal,}"
Oct 31 00:33:07.064632 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.064569    2581 reflector.go:204] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-7.us-east-2.compute.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.Node"
Oct 31 00:33:07.064632 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.064594    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-7.us-east-2.compute.internal\" not found"
Oct 31 00:33:07.064799 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.064746    2581 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 31 00:33:07.064799 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.064758    2581 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 31 00:33:07.064799 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.064766    2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 31 00:33:07.064912 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.064873    2581 reconstruct.go:97] "Volume reconstruction finished"
Oct 31 00:33:07.064912 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.064883    2581 reconciler.go:29] "Reconciler: start to sync state"
Oct 31 00:33:07.065034 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.065021    2581 factory.go:55] Registering systemd factory
Oct 31 00:33:07.065071 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.065039    2581 factory.go:223] Registration of the systemd container factory successfully
Oct 31 00:33:07.065260 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.065246    2581 factory.go:153] Registering CRI-O factory
Oct 31 00:33:07.065308 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.065262    2581 factory.go:223] Registration of the crio container factory successfully
Oct 31 00:33:07.065308 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.065299    2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 31 00:33:07.065378 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.065369    2581 factory.go:103] Registering Raw factory
Oct 31 00:33:07.065409 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.065384    2581 manager.go:1199] Started watching for new ooms in manager
Oct 31 00:33:07.066432 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.066414    2581 manager.go:319] Starting recovery of all containers
Oct 31 00:33:07.072438 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.072414    2581 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:33:07.074315 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.074292    2581 nodelease.go:50] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-7.us-east-2.compute.internal\" not found" node="ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:07.078800 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.078781    2581 manager.go:324] Recovery completed
Oct 31 00:33:07.080918 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.080897    2581 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Oct 31 00:33:07.083707 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.083693    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:33:07.085505 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.085487    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:33:07.085598 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.085520    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:33:07.085598 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.085533    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:33:07.086077 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.086064    2581 cpu_manager.go:226] "Starting" policy="none"
Oct 31 00:33:07.086077 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.086071    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:33:07.086198 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.086075    2581 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 31 00:33:07.086198 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.086125    2581 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 31 00:33:07.086787 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.086772    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:33:07.086870 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.086797    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:33:07.086870 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.086807    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:33:07.088525 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.088512    2581 policy_none.go:50] "Start"
Oct 31 00:33:07.088581 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.088527    2581 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 31 00:33:07.088581 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.088538    2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 31 00:33:07.090584 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.090571    2581 policy_none.go:44] "Start"
Oct 31 00:33:07.135899 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.135753    2581 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 31 00:33:07.141755 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.141742    2581 manager.go:341] "Starting Device Plugin manager"
Oct 31 00:33:07.141822 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.141769    2581 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 31 00:33:07.141822 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.141778    2581 server.go:87] "Starting device plugin registration server"
Oct 31 00:33:07.141985 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.141973    2581 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 31 00:33:07.142018 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.141988    2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 31 00:33:07.142078 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.142065    2581 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 31 00:33:07.142177 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.142164    2581 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 31 00:33:07.142249 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.142177    2581 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 31 00:33:07.142741 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.142725    2581 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 31 00:33:07.142887 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.142867    2581 eviction_manager.go:297] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-7.us-east-2.compute.internal\" not found"
Oct 31 00:33:07.256169 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.242342    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:33:07.256169 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.243199    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:33:07.256169 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.243240    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:33:07.256169 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.243254    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:33:07.256169 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.243287    2581 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:07.256169 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.251249    2581 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:07.256169 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.251275    2581 kubelet_node_status.go:524] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-7.us-east-2.compute.internal\": node \"ip-10-0-143-7.us-east-2.compute.internal\" not found"
Oct 31 00:33:07.265323 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.265307    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-7.us-east-2.compute.internal\" not found"
Oct 31 00:33:07.335746 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.335713    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 31 00:33:07.336914 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.336901    2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 31 00:33:07.336975 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.336919    2581 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 31 00:33:07.336975 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.336935    2581 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 31 00:33:07.336975 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.336966    2581 kubelet.go:2545] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Oct 31 00:33:07.343339 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.343325    2581 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:33:07.365443 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.365428    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-7.us-east-2.compute.internal\" not found"
Oct 31 00:33:07.437679 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.437639    2581 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal"]
Oct 31 00:33:07.437795 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.437717    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:33:07.438644 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.438628    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:33:07.438722 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.438657    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:33:07.438722 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.438671    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:33:07.440921 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.440908    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:33:07.441090 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.441075    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:07.441157 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.441110    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:33:07.441689 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.441665    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:33:07.441782 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.441706    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:33:07.441782 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.441720    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:33:07.441782 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.441667    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:33:07.441782 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.441768    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:33:07.441782 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.441777    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:33:07.443786 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.443770    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:07.443847 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.443800    2581 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:33:07.444454 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.444436    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:33:07.444536 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.444460    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:33:07.444536 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.444469    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:33:07.465714 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.465691    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-7.us-east-2.compute.internal\" not found"
Oct 31 00:33:07.465833 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.465742    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/483afccfa0bddca2d4a120103d33e513-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal\" (UID: \"483afccfa0bddca2d4a120103d33e513\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:07.465833 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.465764    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/483afccfa0bddca2d4a120103d33e513-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal\" (UID: \"483afccfa0bddca2d4a120103d33e513\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:07.465833 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.465783    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b5ed8cacd37cfc52fe028fc738a55eb8-config\") pod \"kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal\" (UID: \"b5ed8cacd37cfc52fe028fc738a55eb8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:07.469741 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.469722    2581 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-7.us-east-2.compute.internal\" not found" node="ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:07.471836 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.471818    2581 kubelet.go:3364] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-7.us-east-2.compute.internal\" not found" node="ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:07.566572 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.566493    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-7.us-east-2.compute.internal\" not found"
Oct 31 00:33:07.566572 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.566530    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/483afccfa0bddca2d4a120103d33e513-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal\" (UID: \"483afccfa0bddca2d4a120103d33e513\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:07.566572 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.566561    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/483afccfa0bddca2d4a120103d33e513-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal\" (UID: \"483afccfa0bddca2d4a120103d33e513\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:07.566760 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.566577    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b5ed8cacd37cfc52fe028fc738a55eb8-config\") pod \"kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal\" (UID: \"b5ed8cacd37cfc52fe028fc738a55eb8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:07.566760 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.566599    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/483afccfa0bddca2d4a120103d33e513-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal\" (UID: \"483afccfa0bddca2d4a120103d33e513\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:07.566760 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.566611    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b5ed8cacd37cfc52fe028fc738a55eb8-config\") pod \"kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal\" (UID: \"b5ed8cacd37cfc52fe028fc738a55eb8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:07.566760 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.566617    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/483afccfa0bddca2d4a120103d33e513-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal\" (UID: \"483afccfa0bddca2d4a120103d33e513\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:07.666852 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.666812    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-7.us-east-2.compute.internal\" not found"
Oct 31 00:33:07.767176 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.767152    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-7.us-east-2.compute.internal\" not found"
Oct 31 00:33:07.772337 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.772318    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:07.774465 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:07.774452    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:07.867926 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.867852    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-7.us-east-2.compute.internal\" not found"
Oct 31 00:33:07.968214 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:07.968186    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-7.us-east-2.compute.internal\" not found"
Oct 31 00:33:08.003386 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:08.003358    2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Oct 31 00:33:08.003848 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:08.003522    2581 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 31 00:33:08.003848 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:08.003557    2581 reflector.go:578] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:161" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:161: Unexpected watch close - watch lasted less than a second and no items received"
Oct 31 00:33:08.058578 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:08.058548    2581 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:33:08.068169 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:08.068130    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 00:28:07 +0000 UTC" deadline="2028-04-08 02:15:03.79700302 +0000 UTC"
Oct 31 00:33:08.068169 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:08.068168    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12601h41m55.728838706s"
Oct 31 00:33:08.069317 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:08.069302    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-7.us-east-2.compute.internal\" not found"
Oct 31 00:33:08.169790 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:08.169720    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-7.us-east-2.compute.internal\" not found"
Oct 31 00:33:08.270366 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:08.270336    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-7.us-east-2.compute.internal\" not found"
Oct 31 00:33:08.371435 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:08.371407    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-7.us-east-2.compute.internal\" not found"
Oct 31 00:33:08.436200 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:08.436169    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod483afccfa0bddca2d4a120103d33e513.slice/crio-a33a4ec8d8ae616c47c8b62e20445a8474a9fc60f2986e0b1a5ded0ba841b466 WatchSource:0}: Error finding container a33a4ec8d8ae616c47c8b62e20445a8474a9fc60f2986e0b1a5ded0ba841b466: Status 404 returned error can't find the container with id a33a4ec8d8ae616c47c8b62e20445a8474a9fc60f2986e0b1a5ded0ba841b466
Oct 31 00:33:08.445213 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:08.445195    2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:33:08.446745 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:08.446718    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5ed8cacd37cfc52fe028fc738a55eb8.slice/crio-8f9aad4a22467b6b1f05aee4d3026871f1cc98a52c3f301d1c1ddb0cde549352 WatchSource:0}: Error finding container 8f9aad4a22467b6b1f05aee4d3026871f1cc98a52c3f301d1c1ddb0cde549352: Status 404 returned error can't find the container with id 8f9aad4a22467b6b1f05aee4d3026871f1cc98a52c3f301d1c1ddb0cde549352
Oct 31 00:33:08.472476 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:08.472450    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-7.us-east-2.compute.internal\" not found"
Oct 31 00:33:08.573269 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:08.573238    2581 kubelet_node_status.go:442] "Error getting the current node from lister" err="node \"ip-10-0-143-7.us-east-2.compute.internal\" not found"
Oct 31 00:33:08.619363 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:08.619346    2581 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:33:08.665706 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:08.665680    2581 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:08.693816 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:08.693761    2581 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:33:08.695245 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:08.695218    2581 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:33:08.719011 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:08.718994    2581 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:33:09.042636 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.042568    2581 apiserver.go:52] "Watching apiserver"
Oct 31 00:33:09.052057 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.052037    2581 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 31 00:33:09.052405 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.052382    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t","openshift-cluster-node-tuning-operator/tuned-mxsc9","openshift-image-registry/node-ca-4pdvd","openshift-network-diagnostics/network-check-target-wf75m","kube-system/konnectivity-agent-p2ntf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal","openshift-ovn-kubernetes/ovnkube-node-knmm8","openshift-multus/multus-additional-cni-plugins-dbnzk","openshift-multus/multus-j7x85","openshift-network-operator/iptables-alerter-jsw5n","kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal","openshift-dns/node-resolver-4pvl9","openshift-multus/network-metrics-daemon-wcnrx","kube-system/global-pull-secret-syncer-zdznl"]
Oct 31 00:33:09.055143 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.055123    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.057599 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.057578    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:09.057705 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.057644    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcnrx" podUID="0883a925-b7f8-44b8-a889-4d3cc5af9fe8"
Oct 31 00:33:09.059973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.059758    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 31 00:33:09.059973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.059770    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 31 00:33:09.059973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.059759    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 31 00:33:09.059973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.059794    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 31 00:33:09.060230 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.060151    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4pdvd"
Oct 31 00:33:09.061344 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.061323    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 31 00:33:09.061447 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.061439    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b29sj\""
Oct 31 00:33:09.061590 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.061571    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 31 00:33:09.062530 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.062477    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:09.062646 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.062562    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wf75m" podUID="26ab7116-31a7-404c-8a01-6502edf9f5ce"
Oct 31 00:33:09.063100 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.063080    2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Oct 31 00:33:09.065290 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.065265    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p2ntf"
Oct 31 00:33:09.067842 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.067825    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:09.067939 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.067880    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdznl" podUID="90fdba20-20ae-405d-bd58-0756cc1fdcad"
Oct 31 00:33:09.070211 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.070191    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.075352 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.074405    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.075352 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.074964    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-run-openvswitch\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.075352 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075011    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66f8ebac-f187-49d1-acf8-ec86c904c475-host\") pod \"node-ca-4pdvd\" (UID: \"66f8ebac-f187-49d1-acf8-ec86c904c475\") " pod="openshift-image-registry/node-ca-4pdvd"
Oct 31 00:33:09.075352 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075048    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f68jv\" (UniqueName: \"kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv\") pod \"network-check-target-wf75m\" (UID: \"26ab7116-31a7-404c-8a01-6502edf9f5ce\") " pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:09.075352 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075107    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5sj7\" (UniqueName: \"kubernetes.io/projected/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-kube-api-access-m5sj7\") pod \"network-metrics-daemon-wcnrx\" (UID: \"0883a925-b7f8-44b8-a889-4d3cc5af9fe8\") " pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:09.075352 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075145    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e1748202-4b8b-4c5d-891e-5f68728124ea-ovnkube-script-lib\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.075352 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075176    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-kubelet\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.075352 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075210    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.075352 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075245    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-slash\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.075352 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075293    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-etc-openvswitch\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.075352 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075320    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-cni-bin\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.075352 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075352    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e1748202-4b8b-4c5d-891e-5f68728124ea-env-overrides\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.075973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075387    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4spf\" (UniqueName: \"kubernetes.io/projected/66f8ebac-f187-49d1-acf8-ec86c904c475-kube-api-access-w4spf\") pod \"node-ca-4pdvd\" (UID: \"66f8ebac-f187-49d1-acf8-ec86c904c475\") " pod="openshift-image-registry/node-ca-4pdvd"
Oct 31 00:33:09.075973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075442    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01-agent-certs\") pod \"konnectivity-agent-p2ntf\" (UID: \"7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01\") " pod="kube-system/konnectivity-agent-p2ntf"
Oct 31 00:33:09.075973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075479    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-systemd-units\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.075973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075505    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-run-ovn\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.075973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075544    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.075973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075575    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-cni-netd\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.075973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075610    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e1748202-4b8b-4c5d-891e-5f68728124ea-ovnkube-config\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.075973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075643    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1748202-4b8b-4c5d-891e-5f68728124ea-ovn-node-metrics-cert\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.075973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075672    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs\") pod \"network-metrics-daemon-wcnrx\" (UID: \"0883a925-b7f8-44b8-a889-4d3cc5af9fe8\") " pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:09.075973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075711    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-node-log\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.075973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075745    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k422l\" (UniqueName: \"kubernetes.io/projected/e1748202-4b8b-4c5d-891e-5f68728124ea-kube-api-access-k422l\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.075973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075860    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66f8ebac-f187-49d1-acf8-ec86c904c475-serviceca\") pod \"node-ca-4pdvd\" (UID: \"66f8ebac-f187-49d1-acf8-ec86c904c475\") " pod="openshift-image-registry/node-ca-4pdvd"
Oct 31 00:33:09.075973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075895    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01-konnectivity-ca\") pod \"konnectivity-agent-p2ntf\" (UID: \"7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01\") " pod="kube-system/konnectivity-agent-p2ntf"
Oct 31 00:33:09.075973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075928    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-log-socket\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.075973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075960    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-run-netns\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.076688 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.075992    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-run-systemd\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.076688 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.076020    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-var-lib-openvswitch\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.078685 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.078660    2581 reflector.go:446] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Oct 31 00:33:09.079121 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.079103    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.081749 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.081730    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jsw5n"
Oct 31 00:33:09.084032 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.084007    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.086648 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.086630    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4pvl9"
Oct 31 00:33:09.100725 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.100704    2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vmjzs"
Oct 31 00:33:09.110030 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.110009    2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vmjzs"
Oct 31 00:33:09.167074 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.167040    2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 31 00:33:09.168776 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.168491    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 31 00:33:09.168776 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.168557    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 31 00:33:09.168776 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.168559    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 31 00:33:09.168776 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.168679    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:33:09.168776 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.168696    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 31 00:33:09.169127 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.168851    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:33:09.169127 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.168932    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hkzgb\""
Oct 31 00:33:09.169127 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.169095    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 31 00:33:09.169317 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.169154    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 31 00:33:09.170496 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.170471    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 31 00:33:09.170496 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.170483    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 31 00:33:09.170496 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.170502    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 31 00:33:09.170709 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.170556    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 31 00:33:09.170709 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.170572    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 31 00:33:09.170709 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.170557    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cvzdq\""
Oct 31 00:33:09.170709 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.170592    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 31 00:33:09.170709 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.170631    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 31 00:33:09.170709 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.170645    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 31 00:33:09.170709 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.170667    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 31 00:33:09.170709 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.170690    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ppkcp\""
Oct 31 00:33:09.171116 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.171046    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 31 00:33:09.171177 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.171133    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 31 00:33:09.171177 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.171143    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-k5rkn\""
Oct 31 00:33:09.171269 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.171221    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 31 00:33:09.172452 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.172431    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-8fmps\""
Oct 31 00:33:09.172555 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.172470    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lfknl\""
Oct 31 00:33:09.172555 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.172508    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jwzf5\""
Oct 31 00:33:09.172555 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.172519    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kxg2f\""
Oct 31 00:33:09.172711 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.172619    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 31 00:33:09.176813 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.176786    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-sys-fs\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.176908 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.176833    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-modprobe-d\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.176908 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.176884    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thmlk\" (UniqueName: \"kubernetes.io/projected/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-kube-api-access-thmlk\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.177028 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.176976    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.177088 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177048    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/90fdba20-20ae-405d-bd58-0756cc1fdcad-kubelet-config\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:09.177088 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177071    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.177179 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177072    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-run-k8s-cni-cncf-io\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.177179 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177130    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.177179 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177163    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-socket-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.177319 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177182    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-etc-openvswitch\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.177319 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177200    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4spf\" (UniqueName: \"kubernetes.io/projected/66f8ebac-f187-49d1-acf8-ec86c904c475-kube-api-access-w4spf\") pod \"node-ca-4pdvd\" (UID: \"66f8ebac-f187-49d1-acf8-ec86c904c475\") " pod="openshift-image-registry/node-ca-4pdvd"
Oct 31 00:33:09.177319 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177218    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01-agent-certs\") pod \"konnectivity-agent-p2ntf\" (UID: \"7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01\") " pod="kube-system/konnectivity-agent-p2ntf"
Oct 31 00:33:09.177319 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177255    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-var-lib-kubelet\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.177319 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177279    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-etc-openvswitch\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.177319 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177282    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6bd3d849-76a8-410d-8aa1-400e57cbaded-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.177619 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177323    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-registration-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.177619 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177369    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-device-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.177619 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177396    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-sysconfig\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.177619 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177420    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-run-multus-certs\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.177619 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bd3d849-76a8-410d-8aa1-400e57cbaded-system-cni-dir\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.177619 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177516    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bd3d849-76a8-410d-8aa1-400e57cbaded-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.177619 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-systemd-units\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.178080 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177644    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-systemd-units\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.178080 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177678    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-run-ovn\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.178080 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177710    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-cni-netd\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.178080 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177665    2581 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 31 00:33:09.178080 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177879    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-cni-netd\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.178080 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177984    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-run-ovn\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.178080 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.177735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1748202-4b8b-4c5d-891e-5f68728124ea-ovn-node-metrics-cert\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.178383 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178115    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs\") pod \"network-metrics-daemon-wcnrx\" (UID: \"0883a925-b7f8-44b8-a889-4d3cc5af9fe8\") " pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:09.178383 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178136    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k422l\" (UniqueName: \"kubernetes.io/projected/e1748202-4b8b-4c5d-891e-5f68728124ea-kube-api-access-k422l\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.178383 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66f8ebac-f187-49d1-acf8-ec86c904c475-serviceca\") pod \"node-ca-4pdvd\" (UID: \"66f8ebac-f187-49d1-acf8-ec86c904c475\") " pod="openshift-image-registry/node-ca-4pdvd"
Oct 31 00:33:09.178383 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178204    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-hostroot\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.178383 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178241    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-sysctl-conf\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.178383 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.178257    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:33:09.178383 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178263    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-host\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.178383 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.178324    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs podName:0883a925-b7f8-44b8-a889-4d3cc5af9fe8 nodeName:}" failed. No retries permitted until 2026-10-31 00:33:09.67830205 +0000 UTC m=+2.964067528 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs") pod "network-metrics-daemon-wcnrx" (UID: "0883a925-b7f8-44b8-a889-4d3cc5af9fe8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:33:09.178383 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178329    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m5kc\" (UniqueName: \"kubernetes.io/projected/0b7e45fa-6f09-4d02-bc42-e89d46d954b6-kube-api-access-5m5kc\") pod \"iptables-alerter-jsw5n\" (UID: \"0b7e45fa-6f09-4d02-bc42-e89d46d954b6\") " pod="openshift-network-operator/iptables-alerter-jsw5n"
Oct 31 00:33:09.178383 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178357    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0420aed9-f163-474d-a19f-2db0bfdb32e6-hosts-file\") pod \"node-resolver-4pvl9\" (UID: \"0420aed9-f163-474d-a19f-2db0bfdb32e6\") " pod="openshift-dns/node-resolver-4pvl9"
Oct 31 00:33:09.178383 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178381    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-run-netns\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.178832 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178406    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-run-systemd\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.178832 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178429    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-system-cni-dir\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.178832 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178454    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b7e45fa-6f09-4d02-bc42-e89d46d954b6-iptables-alerter-script\") pod \"iptables-alerter-jsw5n\" (UID: \"0b7e45fa-6f09-4d02-bc42-e89d46d954b6\") " pod="openshift-network-operator/iptables-alerter-jsw5n"
Oct 31 00:33:09.178832 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178479    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66f8ebac-f187-49d1-acf8-ec86c904c475-host\") pod \"node-ca-4pdvd\" (UID: \"66f8ebac-f187-49d1-acf8-ec86c904c475\") " pod="openshift-image-registry/node-ca-4pdvd"
Oct 31 00:33:09.178832 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178505    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f68jv\" (UniqueName: \"kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv\") pod \"network-check-target-wf75m\" (UID: \"26ab7116-31a7-404c-8a01-6502edf9f5ce\") " pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:09.178832 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178553    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-socket-dir-parent\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.178832 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178589    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-kubernetes\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.178832 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178622    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-cni-dir\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.178832 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178650    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-daemon-config\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.178832 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178676    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww699\" (UniqueName: \"kubernetes.io/projected/8f7af1c9-c623-41f4-8923-ea931d7c08ab-kube-api-access-ww699\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.178832 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178703    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psclh\" (UniqueName: \"kubernetes.io/projected/6bd3d849-76a8-410d-8aa1-400e57cbaded-kube-api-access-psclh\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.178832 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178735    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e1748202-4b8b-4c5d-891e-5f68728124ea-ovnkube-script-lib\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.178832 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178761    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f7af1c9-c623-41f4-8923-ea931d7c08ab-cni-binary-copy\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.178832 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178797    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-run-netns\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.179600 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178903    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmwt7\" (UniqueName: \"kubernetes.io/projected/0420aed9-f163-474d-a19f-2db0bfdb32e6-kube-api-access-qmwt7\") pod \"node-resolver-4pvl9\" (UID: \"0420aed9-f163-474d-a19f-2db0bfdb32e6\") " pod="openshift-dns/node-resolver-4pvl9"
Oct 31 00:33:09.179600 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-kubelet\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.179600 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178961    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bd3d849-76a8-410d-8aa1-400e57cbaded-cnibin\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.179600 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.178989    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bd3d849-76a8-410d-8aa1-400e57cbaded-cni-binary-copy\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.179600 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179017    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llfdt\" (UniqueName: \"kubernetes.io/projected/45efeeda-0c9c-461c-bb19-c43de5b9566a-kube-api-access-llfdt\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.179600 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179046    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-slash\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.179600 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179065    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-run-netns\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.179600 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179072    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-cni-bin\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.179600 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179113    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e1748202-4b8b-4c5d-891e-5f68728124ea-env-overrides\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.179600 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179157    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-etc-selinux\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.179600 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179163    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-cni-bin\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.179600 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179243    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-kubelet\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.179600 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179247    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-slash\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.179600 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179282    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66f8ebac-f187-49d1-acf8-ec86c904c475-host\") pod \"node-ca-4pdvd\" (UID: \"66f8ebac-f187-49d1-acf8-ec86c904c475\") " pod="openshift-image-registry/node-ca-4pdvd"
Oct 31 00:33:09.179600 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179284    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-sysctl-d\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.179600 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179336    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-run\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.179600 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179367    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6bd3d849-76a8-410d-8aa1-400e57cbaded-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.180542 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.180542 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179461    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e1748202-4b8b-4c5d-891e-5f68728124ea-ovnkube-config\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.180542 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179488    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-var-lib-cni-multus\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.180542 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179514    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-lib-modules\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.180542 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179544    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0420aed9-f163-474d-a19f-2db0bfdb32e6-tmp-dir\") pod \"node-resolver-4pvl9\" (UID: \"0420aed9-f163-474d-a19f-2db0bfdb32e6\") " pod="openshift-dns/node-resolver-4pvl9"
Oct 31 00:33:09.180542 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179571    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-node-log\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.180542 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179599    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01-konnectivity-ca\") pod \"konnectivity-agent-p2ntf\" (UID: \"7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01\") " pod="kube-system/konnectivity-agent-p2ntf"
Oct 31 00:33:09.180542 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179666    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-node-log\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.180542 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179671    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-cnibin\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.180542 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179691    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.180542 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179720    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-log-socket\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.180542 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179727    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-run-systemd\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.180542 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179797    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-log-socket\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.180542 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-var-lib-openvswitch\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.180542 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.179936    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-sys\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.180542 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.180030    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-var-lib-openvswitch\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.180542 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.180077    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-var-lib-kubelet\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.181396 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.180107    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-run-openvswitch\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.181396 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.180443    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66f8ebac-f187-49d1-acf8-ec86c904c475-serviceca\") pod \"node-ca-4pdvd\" (UID: \"66f8ebac-f187-49d1-acf8-ec86c904c475\") " pod="openshift-image-registry/node-ca-4pdvd"
Oct 31 00:33:09.181396 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.180605    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e1748202-4b8b-4c5d-891e-5f68728124ea-ovnkube-script-lib\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.181396 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.180654    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-var-lib-cni-bin\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.181396 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.180689    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5sj7\" (UniqueName: \"kubernetes.io/projected/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-kube-api-access-m5sj7\") pod \"network-metrics-daemon-wcnrx\" (UID: \"0883a925-b7f8-44b8-a889-4d3cc5af9fe8\") " pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:09.181396 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.180718    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/90fdba20-20ae-405d-bd58-0756cc1fdcad-dbus\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:09.181396 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.180718    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e1748202-4b8b-4c5d-891e-5f68728124ea-ovnkube-config\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.181396 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.180764    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e1748202-4b8b-4c5d-891e-5f68728124ea-env-overrides\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.181396 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.180768    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-run-openvswitch\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.181396 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.180802    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:09.181396 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.180853    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-etc-kubernetes\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.181396 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.180921    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-systemd\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.181396 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.180999    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-tuned\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.181396 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.181042    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-tmp\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.181396 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.181085    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b7e45fa-6f09-4d02-bc42-e89d46d954b6-host-slash\") pod \"iptables-alerter-jsw5n\" (UID: \"0b7e45fa-6f09-4d02-bc42-e89d46d954b6\") " pod="openshift-network-operator/iptables-alerter-jsw5n"
Oct 31 00:33:09.181396 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.181120    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-conf-dir\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.181396 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.181374    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01-konnectivity-ca\") pod \"konnectivity-agent-p2ntf\" (UID: \"7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01\") " pod="kube-system/konnectivity-agent-p2ntf"
Oct 31 00:33:09.182759 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.182733    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01-agent-certs\") pod \"konnectivity-agent-p2ntf\" (UID: \"7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01\") " pod="kube-system/konnectivity-agent-p2ntf"
Oct 31 00:33:09.183585 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.183559    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1748202-4b8b-4c5d-891e-5f68728124ea-ovn-node-metrics-cert\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.191896 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.191652    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:33:09.191896 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.191678    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:33:09.191896 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.191692    2581 projected.go:196] Error preparing data for projected volume kube-api-access-f68jv for pod openshift-network-diagnostics/network-check-target-wf75m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:33:09.191896 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.191750    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv podName:26ab7116-31a7-404c-8a01-6502edf9f5ce nodeName:}" failed. No retries permitted until 2026-10-31 00:33:09.691731398 +0000 UTC m=+2.977496868 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f68jv" (UniqueName: "kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv") pod "network-check-target-wf75m" (UID: "26ab7116-31a7-404c-8a01-6502edf9f5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:33:09.191896 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.191801    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4spf\" (UniqueName: \"kubernetes.io/projected/66f8ebac-f187-49d1-acf8-ec86c904c475-kube-api-access-w4spf\") pod \"node-ca-4pdvd\" (UID: \"66f8ebac-f187-49d1-acf8-ec86c904c475\") " pod="openshift-image-registry/node-ca-4pdvd"
Oct 31 00:33:09.195385 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.195216    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5sj7\" (UniqueName: \"kubernetes.io/projected/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-kube-api-access-m5sj7\") pod \"network-metrics-daemon-wcnrx\" (UID: \"0883a925-b7f8-44b8-a889-4d3cc5af9fe8\") " pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:09.198880 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.198725    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k422l\" (UniqueName: \"kubernetes.io/projected/e1748202-4b8b-4c5d-891e-5f68728124ea-kube-api-access-k422l\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.281440 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281404    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-socket-dir-parent\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.281632 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281448    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-kubernetes\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.281632 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281477    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-cni-dir\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.281632 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281503    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-daemon-config\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.281632 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281529    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww699\" (UniqueName: \"kubernetes.io/projected/8f7af1c9-c623-41f4-8923-ea931d7c08ab-kube-api-access-ww699\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.281632 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281557    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psclh\" (UniqueName: \"kubernetes.io/projected/6bd3d849-76a8-410d-8aa1-400e57cbaded-kube-api-access-psclh\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.281632 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281564    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-kubernetes\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.281632 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281583    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f7af1c9-c623-41f4-8923-ea931d7c08ab-cni-binary-copy\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.281632 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281610    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-run-netns\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.282051 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281633    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-socket-dir-parent\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.282051 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281649    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-cni-dir\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.282051 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281637    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmwt7\" (UniqueName: \"kubernetes.io/projected/0420aed9-f163-474d-a19f-2db0bfdb32e6-kube-api-access-qmwt7\") pod \"node-resolver-4pvl9\" (UID: \"0420aed9-f163-474d-a19f-2db0bfdb32e6\") " pod="openshift-dns/node-resolver-4pvl9"
Oct 31 00:33:09.282051 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281694    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bd3d849-76a8-410d-8aa1-400e57cbaded-cnibin\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.282051 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281723    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bd3d849-76a8-410d-8aa1-400e57cbaded-cni-binary-copy\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.282051 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281753    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llfdt\" (UniqueName: \"kubernetes.io/projected/45efeeda-0c9c-461c-bb19-c43de5b9566a-kube-api-access-llfdt\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.282051 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281783    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-etc-selinux\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.282051 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281809    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-sysctl-d\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.282051 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281833    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-run\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.282051 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281859    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6bd3d849-76a8-410d-8aa1-400e57cbaded-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.282051 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281890    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-var-lib-cni-multus\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.282051 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281915    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-lib-modules\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.282051 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281942    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0420aed9-f163-474d-a19f-2db0bfdb32e6-tmp-dir\") pod \"node-resolver-4pvl9\" (UID: \"0420aed9-f163-474d-a19f-2db0bfdb32e6\") " pod="openshift-dns/node-resolver-4pvl9"
Oct 31 00:33:09.282051 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281968    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-cnibin\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.282051 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.281994    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-sys\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.282051 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282002    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-etc-selinux\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.282051 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282018    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-var-lib-kubelet\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.282881 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-var-lib-cni-bin\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.282881 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282054    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bd3d849-76a8-410d-8aa1-400e57cbaded-cnibin\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.282881 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282073    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/90fdba20-20ae-405d-bd58-0756cc1fdcad-dbus\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:09.282881 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282132    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:09.282881 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282159    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-etc-kubernetes\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.282881 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282201    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f7af1c9-c623-41f4-8923-ea931d7c08ab-cni-binary-copy\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.282881 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282187    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-systemd\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.282881 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282255    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-run-netns\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.282881 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282261    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-tuned\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.282881 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282306    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-tmp\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.282881 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b7e45fa-6f09-4d02-bc42-e89d46d954b6-host-slash\") pod \"iptables-alerter-jsw5n\" (UID: \"0b7e45fa-6f09-4d02-bc42-e89d46d954b6\") " pod="openshift-network-operator/iptables-alerter-jsw5n"
Oct 31 00:33:09.282881 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282359    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-conf-dir\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.282881 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282386    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-sys-fs\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.282881 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282407    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-daemon-config\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.282881 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282412    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-modprobe-d\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.282881 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282467    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thmlk\" (UniqueName: \"kubernetes.io/projected/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-kube-api-access-thmlk\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.282881 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282500    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/90fdba20-20ae-405d-bd58-0756cc1fdcad-kubelet-config\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:09.282881 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282523    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-var-lib-cni-bin\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.284086 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282529    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-modprobe-d\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.284086 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282589    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/90fdba20-20ae-405d-bd58-0756cc1fdcad-kubelet-config\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:09.284086 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282604    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/90fdba20-20ae-405d-bd58-0756cc1fdcad-dbus\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:09.284086 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282645    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-sysctl-d\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.284086 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282650    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-etc-kubernetes\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.284086 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282656    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b7e45fa-6f09-4d02-bc42-e89d46d954b6-host-slash\") pod \"iptables-alerter-jsw5n\" (UID: \"0b7e45fa-6f09-4d02-bc42-e89d46d954b6\") " pod="openshift-network-operator/iptables-alerter-jsw5n"
Oct 31 00:33:09.284086 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282710    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-sys-fs\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.284086 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282756    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-systemd\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.284086 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282797    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-conf-dir\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.284086 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282834    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-run-k8s-cni-cncf-io\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.284086 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282531    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-run-k8s-cni-cncf-io\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.284086 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282872    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.284086 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282879    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-run\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.284086 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282900    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-socket-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.284086 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282940    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.284086 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282992    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-cnibin\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.284086 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283012    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-var-lib-cni-multus\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.284086 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283029    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-sys\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.284716 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283039    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-socket-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.284716 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283067    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-var-lib-kubelet\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.284716 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.282604    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bd3d849-76a8-410d-8aa1-400e57cbaded-cni-binary-copy\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.284716 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283121    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-lib-modules\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.284716 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283141    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-var-lib-kubelet\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.284716 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283168    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6bd3d849-76a8-410d-8aa1-400e57cbaded-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.284716 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283174    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-var-lib-kubelet\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.284716 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283202    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-registration-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.284716 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283228    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-device-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.284716 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283251    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-sysconfig\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.284716 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283274    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-run-multus-certs\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.284716 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283316    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bd3d849-76a8-410d-8aa1-400e57cbaded-system-cni-dir\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.284716 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283340    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bd3d849-76a8-410d-8aa1-400e57cbaded-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.284716 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283385    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-hostroot\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.284716 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283410    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-sysctl-conf\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.284716 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283434    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-host\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.284716 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283450    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-run-multus-certs\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.285486 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283458    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m5kc\" (UniqueName: \"kubernetes.io/projected/0b7e45fa-6f09-4d02-bc42-e89d46d954b6-kube-api-access-5m5kc\") pod \"iptables-alerter-jsw5n\" (UID: \"0b7e45fa-6f09-4d02-bc42-e89d46d954b6\") " pod="openshift-network-operator/iptables-alerter-jsw5n"
Oct 31 00:33:09.285486 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283495    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0420aed9-f163-474d-a19f-2db0bfdb32e6-hosts-file\") pod \"node-resolver-4pvl9\" (UID: \"0420aed9-f163-474d-a19f-2db0bfdb32e6\") " pod="openshift-dns/node-resolver-4pvl9"
Oct 31 00:33:09.285486 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283545    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-system-cni-dir\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.285486 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283576    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b7e45fa-6f09-4d02-bc42-e89d46d954b6-iptables-alerter-script\") pod \"iptables-alerter-jsw5n\" (UID: \"0b7e45fa-6f09-4d02-bc42-e89d46d954b6\") " pod="openshift-network-operator/iptables-alerter-jsw5n"
Oct 31 00:33:09.285486 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283699    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-hostroot\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.285486 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283746    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bd3d849-76a8-410d-8aa1-400e57cbaded-system-cni-dir\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.285486 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283844    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-sysctl-conf\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.285486 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.283408    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:33:09.285486 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283870    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-registration-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.285486 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.283923    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret podName:90fdba20-20ae-405d-bd58-0756cc1fdcad nodeName:}" failed. No retries permitted until 2026-10-31 00:33:09.783906536 +0000 UTC m=+3.069672013 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret") pod "global-pull-secret-syncer-zdznl" (UID: "90fdba20-20ae-405d-bd58-0756cc1fdcad") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:33:09.285486 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283927    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-device-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.285486 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.283976    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-host\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.285486 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.284025    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-sysconfig\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.285486 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.284074    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0420aed9-f163-474d-a19f-2db0bfdb32e6-hosts-file\") pod \"node-resolver-4pvl9\" (UID: \"0420aed9-f163-474d-a19f-2db0bfdb32e6\") " pod="openshift-dns/node-resolver-4pvl9"
Oct 31 00:33:09.285486 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.284123    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-system-cni-dir\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.297619 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.297535    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0420aed9-f163-474d-a19f-2db0bfdb32e6-tmp-dir\") pod \"node-resolver-4pvl9\" (UID: \"0420aed9-f163-474d-a19f-2db0bfdb32e6\") " pod="openshift-dns/node-resolver-4pvl9"
Oct 31 00:33:09.298027 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.298007    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6bd3d849-76a8-410d-8aa1-400e57cbaded-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.298174 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.298151    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6bd3d849-76a8-410d-8aa1-400e57cbaded-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.298495 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.298470    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bd3d849-76a8-410d-8aa1-400e57cbaded-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.298688 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.298668    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-tmp\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.298771 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.298697    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-tuned\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.298915 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.298894    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b7e45fa-6f09-4d02-bc42-e89d46d954b6-iptables-alerter-script\") pod \"iptables-alerter-jsw5n\" (UID: \"0b7e45fa-6f09-4d02-bc42-e89d46d954b6\") " pod="openshift-network-operator/iptables-alerter-jsw5n"
Oct 31 00:33:09.299329 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.299295    2581 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:33:09.301482 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.301435    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psclh\" (UniqueName: \"kubernetes.io/projected/6bd3d849-76a8-410d-8aa1-400e57cbaded-kube-api-access-psclh\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.302256 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.302230    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llfdt\" (UniqueName: \"kubernetes.io/projected/45efeeda-0c9c-461c-bb19-c43de5b9566a-kube-api-access-llfdt\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.302709 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.302686    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m5kc\" (UniqueName: \"kubernetes.io/projected/0b7e45fa-6f09-4d02-bc42-e89d46d954b6-kube-api-access-5m5kc\") pod \"iptables-alerter-jsw5n\" (UID: \"0b7e45fa-6f09-4d02-bc42-e89d46d954b6\") " pod="openshift-network-operator/iptables-alerter-jsw5n"
Oct 31 00:33:09.303102 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.303082    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmwt7\" (UniqueName: \"kubernetes.io/projected/0420aed9-f163-474d-a19f-2db0bfdb32e6-kube-api-access-qmwt7\") pod \"node-resolver-4pvl9\" (UID: \"0420aed9-f163-474d-a19f-2db0bfdb32e6\") " pod="openshift-dns/node-resolver-4pvl9"
Oct 31 00:33:09.304373 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.304285    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thmlk\" (UniqueName: \"kubernetes.io/projected/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-kube-api-access-thmlk\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.304373 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.304324    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww699\" (UniqueName: \"kubernetes.io/projected/8f7af1c9-c623-41f4-8923-ea931d7c08ab-kube-api-access-ww699\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.342084 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.342012    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal" event={"ID":"b5ed8cacd37cfc52fe028fc738a55eb8","Type":"ContainerStarted","Data":"8f9aad4a22467b6b1f05aee4d3026871f1cc98a52c3f301d1c1ddb0cde549352"}
Oct 31 00:33:09.343667 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.343633    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal" event={"ID":"483afccfa0bddca2d4a120103d33e513","Type":"ContainerStarted","Data":"a33a4ec8d8ae616c47c8b62e20445a8474a9fc60f2986e0b1a5ded0ba841b466"}
Oct 31 00:33:09.385448 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.385417    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4pdvd"
Oct 31 00:33:09.392829 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.392648    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:09.395850 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.395787    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p2ntf"
Oct 31 00:33:09.397465 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.397082    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-j7x85"
Oct 31 00:33:09.398186 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:09.398154    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66f8ebac_f187_49d1_acf8_ec86c904c475.slice/crio-7c299a3043f0a079b20d78d440dc4211bdbb58955fee38c6137e812d96795504 WatchSource:0}: Error finding container 7c299a3043f0a079b20d78d440dc4211bdbb58955fee38c6137e812d96795504: Status 404 returned error can't find the container with id 7c299a3043f0a079b20d78d440dc4211bdbb58955fee38c6137e812d96795504
Oct 31 00:33:09.406646 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:09.406620    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1748202_4b8b_4c5d_891e_5f68728124ea.slice/crio-9a67d896966aed131375804909522399a11dd0980b09077cbb6497282a208133 WatchSource:0}: Error finding container 9a67d896966aed131375804909522399a11dd0980b09077cbb6497282a208133: Status 404 returned error can't find the container with id 9a67d896966aed131375804909522399a11dd0980b09077cbb6497282a208133
Oct 31 00:33:09.408871 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.408854    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:33:09.412399 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.412323    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:33:09.414612 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:09.414592    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f7af1c9_c623_41f4_8923_ea931d7c08ab.slice/crio-093ca6ba9183eebb21515723150a834bacea4d33046d9f55558fc5f246af546e WatchSource:0}: Error finding container 093ca6ba9183eebb21515723150a834bacea4d33046d9f55558fc5f246af546e: Status 404 returned error can't find the container with id 093ca6ba9183eebb21515723150a834bacea4d33046d9f55558fc5f246af546e
Oct 31 00:33:09.423096 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.421785    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jsw5n"
Oct 31 00:33:09.423096 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:09.422387    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45efeeda_0c9c_461c_bb19_c43de5b9566a.slice/crio-63af29665d5fd3255d1b19fdc5cce7f204b69dcd711c61f2c7cfcf86285f771c WatchSource:0}: Error finding container 63af29665d5fd3255d1b19fdc5cce7f204b69dcd711c61f2c7cfcf86285f771c: Status 404 returned error can't find the container with id 63af29665d5fd3255d1b19fdc5cce7f204b69dcd711c61f2c7cfcf86285f771c
Oct 31 00:33:09.423481 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:09.423459    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34b2bd3f_0955_482d_bf8e_0ec7de5a226a.slice/crio-30dc954be3f6dd1bd7de602a736214c348110aa32ca2028f7c4f729248c1bc8d WatchSource:0}: Error finding container 30dc954be3f6dd1bd7de602a736214c348110aa32ca2028f7c4f729248c1bc8d: Status 404 returned error can't find the container with id 30dc954be3f6dd1bd7de602a736214c348110aa32ca2028f7c4f729248c1bc8d
Oct 31 00:33:09.433460 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:09.433437    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b7e45fa_6f09_4d02_bc42_e89d46d954b6.slice/crio-82a7f8c3d05eddccebf4f83dcd2fc461c57375d2130e29c022defca00005e367 WatchSource:0}: Error finding container 82a7f8c3d05eddccebf4f83dcd2fc461c57375d2130e29c022defca00005e367: Status 404 returned error can't find the container with id 82a7f8c3d05eddccebf4f83dcd2fc461c57375d2130e29c022defca00005e367
Oct 31 00:33:09.443973 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.443809    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-4pvl9"
Oct 31 00:33:09.446315 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.446269    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:33:09.456029 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:09.455999    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0420aed9_f163_474d_a19f_2db0bfdb32e6.slice/crio-472e73657b21b4b25654d2e7484627b3b0aa2bc12bb409ff9b0e6e4af280fd29 WatchSource:0}: Error finding container 472e73657b21b4b25654d2e7484627b3b0aa2bc12bb409ff9b0e6e4af280fd29: Status 404 returned error can't find the container with id 472e73657b21b4b25654d2e7484627b3b0aa2bc12bb409ff9b0e6e4af280fd29
Oct 31 00:33:09.458400 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:09.458377    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bd3d849_76a8_410d_8aa1_400e57cbaded.slice/crio-06d3ae65be837623b620e551c3ad9a59234c1dd8a8ea8c94b9c57b1a1e24e782 WatchSource:0}: Error finding container 06d3ae65be837623b620e551c3ad9a59234c1dd8a8ea8c94b9c57b1a1e24e782: Status 404 returned error can't find the container with id 06d3ae65be837623b620e551c3ad9a59234c1dd8a8ea8c94b9c57b1a1e24e782
Oct 31 00:33:09.496574 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.496544    2581 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:33:09.686122 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.686043    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs\") pod \"network-metrics-daemon-wcnrx\" (UID: \"0883a925-b7f8-44b8-a889-4d3cc5af9fe8\") " pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:09.686321 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.686241    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:33:09.686383 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.686328    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs podName:0883a925-b7f8-44b8-a889-4d3cc5af9fe8 nodeName:}" failed. No retries permitted until 2026-10-31 00:33:10.686305888 +0000 UTC m=+3.972071358 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs") pod "network-metrics-daemon-wcnrx" (UID: "0883a925-b7f8-44b8-a889-4d3cc5af9fe8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:33:09.786857 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.786817    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f68jv\" (UniqueName: \"kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv\") pod \"network-check-target-wf75m\" (UID: \"26ab7116-31a7-404c-8a01-6502edf9f5ce\") " pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:09.787032 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:09.786887    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:09.787032 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.787027    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:33:09.787134 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.787097    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret podName:90fdba20-20ae-405d-bd58-0756cc1fdcad nodeName:}" failed. No retries permitted until 2026-10-31 00:33:10.787077992 +0000 UTC m=+4.072843463 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret") pod "global-pull-secret-syncer-zdznl" (UID: "90fdba20-20ae-405d-bd58-0756cc1fdcad") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:33:09.787567 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.787546    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:33:09.787567 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.787569    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:33:09.787726 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.787584    2581 projected.go:196] Error preparing data for projected volume kube-api-access-f68jv for pod openshift-network-diagnostics/network-check-target-wf75m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:33:09.787726 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:09.787631    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv podName:26ab7116-31a7-404c-8a01-6502edf9f5ce nodeName:}" failed. No retries permitted until 2026-10-31 00:33:10.787616284 +0000 UTC m=+4.073381757 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f68jv" (UniqueName: "kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv") pod "network-check-target-wf75m" (UID: "26ab7116-31a7-404c-8a01-6502edf9f5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:33:10.114204 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:10.114076    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 00:28:09 +0000 UTC" deadline="2028-04-06 04:05:33.992077251 +0000 UTC"
Oct 31 00:33:10.114772 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:10.114203    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12555h32m23.877935009s"
Oct 31 00:33:10.337599 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:10.337563    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:10.337774 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:10.337701    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdznl" podUID="90fdba20-20ae-405d-bd58-0756cc1fdcad"
Oct 31 00:33:10.338130 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:10.338108    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:10.338244 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:10.338207    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wf75m" podUID="26ab7116-31a7-404c-8a01-6502edf9f5ce"
Oct 31 00:33:10.360180 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:10.360138    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p2ntf" event={"ID":"7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01","Type":"ContainerStarted","Data":"1f7453db944a767efe3032f2f57d99527f6ba17a122d6c8edc3e744347af5ccd"}
Oct 31 00:33:10.364591 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:10.364524    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4pdvd" event={"ID":"66f8ebac-f187-49d1-acf8-ec86c904c475","Type":"ContainerStarted","Data":"7c299a3043f0a079b20d78d440dc4211bdbb58955fee38c6137e812d96795504"}
Oct 31 00:33:10.367301 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:10.367273    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dbnzk" event={"ID":"6bd3d849-76a8-410d-8aa1-400e57cbaded","Type":"ContainerStarted","Data":"06d3ae65be837623b620e551c3ad9a59234c1dd8a8ea8c94b9c57b1a1e24e782"}
Oct 31 00:33:10.369583 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:10.369547    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4pvl9" event={"ID":"0420aed9-f163-474d-a19f-2db0bfdb32e6","Type":"ContainerStarted","Data":"472e73657b21b4b25654d2e7484627b3b0aa2bc12bb409ff9b0e6e4af280fd29"}
Oct 31 00:33:10.372654 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:10.372628    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mxsc9" event={"ID":"34b2bd3f-0955-482d-bf8e-0ec7de5a226a","Type":"ContainerStarted","Data":"30dc954be3f6dd1bd7de602a736214c348110aa32ca2028f7c4f729248c1bc8d"}
Oct 31 00:33:10.383234 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:10.383206    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t" event={"ID":"45efeeda-0c9c-461c-bb19-c43de5b9566a","Type":"ContainerStarted","Data":"63af29665d5fd3255d1b19fdc5cce7f204b69dcd711c61f2c7cfcf86285f771c"}
Oct 31 00:33:10.392366 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:10.392336    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j7x85" event={"ID":"8f7af1c9-c623-41f4-8923-ea931d7c08ab","Type":"ContainerStarted","Data":"093ca6ba9183eebb21515723150a834bacea4d33046d9f55558fc5f246af546e"}
Oct 31 00:33:10.397285 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:10.397243    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8" event={"ID":"e1748202-4b8b-4c5d-891e-5f68728124ea","Type":"ContainerStarted","Data":"9a67d896966aed131375804909522399a11dd0980b09077cbb6497282a208133"}
Oct 31 00:33:10.401485 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:10.401458    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jsw5n" event={"ID":"0b7e45fa-6f09-4d02-bc42-e89d46d954b6","Type":"ContainerStarted","Data":"82a7f8c3d05eddccebf4f83dcd2fc461c57375d2130e29c022defca00005e367"}
Oct 31 00:33:10.694288 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:10.694203    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs\") pod \"network-metrics-daemon-wcnrx\" (UID: \"0883a925-b7f8-44b8-a889-4d3cc5af9fe8\") " pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:10.694480 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:10.694404    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:33:10.694480 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:10.694473    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs podName:0883a925-b7f8-44b8-a889-4d3cc5af9fe8 nodeName:}" failed. No retries permitted until 2026-10-31 00:33:12.694454453 +0000 UTC m=+5.980219912 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs") pod "network-metrics-daemon-wcnrx" (UID: "0883a925-b7f8-44b8-a889-4d3cc5af9fe8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:33:10.795276 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:10.795214    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:10.795469 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:10.795324    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f68jv\" (UniqueName: \"kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv\") pod \"network-check-target-wf75m\" (UID: \"26ab7116-31a7-404c-8a01-6502edf9f5ce\") " pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:10.795541 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:10.795495    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:33:10.795541 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:10.795513    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:33:10.795541 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:10.795526    2581 projected.go:196] Error preparing data for projected volume kube-api-access-f68jv for pod openshift-network-diagnostics/network-check-target-wf75m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:33:10.795694 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:10.795589    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv podName:26ab7116-31a7-404c-8a01-6502edf9f5ce nodeName:}" failed. No retries permitted until 2026-10-31 00:33:12.795568922 +0000 UTC m=+6.081334394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f68jv" (UniqueName: "kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv") pod "network-check-target-wf75m" (UID: "26ab7116-31a7-404c-8a01-6502edf9f5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:33:10.795694 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:10.795672    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:33:10.795809 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:10.795725    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret podName:90fdba20-20ae-405d-bd58-0756cc1fdcad nodeName:}" failed. No retries permitted until 2026-10-31 00:33:12.795697489 +0000 UTC m=+6.081462950 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret") pod "global-pull-secret-syncer-zdznl" (UID: "90fdba20-20ae-405d-bd58-0756cc1fdcad") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:33:11.115206 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:11.114933    2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 00:28:09 +0000 UTC" deadline="2028-04-08 12:49:52.916690787 +0000 UTC"
Oct 31 00:33:11.115206 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:11.115208    2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12612h16m41.801490733s"
Oct 31 00:33:11.342673 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:11.342565    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:11.342833 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:11.342775    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcnrx" podUID="0883a925-b7f8-44b8-a889-4d3cc5af9fe8"
Oct 31 00:33:11.417153 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:11.416656    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal" event={"ID":"b5ed8cacd37cfc52fe028fc738a55eb8","Type":"ContainerStarted","Data":"00b94a638f11f3d5cb8618939f99e08e5b305c8c4ba21f4daea7f16004c20ef1"}
Oct 31 00:33:12.337369 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:12.337333    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:12.337882 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:12.337477    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdznl" podUID="90fdba20-20ae-405d-bd58-0756cc1fdcad"
Oct 31 00:33:12.337958 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:12.337903    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:12.338030 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:12.338005    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wf75m" podUID="26ab7116-31a7-404c-8a01-6502edf9f5ce"
Oct 31 00:33:12.452626 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:12.452538    2581 generic.go:356] "Generic (PLEG): container finished" podID="483afccfa0bddca2d4a120103d33e513" containerID="9107a5fa6d6e859dd55e66bec7bbf7356b4fb325f4ed80623821dc9c28f5bc8d" exitCode=0
Oct 31 00:33:12.453342 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:12.453315    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal" event={"ID":"483afccfa0bddca2d4a120103d33e513","Type":"ContainerDied","Data":"9107a5fa6d6e859dd55e66bec7bbf7356b4fb325f4ed80623821dc9c28f5bc8d"}
Oct 31 00:33:12.473232 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:12.470195    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal" podStartSLOduration=4.470179252 podStartE2EDuration="4.470179252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:33:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:11.434358075 +0000 UTC m=+4.720123553" watchObservedRunningTime="2026-10-31 00:33:12.470179252 +0000 UTC m=+5.755944730"
Oct 31 00:33:12.713686 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:12.713652    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs\") pod \"network-metrics-daemon-wcnrx\" (UID: \"0883a925-b7f8-44b8-a889-4d3cc5af9fe8\") " pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:12.713864 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:12.713818    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:33:12.713930 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:12.713885    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs podName:0883a925-b7f8-44b8-a889-4d3cc5af9fe8 nodeName:}" failed. No retries permitted until 2026-10-31 00:33:16.713864925 +0000 UTC m=+9.999630401 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs") pod "network-metrics-daemon-wcnrx" (UID: "0883a925-b7f8-44b8-a889-4d3cc5af9fe8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:33:12.814957 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:12.814304    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:12.814957 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:12.814395    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f68jv\" (UniqueName: \"kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv\") pod \"network-check-target-wf75m\" (UID: \"26ab7116-31a7-404c-8a01-6502edf9f5ce\") " pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:12.814957 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:12.814591    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:33:12.814957 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:12.814612    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:33:12.814957 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:12.814624    2581 projected.go:196] Error preparing data for projected volume kube-api-access-f68jv for pod openshift-network-diagnostics/network-check-target-wf75m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:33:12.814957 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:12.814703    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv podName:26ab7116-31a7-404c-8a01-6502edf9f5ce nodeName:}" failed. No retries permitted until 2026-10-31 00:33:16.814682433 +0000 UTC m=+10.100447925 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f68jv" (UniqueName: "kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv") pod "network-check-target-wf75m" (UID: "26ab7116-31a7-404c-8a01-6502edf9f5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:33:12.815271 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:12.815145    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:33:12.815271 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:12.815196    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret podName:90fdba20-20ae-405d-bd58-0756cc1fdcad nodeName:}" failed. No retries permitted until 2026-10-31 00:33:16.815181412 +0000 UTC m=+10.100946868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret") pod "global-pull-secret-syncer-zdznl" (UID: "90fdba20-20ae-405d-bd58-0756cc1fdcad") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:33:13.340125 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:13.340090    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:13.340662 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:13.340531    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcnrx" podUID="0883a925-b7f8-44b8-a889-4d3cc5af9fe8"
Oct 31 00:33:13.459619 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:13.459581    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal" event={"ID":"483afccfa0bddca2d4a120103d33e513","Type":"ContainerStarted","Data":"8ede57a17f63491259a41abd2cc98d1903e58e4f870635559c9f81e85324616a"}
Oct 31 00:33:13.469177 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:13.469025    2581 generic.go:356] "Generic (PLEG): container finished" podID="6bd3d849-76a8-410d-8aa1-400e57cbaded" containerID="c06156ed0b80d3d13059a84f007c0244c7483d84d5cc5d11ec4d1b2ed12ce99d" exitCode=0
Oct 31 00:33:13.469177 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:13.469068    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dbnzk" event={"ID":"6bd3d849-76a8-410d-8aa1-400e57cbaded","Type":"ContainerDied","Data":"c06156ed0b80d3d13059a84f007c0244c7483d84d5cc5d11ec4d1b2ed12ce99d"}
Oct 31 00:33:13.477099 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:13.477043    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal" podStartSLOduration=5.477025294 podStartE2EDuration="5.477025294s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:33:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:13.47632566 +0000 UTC m=+6.762091135" watchObservedRunningTime="2026-10-31 00:33:13.477025294 +0000 UTC m=+6.762790771"
Oct 31 00:33:14.337267 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:14.337234    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:14.337435 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:14.337281    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:14.337435 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:14.337372    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wf75m" podUID="26ab7116-31a7-404c-8a01-6502edf9f5ce"
Oct 31 00:33:14.337927 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:14.337814    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdznl" podUID="90fdba20-20ae-405d-bd58-0756cc1fdcad"
Oct 31 00:33:14.483387 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:14.483335    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p2ntf" event={"ID":"7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01","Type":"ContainerStarted","Data":"cd9c8c032d5ea31c2a220ca99f72d0feaded08e9caa2e9103f266259b938fc6f"}
Oct 31 00:33:14.503368 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:14.503318    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p2ntf" podStartSLOduration=3.218500931 podStartE2EDuration="7.503304184s" totalImagesPullingTime="4.284803253s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:14.502444497 +0000 UTC m=+7.788209976" watchObservedRunningTime="2026-10-31 00:33:14.503304184 +0000 UTC m=+7.789069660"
Oct 31 00:33:15.342692 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:15.342189    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:15.342692 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:15.342344    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcnrx" podUID="0883a925-b7f8-44b8-a889-4d3cc5af9fe8"
Oct 31 00:33:15.490762 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:15.490732    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4pdvd" event={"ID":"66f8ebac-f187-49d1-acf8-ec86c904c475","Type":"ContainerStarted","Data":"09cf22b9373a8d6b7851fb277f4e5eec1bed5dbf7951b2455f9ef64782c835bd"}
Oct 31 00:33:15.507977 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:15.507927    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4pdvd" podStartSLOduration=3.393216029 podStartE2EDuration="8.507908019s" totalImagesPullingTime="5.11469199s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:15.507336224 +0000 UTC m=+8.793101699" watchObservedRunningTime="2026-10-31 00:33:15.507908019 +0000 UTC m=+8.793673496"
Oct 31 00:33:16.260182 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:16.260147    2581 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p2ntf"
Oct 31 00:33:16.261052 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:16.261014    2581 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p2ntf"
Oct 31 00:33:16.339743 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:16.339708    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:16.339916 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:16.339844    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdznl" podUID="90fdba20-20ae-405d-bd58-0756cc1fdcad"
Oct 31 00:33:16.340231 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:16.340203    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:16.340329 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:16.340311    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wf75m" podUID="26ab7116-31a7-404c-8a01-6502edf9f5ce"
Oct 31 00:33:16.496158 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:16.496126    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t" event={"ID":"45efeeda-0c9c-461c-bb19-c43de5b9566a","Type":"ContainerStarted","Data":"dad4c3af9936dfd4b555fab54a6e858e7c3c54c972977ed492749ec89b37cc8b"}
Oct 31 00:33:16.750706 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:16.750625    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs\") pod \"network-metrics-daemon-wcnrx\" (UID: \"0883a925-b7f8-44b8-a889-4d3cc5af9fe8\") " pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:16.750832 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:16.750775    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:33:16.750832 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:16.750827    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs podName:0883a925-b7f8-44b8-a889-4d3cc5af9fe8 nodeName:}" failed. No retries permitted until 2026-10-31 00:33:24.750816284 +0000 UTC m=+18.036581751 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs") pod "network-metrics-daemon-wcnrx" (UID: "0883a925-b7f8-44b8-a889-4d3cc5af9fe8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:33:16.850979 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:16.850940    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f68jv\" (UniqueName: \"kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv\") pod \"network-check-target-wf75m\" (UID: \"26ab7116-31a7-404c-8a01-6502edf9f5ce\") " pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:16.851150 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:16.851008    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:16.851150 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:16.851144    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:33:16.851273 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:16.851204    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret podName:90fdba20-20ae-405d-bd58-0756cc1fdcad nodeName:}" failed. No retries permitted until 2026-10-31 00:33:24.85118811 +0000 UTC m=+18.136953578 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret") pod "global-pull-secret-syncer-zdznl" (UID: "90fdba20-20ae-405d-bd58-0756cc1fdcad") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:33:16.851348 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:16.851318    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:33:16.851348 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:16.851333    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:33:16.851348 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:16.851345    2581 projected.go:196] Error preparing data for projected volume kube-api-access-f68jv for pod openshift-network-diagnostics/network-check-target-wf75m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:33:16.851500 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:16.851382    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv podName:26ab7116-31a7-404c-8a01-6502edf9f5ce nodeName:}" failed. No retries permitted until 2026-10-31 00:33:24.851368467 +0000 UTC m=+18.137133934 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f68jv" (UniqueName: "kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv") pod "network-check-target-wf75m" (UID: "26ab7116-31a7-404c-8a01-6502edf9f5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:33:17.260317 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:17.260275    2581 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 31 00:33:17.345400 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:17.345337    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:17.345659 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:17.345639    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcnrx" podUID="0883a925-b7f8-44b8-a889-4d3cc5af9fe8"
Oct 31 00:33:17.501343 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:17.500579    2581 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 00:33:17.501343 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:17.501027    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t" event={"ID":"45efeeda-0c9c-461c-bb19-c43de5b9566a","Type":"ContainerStarted","Data":"31de8517f690ff32645824f6fa6df3ae8dba931f0d0f5af617d14f90f9d566a6"}
Oct 31 00:33:18.149128 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:18.148275    2581 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T00:33:17.26029357Z","UUID":"fb49c4c0-e032-4f72-bf66-bb1e9646199a","Handler":null,"Name":"","Endpoint":""}
Oct 31 00:33:18.150850 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:18.150582    2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 31 00:33:18.150850 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:18.150614    2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 31 00:33:18.337356 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:18.337327    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:18.337503 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:18.337368    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:18.337503 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:18.337451    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdznl" podUID="90fdba20-20ae-405d-bd58-0756cc1fdcad"
Oct 31 00:33:18.337622 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:18.337605    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wf75m" podUID="26ab7116-31a7-404c-8a01-6502edf9f5ce"
Oct 31 00:33:18.506649 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:18.505801    2581 generic.go:356] "Generic (PLEG): container finished" podID="6bd3d849-76a8-410d-8aa1-400e57cbaded" containerID="2434a245b2d1ade2dca2e44d6117946f540d0279c271fd27b4b174fe8a9a1986" exitCode=0
Oct 31 00:33:18.506649 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:18.505884    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dbnzk" event={"ID":"6bd3d849-76a8-410d-8aa1-400e57cbaded","Type":"ContainerDied","Data":"2434a245b2d1ade2dca2e44d6117946f540d0279c271fd27b4b174fe8a9a1986"}
Oct 31 00:33:18.510462 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:18.510436    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-4pvl9" event={"ID":"0420aed9-f163-474d-a19f-2db0bfdb32e6","Type":"ContainerStarted","Data":"e5c1888757b31bb5c711a5796ca61d74c747f9832af4362d3eb395f067790bd2"}
Oct 31 00:33:18.514960 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:18.514936    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t" event={"ID":"45efeeda-0c9c-461c-bb19-c43de5b9566a","Type":"ContainerStarted","Data":"a58c84032b33d9417c472d11e361a2edbd39e27a99918365014dd3c322d63f70"}
Oct 31 00:33:18.517265 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:18.517243    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-j7x85" event={"ID":"8f7af1c9-c623-41f4-8923-ea931d7c08ab","Type":"ContainerStarted","Data":"c89e1cfef81f11134fb69891f39fd67fed080535354fd28e49a26652b242e4dd"}
Oct 31 00:33:18.558977 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:18.558933    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/node-resolver-4pvl9" podStartSLOduration=3.252077357 podStartE2EDuration="11.558921116s" totalImagesPullingTime="8.306843759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:18.541782377 +0000 UTC m=+11.827547855" watchObservedRunningTime="2026-10-31 00:33:18.558921116 +0000 UTC m=+11.844686590"
Oct 31 00:33:18.559563 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:18.559517    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-j7x85" podStartSLOduration=3.426208551 podStartE2EDuration="11.55950834s" totalImagesPullingTime="8.133299789s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:18.559355943 +0000 UTC m=+11.845121420" watchObservedRunningTime="2026-10-31 00:33:18.55950834 +0000 UTC m=+11.845273815"
Oct 31 00:33:19.337543 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:19.337501    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:19.337711 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:19.337646    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcnrx" podUID="0883a925-b7f8-44b8-a889-4d3cc5af9fe8"
Oct 31 00:33:19.522331 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:19.521818    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dbnzk" event={"ID":"6bd3d849-76a8-410d-8aa1-400e57cbaded","Type":"ContainerStarted","Data":"6fa3bbfffdfd7a7769552d2cf3a174f85cd08364174b15da17e75a53637e8f2a"}
Oct 31 00:33:19.524453 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:19.523475    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jsw5n" event={"ID":"0b7e45fa-6f09-4d02-bc42-e89d46d954b6","Type":"ContainerStarted","Data":"b87119350b0d273e8f653e9aa70c4d251ac65a2838dd5802ecb48016e89603df"}
Oct 31 00:33:19.545767 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:19.545728    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t" podStartSLOduration=3.9271455140000002 podStartE2EDuration="12.545715065s" totalImagesPullingTime="8.618569551s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:33:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:18.577645559 +0000 UTC m=+11.863411034" watchObservedRunningTime="2026-10-31 00:33:19.545715065 +0000 UTC m=+12.831480539"
Oct 31 00:33:19.560857 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:19.560807    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jsw5n" podStartSLOduration=4.451350166 podStartE2EDuration="12.560790945s" totalImagesPullingTime="8.109440779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:19.559811327 +0000 UTC m=+12.845576805" watchObservedRunningTime="2026-10-31 00:33:19.560790945 +0000 UTC m=+12.846556424"
Oct 31 00:33:20.337615 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:20.337582    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:20.337785 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:20.337591    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:20.337785 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:20.337701    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wf75m" podUID="26ab7116-31a7-404c-8a01-6502edf9f5ce"
Oct 31 00:33:20.337887 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:20.337792    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdznl" podUID="90fdba20-20ae-405d-bd58-0756cc1fdcad"
Oct 31 00:33:20.528371 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:20.528332    2581 generic.go:356] "Generic (PLEG): container finished" podID="6bd3d849-76a8-410d-8aa1-400e57cbaded" containerID="6fa3bbfffdfd7a7769552d2cf3a174f85cd08364174b15da17e75a53637e8f2a" exitCode=0
Oct 31 00:33:20.529033 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:20.528415    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dbnzk" event={"ID":"6bd3d849-76a8-410d-8aa1-400e57cbaded","Type":"ContainerDied","Data":"6fa3bbfffdfd7a7769552d2cf3a174f85cd08364174b15da17e75a53637e8f2a"}
Oct 31 00:33:20.530585 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:20.530429    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mxsc9" event={"ID":"34b2bd3f-0955-482d-bf8e-0ec7de5a226a","Type":"ContainerStarted","Data":"1ccda552b9ad288b9e006dd1ac15f0b6be146d28f693ef61a0439691e05b4ac0"}
Oct 31 00:33:20.574862 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:20.574813    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mxsc9" podStartSLOduration=2.9753140289999997 podStartE2EDuration="13.574797414s" totalImagesPullingTime="10.599483385s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:20.574678753 +0000 UTC m=+13.860444239" watchObservedRunningTime="2026-10-31 00:33:20.574797414 +0000 UTC m=+13.860562891"
Oct 31 00:33:21.338212 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:21.338014    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:21.338395 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:21.338327    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcnrx" podUID="0883a925-b7f8-44b8-a889-4d3cc5af9fe8"
Oct 31 00:33:22.337667 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:22.337635    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:22.337667 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:22.337655    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:22.338106 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:22.337760    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdznl" podUID="90fdba20-20ae-405d-bd58-0756cc1fdcad"
Oct 31 00:33:22.338106 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:22.337889    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wf75m" podUID="26ab7116-31a7-404c-8a01-6502edf9f5ce"
Oct 31 00:33:22.537604 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:22.537568    2581 generic.go:356] "Generic (PLEG): container finished" podID="6bd3d849-76a8-410d-8aa1-400e57cbaded" containerID="45803047eab0a1fc709bcfa7afb09bf5f0f9fa9385e95607f25613f8414cf876" exitCode=0
Oct 31 00:33:22.537763 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:22.537600    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dbnzk" event={"ID":"6bd3d849-76a8-410d-8aa1-400e57cbaded","Type":"ContainerDied","Data":"45803047eab0a1fc709bcfa7afb09bf5f0f9fa9385e95607f25613f8414cf876"}
Oct 31 00:33:23.340907 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:23.340367    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:23.340907 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:23.340515    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcnrx" podUID="0883a925-b7f8-44b8-a889-4d3cc5af9fe8"
Oct 31 00:33:24.338175 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:24.337985    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:24.338281 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:24.338026    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:24.338333 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:24.338301    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wf75m" podUID="26ab7116-31a7-404c-8a01-6502edf9f5ce"
Oct 31 00:33:24.338389 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:24.338363    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdznl" podUID="90fdba20-20ae-405d-bd58-0756cc1fdcad"
Oct 31 00:33:24.545386 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:24.545349    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8" event={"ID":"e1748202-4b8b-4c5d-891e-5f68728124ea","Type":"ContainerStarted","Data":"b062addb4c66f5d0367bae06ac49ce8232e2d1baf16cd3c2028adc067ad252c7"}
Oct 31 00:33:24.545854 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:24.545446    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8" event={"ID":"e1748202-4b8b-4c5d-891e-5f68728124ea","Type":"ContainerStarted","Data":"bf0a7d3d45ee99a75422a0bc9080ec8c61079e94c572da65c353376f75cb1a31"}
Oct 31 00:33:24.545854 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:24.545497    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8" event={"ID":"e1748202-4b8b-4c5d-891e-5f68728124ea","Type":"ContainerStarted","Data":"bce8d0a0d3be66b2d904f5d2037f731afb6f675bbfd4915cb1ae391712e568c0"}
Oct 31 00:33:24.545854 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:24.545545    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8" event={"ID":"e1748202-4b8b-4c5d-891e-5f68728124ea","Type":"ContainerStarted","Data":"ee733781b48a5e666bbecaf32a3e745c26f86ee47bf316f109c5d94d6f587b99"}
Oct 31 00:33:24.545854 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:24.545587    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8" event={"ID":"e1748202-4b8b-4c5d-891e-5f68728124ea","Type":"ContainerStarted","Data":"9f89c87bc842ee2bad6022b9d4c0ca9f68fb46f8b59760a75dabd5e9b22d07c4"}
Oct 31 00:33:24.545854 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:24.545615    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8" event={"ID":"e1748202-4b8b-4c5d-891e-5f68728124ea","Type":"ContainerStarted","Data":"6b4c0f9b55f968c5645959059cf65c7faa0500a8d7120b113f4a15c214881c14"}
Oct 31 00:33:24.548277 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:24.548254    2581 generic.go:356] "Generic (PLEG): container finished" podID="6bd3d849-76a8-410d-8aa1-400e57cbaded" containerID="ba37af5a496086497438c5814b048a9594ab8022267c776c69919b494f4e9836" exitCode=0
Oct 31 00:33:24.548374 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:24.548286    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dbnzk" event={"ID":"6bd3d849-76a8-410d-8aa1-400e57cbaded","Type":"ContainerDied","Data":"ba37af5a496086497438c5814b048a9594ab8022267c776c69919b494f4e9836"}
Oct 31 00:33:24.806689 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:24.806649    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs\") pod \"network-metrics-daemon-wcnrx\" (UID: \"0883a925-b7f8-44b8-a889-4d3cc5af9fe8\") " pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:24.806856 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:24.806818    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:33:24.806932 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:24.806896    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs podName:0883a925-b7f8-44b8-a889-4d3cc5af9fe8 nodeName:}" failed. No retries permitted until 2026-10-31 00:33:40.806875933 +0000 UTC m=+34.092641409 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs") pod "network-metrics-daemon-wcnrx" (UID: "0883a925-b7f8-44b8-a889-4d3cc5af9fe8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:33:24.907505 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:24.907397    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:24.907505 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:24.907480    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f68jv\" (UniqueName: \"kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv\") pod \"network-check-target-wf75m\" (UID: \"26ab7116-31a7-404c-8a01-6502edf9f5ce\") " pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:24.907715 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:24.907546    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:33:24.907715 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:24.907603    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:33:24.907715 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:24.907620    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:33:24.907715 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:24.907633    2581 projected.go:196] Error preparing data for projected volume kube-api-access-f68jv for pod openshift-network-diagnostics/network-check-target-wf75m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:33:24.907715 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:24.907607    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret podName:90fdba20-20ae-405d-bd58-0756cc1fdcad nodeName:}" failed. No retries permitted until 2026-10-31 00:33:40.907593469 +0000 UTC m=+34.193358921 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret") pod "global-pull-secret-syncer-zdznl" (UID: "90fdba20-20ae-405d-bd58-0756cc1fdcad") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:33:24.907715 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:24.907689    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv podName:26ab7116-31a7-404c-8a01-6502edf9f5ce nodeName:}" failed. No retries permitted until 2026-10-31 00:33:40.907670783 +0000 UTC m=+34.193436242 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f68jv" (UniqueName: "kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv") pod "network-check-target-wf75m" (UID: "26ab7116-31a7-404c-8a01-6502edf9f5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:33:25.337887 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:25.337858    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:25.338019 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:25.337957    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcnrx" podUID="0883a925-b7f8-44b8-a889-4d3cc5af9fe8"
Oct 31 00:33:25.553421 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:25.553387    2581 generic.go:356] "Generic (PLEG): container finished" podID="6bd3d849-76a8-410d-8aa1-400e57cbaded" containerID="0aa0e09af0a3e0f47f9bf3237a1442e1a6d6c918c59b59c48d099a7824f6c759" exitCode=0
Oct 31 00:33:25.553884 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:25.553433    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dbnzk" event={"ID":"6bd3d849-76a8-410d-8aa1-400e57cbaded","Type":"ContainerDied","Data":"0aa0e09af0a3e0f47f9bf3237a1442e1a6d6c918c59b59c48d099a7824f6c759"}
Oct 31 00:33:26.337378 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:26.337346    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:26.337535 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:26.337356    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:26.337535 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:26.337443    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wf75m" podUID="26ab7116-31a7-404c-8a01-6502edf9f5ce"
Oct 31 00:33:26.337535 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:26.337519    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdznl" podUID="90fdba20-20ae-405d-bd58-0756cc1fdcad"
Oct 31 00:33:26.559439 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:26.559407    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dbnzk" event={"ID":"6bd3d849-76a8-410d-8aa1-400e57cbaded","Type":"ContainerStarted","Data":"b849c0394962e0bb76ce9b9ce375eaa63f0ebd3d3b2c6a32d4cde3a42bb6a3fd"}
Oct 31 00:33:26.585895 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:26.585856    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dbnzk" podStartSLOduration=8.694491191000001 podStartE2EDuration="19.585843839s" totalImagesPullingTime="10.891352648s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:33:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:26.585509144 +0000 UTC m=+19.871274649" watchObservedRunningTime="2026-10-31 00:33:26.585843839 +0000 UTC m=+19.871609314"
Oct 31 00:33:27.253872 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:27.253846    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4pvl9_0420aed9-f163-474d-a19f-2db0bfdb32e6/dns-node-resolver/0.log"
Oct 31 00:33:27.338747 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:27.338724    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:27.338867 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:27.338837    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcnrx" podUID="0883a925-b7f8-44b8-a889-4d3cc5af9fe8"
Oct 31 00:33:27.564561 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:27.564528    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8" event={"ID":"e1748202-4b8b-4c5d-891e-5f68728124ea","Type":"ContainerStarted","Data":"05d5ec352489e917c0c01ddd96fd0d2cc42a79d17d282c4127fbc0b4c37797f4"}
Oct 31 00:33:28.234872 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:28.234845    2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4pdvd_66f8ebac-f187-49d1-acf8-ec86c904c475/node-ca/0.log"
Oct 31 00:33:28.337571 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:28.337525    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:28.337571 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:28.337560    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:28.337786 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:28.337635    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdznl" podUID="90fdba20-20ae-405d-bd58-0756cc1fdcad"
Oct 31 00:33:28.337786 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:28.337765    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wf75m" podUID="26ab7116-31a7-404c-8a01-6502edf9f5ce"
Oct 31 00:33:29.338375 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:29.338176    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:29.339144 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:29.338487    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcnrx" podUID="0883a925-b7f8-44b8-a889-4d3cc5af9fe8"
Oct 31 00:33:29.572259 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:29.572206    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8" event={"ID":"e1748202-4b8b-4c5d-891e-5f68728124ea","Type":"ContainerStarted","Data":"fbf304375862a3d7aa64bb5596b69d4ea1b2be13717392134ea29ffe8f5ed60a"}
Oct 31 00:33:29.572538 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:29.572519    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:29.572636 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:29.572589    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:29.588112 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:29.588087    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:29.609315 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:29.609234    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8" podStartSLOduration=7.920910889 podStartE2EDuration="22.609209215s" totalImagesPullingTime="14.688298326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:29.607287415 +0000 UTC m=+22.893052890" watchObservedRunningTime="2026-10-31 00:33:29.609209215 +0000 UTC m=+22.894974690"
Oct 31 00:33:30.337809 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:30.337782    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:30.337809 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:30.337812    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:30.338005 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:30.337878    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdznl" podUID="90fdba20-20ae-405d-bd58-0756cc1fdcad"
Oct 31 00:33:30.338005 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:30.337931    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wf75m" podUID="26ab7116-31a7-404c-8a01-6502edf9f5ce"
Oct 31 00:33:30.574830 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:30.574802    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:30.589060 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:30.588998    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:33:31.338090 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:31.338060    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:31.338357 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:31.338167    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcnrx" podUID="0883a925-b7f8-44b8-a889-4d3cc5af9fe8"
Oct 31 00:33:32.337801 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:32.337772    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:32.338173 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:32.337773    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:32.338173 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:32.337873    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdznl" podUID="90fdba20-20ae-405d-bd58-0756cc1fdcad"
Oct 31 00:33:32.338173 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:32.337941    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wf75m" podUID="26ab7116-31a7-404c-8a01-6502edf9f5ce"
Oct 31 00:33:33.337867 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:33.337836    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:33.338288 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:33.337957    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcnrx" podUID="0883a925-b7f8-44b8-a889-4d3cc5af9fe8"
Oct 31 00:33:34.337718 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:34.337689    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:34.337718 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:34.337717    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:34.337897 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:34.337802    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wf75m" podUID="26ab7116-31a7-404c-8a01-6502edf9f5ce"
Oct 31 00:33:34.338170 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:34.337912    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdznl" podUID="90fdba20-20ae-405d-bd58-0756cc1fdcad"
Oct 31 00:33:35.337520 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:35.337453    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:35.337672 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:35.337605    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcnrx" podUID="0883a925-b7f8-44b8-a889-4d3cc5af9fe8"
Oct 31 00:33:35.377595 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:35.377563    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zdznl"]
Oct 31 00:33:35.378059 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:35.377677    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:35.378059 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:35.377805    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdznl" podUID="90fdba20-20ae-405d-bd58-0756cc1fdcad"
Oct 31 00:33:35.381045 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:35.381017    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wcnrx"]
Oct 31 00:33:35.385248 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:35.384611    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wf75m"]
Oct 31 00:33:35.385248 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:35.384760    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:35.385248 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:35.384856    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wf75m" podUID="26ab7116-31a7-404c-8a01-6502edf9f5ce"
Oct 31 00:33:35.584210 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:35.584177    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:35.584390 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:35.584339    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcnrx" podUID="0883a925-b7f8-44b8-a889-4d3cc5af9fe8"
Oct 31 00:33:37.338063 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:37.338030    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:37.338553 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:37.338127    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdznl" podUID="90fdba20-20ae-405d-bd58-0756cc1fdcad"
Oct 31 00:33:37.338553 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:37.338184    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:37.338553 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:37.338290    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcnrx" podUID="0883a925-b7f8-44b8-a889-4d3cc5af9fe8"
Oct 31 00:33:37.338553 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:37.338332    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:37.338553 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:37.338402    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wf75m" podUID="26ab7116-31a7-404c-8a01-6502edf9f5ce"
Oct 31 00:33:38.000142 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:38.000114    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p2ntf"
Oct 31 00:33:38.000327 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:38.000241    2581 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 00:33:38.000698 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:38.000674    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p2ntf"
Oct 31 00:33:39.338136 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:39.337950    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:39.338650 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:39.337979    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:39.338650 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:39.338012    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:39.338650 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:39.338289    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wcnrx" podUID="0883a925-b7f8-44b8-a889-4d3cc5af9fe8"
Oct 31 00:33:39.338650 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:39.338324    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-zdznl" podUID="90fdba20-20ae-405d-bd58-0756cc1fdcad"
Oct 31 00:33:39.338650 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:39.338388    2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wf75m" podUID="26ab7116-31a7-404c-8a01-6502edf9f5ce"
Oct 31 00:33:39.965550 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:39.965526    2581 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeReady"
Oct 31 00:33:39.965670 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:39.965660    2581 kubelet_node_status.go:477] "Fast updating node status as it just became ready"
Oct 31 00:33:40.073691 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.073662    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5sqlr"]
Oct 31 00:33:40.077083 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.077067    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5sqlr"
Oct 31 00:33:40.080030 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.080008    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-szr5z"]
Oct 31 00:33:40.084005 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.083966    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:33:40.088639 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.088618    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 31 00:33:40.091873 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.091854    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 31 00:33:40.092952 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.092931    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5sqlr"]
Oct 31 00:33:40.093039 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.092998    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 31 00:33:40.094104 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.094048    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 31 00:33:40.094189 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.094104    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6p62k\""
Oct 31 00:33:40.095450 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.095429    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-szr5z"]
Oct 31 00:33:40.095531 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.095515    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-hwf9w\""
Oct 31 00:33:40.100752 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.100736    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ws48k"]
Oct 31 00:33:40.103995 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.103981    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ws48k"
Oct 31 00:33:40.116317 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.116293    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ws48k"]
Oct 31 00:33:40.197190 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.197103    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 31 00:33:40.197482 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.197464    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 31 00:33:40.197563 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.197466    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 31 00:33:40.197563 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.197502    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kh74f\""
Oct 31 00:33:40.197563 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.197472    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 31 00:33:40.197563 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.197504    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 31 00:33:40.210853 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.210835    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hd475\" (UniqueName: \"kubernetes.io/projected/c9248850-deda-4b75-b652-9f26255812f8-kube-api-access-hd475\") pod \"ingress-canary-5sqlr\" (UID: \"c9248850-deda-4b75-b652-9f26255812f8\") " pod="openshift-ingress-canary/ingress-canary-5sqlr"
Oct 31 00:33:40.210907 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.210872    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-tmp-dir\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:33:40.210907 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.210886    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw7nf\" (UniqueName: \"kubernetes.io/projected/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-kube-api-access-gw7nf\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:33:40.210907 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.210901    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c55ac10a-0189-4764-b828-098f9ea03f75-crio-socket\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:33:40.211016 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.210959    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c55ac10a-0189-4764-b828-098f9ea03f75-data-volume\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:33:40.211093 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.211077    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-config-volume\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:33:40.211149 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.211107    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c55ac10a-0189-4764-b828-098f9ea03f75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:33:40.211149 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.211135    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c55ac10a-0189-4764-b828-098f9ea03f75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:33:40.211277 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.211234    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfw9h\" (UniqueName: \"kubernetes.io/projected/c55ac10a-0189-4764-b828-098f9ea03f75-kube-api-access-wfw9h\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:33:40.211277 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.211268    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-metrics-tls\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:33:40.211369 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.211296    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9248850-deda-4b75-b652-9f26255812f8-cert\") pod \"ingress-canary-5sqlr\" (UID: \"c9248850-deda-4b75-b652-9f26255812f8\") " pod="openshift-ingress-canary/ingress-canary-5sqlr"
Oct 31 00:33:40.311601 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.311549    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-metrics-tls\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:33:40.311601 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.311600    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9248850-deda-4b75-b652-9f26255812f8-cert\") pod \"ingress-canary-5sqlr\" (UID: \"c9248850-deda-4b75-b652-9f26255812f8\") " pod="openshift-ingress-canary/ingress-canary-5sqlr"
Oct 31 00:33:40.311852 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.311638    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd475\" (UniqueName: \"kubernetes.io/projected/c9248850-deda-4b75-b652-9f26255812f8-kube-api-access-hd475\") pod \"ingress-canary-5sqlr\" (UID: \"c9248850-deda-4b75-b652-9f26255812f8\") " pod="openshift-ingress-canary/ingress-canary-5sqlr"
Oct 31 00:33:40.311852 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.311679    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-tmp-dir\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:33:40.311852 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.311698    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw7nf\" (UniqueName: \"kubernetes.io/projected/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-kube-api-access-gw7nf\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:33:40.311852 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.311831    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c55ac10a-0189-4764-b828-098f9ea03f75-crio-socket\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:33:40.312054 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.311875    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c55ac10a-0189-4764-b828-098f9ea03f75-data-volume\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:33:40.312054 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.311941    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-config-volume\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:33:40.312054 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.311967    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c55ac10a-0189-4764-b828-098f9ea03f75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:33:40.312054 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.311991    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c55ac10a-0189-4764-b828-098f9ea03f75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:33:40.312054 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.312028    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfw9h\" (UniqueName: \"kubernetes.io/projected/c55ac10a-0189-4764-b828-098f9ea03f75-kube-api-access-wfw9h\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:33:40.312054 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.312062    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c55ac10a-0189-4764-b828-098f9ea03f75-crio-socket\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:33:40.312411 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.312087    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-tmp-dir\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:33:40.312411 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.312259    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c55ac10a-0189-4764-b828-098f9ea03f75-data-volume\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:33:40.312670 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.312649    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c55ac10a-0189-4764-b828-098f9ea03f75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:33:40.312670 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.312658    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-config-volume\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:33:40.315479 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.315457    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c55ac10a-0189-4764-b828-098f9ea03f75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:33:40.315573 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.315515    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-metrics-tls\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:33:40.315573 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.315545    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9248850-deda-4b75-b652-9f26255812f8-cert\") pod \"ingress-canary-5sqlr\" (UID: \"c9248850-deda-4b75-b652-9f26255812f8\") " pod="openshift-ingress-canary/ingress-canary-5sqlr"
Oct 31 00:33:40.321531 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.321509    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd475\" (UniqueName: \"kubernetes.io/projected/c9248850-deda-4b75-b652-9f26255812f8-kube-api-access-hd475\") pod \"ingress-canary-5sqlr\" (UID: \"c9248850-deda-4b75-b652-9f26255812f8\") " pod="openshift-ingress-canary/ingress-canary-5sqlr"
Oct 31 00:33:40.322023 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.321995    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfw9h\" (UniqueName: \"kubernetes.io/projected/c55ac10a-0189-4764-b828-098f9ea03f75-kube-api-access-wfw9h\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:33:40.322023 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.322009    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw7nf\" (UniqueName: \"kubernetes.io/projected/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-kube-api-access-gw7nf\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:33:40.389207 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.389187    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5sqlr"
Oct 31 00:33:40.402472 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.402442    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:33:40.417749 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.417728    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ws48k"
Oct 31 00:33:40.679945 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.679923    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5sqlr"]
Oct 31 00:33:40.683025 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:40.682877    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9248850_deda_4b75_b652_9f26255812f8.slice/crio-b887ee3e2bc7e26ec6174b3ad1c9553f3d02530e41b5d4759e0ed750de2ed962 WatchSource:0}: Error finding container b887ee3e2bc7e26ec6174b3ad1c9553f3d02530e41b5d4759e0ed750de2ed962: Status 404 returned error can't find the container with id b887ee3e2bc7e26ec6174b3ad1c9553f3d02530e41b5d4759e0ed750de2ed962
Oct 31 00:33:40.684610 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.684584    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-szr5z"]
Oct 31 00:33:40.689479 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:40.689458    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc55ac10a_0189_4764_b828_098f9ea03f75.slice/crio-16adc2d08ec3a80f2102398375c3a21ad418981115137bf5c3ec579fd6ebea43 WatchSource:0}: Error finding container 16adc2d08ec3a80f2102398375c3a21ad418981115137bf5c3ec579fd6ebea43: Status 404 returned error can't find the container with id 16adc2d08ec3a80f2102398375c3a21ad418981115137bf5c3ec579fd6ebea43
Oct 31 00:33:40.706272 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.706091    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ws48k"]
Oct 31 00:33:40.715262 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:40.715239    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a2e0e44_ffc6_4199_903b_4eae5ad5aefb.slice/crio-76b05dc3df1ffe648a33eb8fb2b102295235d3042c71f1017412960b4f09e4ff WatchSource:0}: Error finding container 76b05dc3df1ffe648a33eb8fb2b102295235d3042c71f1017412960b4f09e4ff: Status 404 returned error can't find the container with id 76b05dc3df1ffe648a33eb8fb2b102295235d3042c71f1017412960b4f09e4ff
Oct 31 00:33:40.816555 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.816518    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs\") pod \"network-metrics-daemon-wcnrx\" (UID: \"0883a925-b7f8-44b8-a889-4d3cc5af9fe8\") " pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:40.816776 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:40.816660    2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:33:40.816776 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:40.816714    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs podName:0883a925-b7f8-44b8-a889-4d3cc5af9fe8 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:12.816701508 +0000 UTC m=+66.102466973 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs") pod "network-metrics-daemon-wcnrx" (UID: "0883a925-b7f8-44b8-a889-4d3cc5af9fe8") : object "openshift-multus"/"metrics-daemon-secret" not registered
Oct 31 00:33:40.917128 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.917094    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:40.917274 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:40.917149    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f68jv\" (UniqueName: \"kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv\") pod \"network-check-target-wf75m\" (UID: \"26ab7116-31a7-404c-8a01-6502edf9f5ce\") " pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:40.917327 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:40.917264    2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Oct 31 00:33:40.917374 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:40.917336    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret podName:90fdba20-20ae-405d-bd58-0756cc1fdcad nodeName:}" failed. No retries permitted until 2026-10-31 00:34:12.917320873 +0000 UTC m=+66.203086348 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret") pod "global-pull-secret-syncer-zdznl" (UID: "90fdba20-20ae-405d-bd58-0756cc1fdcad") : object "kube-system"/"original-pull-secret" not registered
Oct 31 00:33:40.917374 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:40.917271    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Oct 31 00:33:40.917447 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:40.917378    2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Oct 31 00:33:40.917447 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:40.917391    2581 projected.go:196] Error preparing data for projected volume kube-api-access-f68jv for pod openshift-network-diagnostics/network-check-target-wf75m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:33:40.917447 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:33:40.917434    2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv podName:26ab7116-31a7-404c-8a01-6502edf9f5ce nodeName:}" failed. No retries permitted until 2026-10-31 00:34:12.917420967 +0000 UTC m=+66.203186435 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f68jv" (UniqueName: "kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv") pod "network-check-target-wf75m" (UID: "26ab7116-31a7-404c-8a01-6502edf9f5ce") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Oct 31 00:33:41.337865 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:41.337832    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:33:41.337865 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:41.337858    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:33:41.338063 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:41.337929    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:33:41.345696 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:41.345674    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 31 00:33:41.347726 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:41.347708    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 31 00:33:41.347805 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:41.347793    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 00:33:41.347925 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:41.347912    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 31 00:33:41.348099 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:41.348077    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-87knn\""
Oct 31 00:33:41.348277 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:41.348261    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-v94lw\""
Oct 31 00:33:41.348405 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:41.348391    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-qhb2k\""
Oct 31 00:33:41.598517 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:41.598426    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5sqlr" event={"ID":"c9248850-deda-4b75-b652-9f26255812f8","Type":"ContainerStarted","Data":"b887ee3e2bc7e26ec6174b3ad1c9553f3d02530e41b5d4759e0ed750de2ed962"}
Oct 31 00:33:41.599828 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:41.599796    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ws48k" event={"ID":"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb","Type":"ContainerStarted","Data":"76b05dc3df1ffe648a33eb8fb2b102295235d3042c71f1017412960b4f09e4ff"}
Oct 31 00:33:41.601398 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:41.601374    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szr5z" event={"ID":"c55ac10a-0189-4764-b828-098f9ea03f75","Type":"ContainerStarted","Data":"e1e18f176eb2ba15e0d9da0dd24c2a7fcce60924302b3ef5da6f875decee3d65"}
Oct 31 00:33:41.601507 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:41.601428    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szr5z" event={"ID":"c55ac10a-0189-4764-b828-098f9ea03f75","Type":"ContainerStarted","Data":"16adc2d08ec3a80f2102398375c3a21ad418981115137bf5c3ec579fd6ebea43"}
Oct 31 00:33:42.606993 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.606916    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szr5z" event={"ID":"c55ac10a-0189-4764-b828-098f9ea03f75","Type":"ContainerStarted","Data":"15af857d2b3344e7d91480a6c975f521a7367f696c2dbf6c7549dbecffabc621"}
Oct 31 00:33:42.819681 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.819650    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-579b9db4b-hb7q9"]
Oct 31 00:33:42.833480 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.833451    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:42.842629 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.842601    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Oct 31 00:33:42.843031 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.842659    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Oct 31 00:33:42.843722 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.843670    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-579b9db4b-hb7q9"]
Oct 31 00:33:42.843892 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.843749    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Oct 31 00:33:42.844206 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.844167    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Oct 31 00:33:42.844338 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.844280    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Oct 31 00:33:42.844388 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.844369    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Oct 31 00:33:42.846247 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.846211    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Oct 31 00:33:42.846247 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.846240    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-mv6rq\""
Oct 31 00:33:42.934529 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.934458    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:42.934529 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.934500    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:42.934529 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.934527    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:42.934786 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.934580    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/610ed88a-261c-4503-b776-4a0c20b6cb07-tmp\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:42.934786 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.934627    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:42.934786 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.934701    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crwrm\" (UniqueName: \"kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:42.934786 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:42.934763    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:43.035198 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.035170    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:43.035335 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.035213    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/610ed88a-261c-4503-b776-4a0c20b6cb07-tmp\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:43.035335 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.035259    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:43.035335 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.035292    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crwrm\" (UniqueName: \"kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:43.035335 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.035326    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:43.035551 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.035409    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:43.035551 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.035445    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:43.035654 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.035631    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/610ed88a-261c-4503-b776-4a0c20b6cb07-tmp\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:43.042247 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.036015    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:43.042247 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.036052    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:43.042247 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.036128    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:43.042247 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.039341    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:43.042247 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.039420    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:43.047185 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.046713    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crwrm\" (UniqueName: \"kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:43.164515 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.164487    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:43.326765 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.326572    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"]
Oct 31 00:33:43.341166 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.341142    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:33:43.355939 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.355913    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 31 00:33:43.356167 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.356149    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 31 00:33:43.357034 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.357011    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"]
Oct 31 00:33:43.358038 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.358000    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 31 00:33:43.358122 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.358107    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 31 00:33:43.358282 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.358251    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 31 00:33:43.438739 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.438708    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:33:43.438929 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.438750    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:33:43.438929 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.438798    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:33:43.438929 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.438824    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9gng\" (UniqueName: \"kubernetes.io/projected/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-kube-api-access-v9gng\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:33:43.449755 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.449734    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-sf9lg\""
Oct 31 00:33:43.474563 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.474537    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-579b9db4b-hb7q9"]
Oct 31 00:33:43.479297 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:43.478346    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod610ed88a_261c_4503_b776_4a0c20b6cb07.slice/crio-adf334f33e47c7fcc6dbacf70ec1250e8f01a728479f699821d8ffaf197845ea WatchSource:0}: Error finding container adf334f33e47c7fcc6dbacf70ec1250e8f01a728479f699821d8ffaf197845ea: Status 404 returned error can't find the container with id adf334f33e47c7fcc6dbacf70ec1250e8f01a728479f699821d8ffaf197845ea
Oct 31 00:33:43.539693 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.539612    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:33:43.539693 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.539651    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9gng\" (UniqueName: \"kubernetes.io/projected/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-kube-api-access-v9gng\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:33:43.539879 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.539741    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:33:43.539879 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.539769    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:33:43.540640 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.540587    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:33:43.543527 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.543507    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:33:43.543827 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.543810    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:33:43.556686 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.556662    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9gng\" (UniqueName: \"kubernetes.io/projected/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-kube-api-access-v9gng\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:33:43.610877 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.610844    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-579b9db4b-hb7q9" event={"ID":"610ed88a-261c-4503-b776-4a0c20b6cb07","Type":"ContainerStarted","Data":"adf334f33e47c7fcc6dbacf70ec1250e8f01a728479f699821d8ffaf197845ea"}
Oct 31 00:33:43.612949 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.612921    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ws48k" event={"ID":"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb","Type":"ContainerStarted","Data":"5149f8ccddbc7b40e86c077523e2ea9cbaa2415185a7cf0b19b98a9462b73957"}
Oct 31 00:33:43.613053 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.612979    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ws48k" event={"ID":"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb","Type":"ContainerStarted","Data":"4c4f84d81c7fe815a8caf59f1de63a0450913e224dc2ff3c8d7075eaf0c2b59a"}
Oct 31 00:33:43.613717 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.613696    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ws48k"
Oct 31 00:33:43.639101 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.639048    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-dns/dns-default-ws48k" podStartSLOduration=1.331004993 podStartE2EDuration="3.639029272s" totalImagesPullingTime="2.308024279s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:33:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:43.638735275 +0000 UTC m=+36.924500751" watchObservedRunningTime="2026-10-31 00:33:43.639029272 +0000 UTC m=+36.924794748"
Oct 31 00:33:43.700419 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.700390    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:33:43.989758 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:43.989726    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"]
Oct 31 00:33:44.010300 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:44.010267    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc80f90_f288_4fc5_b3fc_6c9dda0dccc4.slice/crio-52f7ea9a62d9c565d76e1b3cbcab6cca76bdb6a674e8caf8b014357d71978c35 WatchSource:0}: Error finding container 52f7ea9a62d9c565d76e1b3cbcab6cca76bdb6a674e8caf8b014357d71978c35: Status 404 returned error can't find the container with id 52f7ea9a62d9c565d76e1b3cbcab6cca76bdb6a674e8caf8b014357d71978c35
Oct 31 00:33:44.617300 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:44.617265    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6" event={"ID":"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4","Type":"ContainerStarted","Data":"52f7ea9a62d9c565d76e1b3cbcab6cca76bdb6a674e8caf8b014357d71978c35"}
Oct 31 00:33:44.619141 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:44.619114    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5sqlr" event={"ID":"c9248850-deda-4b75-b652-9f26255812f8","Type":"ContainerStarted","Data":"f41f18803f600ee670938d6d459e2bc30e788369798511084ad994863acd3a27"}
Oct 31 00:33:44.637775 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:44.637723    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5sqlr" podStartSLOduration=1.084760106 podStartE2EDuration="4.637706748s" totalImagesPullingTime="3.552946642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:33:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:44.636545288 +0000 UTC m=+37.922310763" watchObservedRunningTime="2026-10-31 00:33:44.637706748 +0000 UTC m=+37.923472226"
Oct 31 00:33:45.625073 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:45.625035    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-szr5z" event={"ID":"c55ac10a-0189-4764-b828-098f9ea03f75","Type":"ContainerStarted","Data":"c0a5f1bee9eeb2dc00e26357df45da112687a8cc2b3e51903ae5f77a57a5e2d3"}
Oct 31 00:33:45.646343 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:45.646296    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-szr5z" podStartSLOduration=1.978669649 podStartE2EDuration="5.646277618s" totalImagesPullingTime="3.667607969s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 00:33:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:45.644794939 +0000 UTC m=+38.930560414" watchObservedRunningTime="2026-10-31 00:33:45.646277618 +0000 UTC m=+38.932043096"
Oct 31 00:33:46.629435 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:46.629400    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6" event={"ID":"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4","Type":"ContainerStarted","Data":"8111eadacefa30fb16af208fbb2fb44f7fad08b10ae473b30f9c6afd433a73ad"}
Oct 31 00:33:46.629960 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:46.629450    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6" event={"ID":"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4","Type":"ContainerStarted","Data":"acbb2a2b4f3b0bb6de23cde5efad562f5ec78920deb72accfb656da42be04f60"}
Oct 31 00:33:46.647437 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:46.647395    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6" podStartSLOduration=1.476192205 podStartE2EDuration="3.647382827s" totalImagesPullingTime="2.171190622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:33:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:46.646083591 +0000 UTC m=+39.931849067" watchObservedRunningTime="2026-10-31 00:33:46.647382827 +0000 UTC m=+39.933148296"
Oct 31 00:33:47.634325 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:47.634286    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-579b9db4b-hb7q9" event={"ID":"610ed88a-261c-4503-b776-4a0c20b6cb07","Type":"ContainerStarted","Data":"cad667997ceff2742d8cfeb5de234289f6f68d9dd94654fb8cf92a1085f1ce35"}
Oct 31 00:33:47.655413 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:47.655374    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-579b9db4b-hb7q9" podStartSLOduration=2.399941625 podStartE2EDuration="5.655360648s" totalImagesPullingTime="3.255419023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:33:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:47.654260833 +0000 UTC m=+40.940026309" watchObservedRunningTime="2026-10-31 00:33:47.655360648 +0000 UTC m=+40.941126185"
Oct 31 00:33:48.652318 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.652283    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"]
Oct 31 00:33:48.674478 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.674420    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"]
Oct 31 00:33:48.674478 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.674460    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:33:48.674702 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.674526    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cxblw"]
Oct 31 00:33:48.679450 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.679425    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 31 00:33:48.679588 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.679506    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 31 00:33:48.679588 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.679551    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nch2p\""
Oct 31 00:33:48.690493 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.690470    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"]
Oct 31 00:33:48.690613 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.690598    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.698506 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.698479    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 31 00:33:48.698506 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.698506    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 31 00:33:48.698671 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.698582    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kgtx2\""
Oct 31 00:33:48.698729 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.698684    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 31 00:33:48.704659 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.704640    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"]
Oct 31 00:33:48.704721 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.704678    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:48.719370 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.719346    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 31 00:33:48.719452 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.719406    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 31 00:33:48.719452 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.719418    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-p9q7z\""
Oct 31 00:33:48.788286 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.788253    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/506537b2-c447-4523-95f5-a53bdc768c84-metrics-client-ca\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.788536 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.788298    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlwjc\" (UniqueName: \"kubernetes.io/projected/e4798203-046e-4ad4-842d-a211d905cd74-kube-api-access-wlwjc\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:33:48.788536 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.788319    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.788536 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.788347    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-accelerators-collector-config\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.788536 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.788430    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:48.788536 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.788472    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:48.788731 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.788541    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4798203-046e-4ad4-842d-a211d905cd74-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:33:48.788731 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.788568    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:48.788731 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.788673    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-textfile\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.788731 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.788693    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlq92\" (UniqueName: \"kubernetes.io/projected/506537b2-c447-4523-95f5-a53bdc768c84-kube-api-access-zlq92\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.788891 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.788787    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-tls\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.788891 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.788819    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:48.788891 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.788861    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4798203-046e-4ad4-842d-a211d905cd74-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:33:48.788891 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.788880    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-wtmp\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.789035 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.788917    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/506537b2-c447-4523-95f5-a53bdc768c84-sys\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.789035 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.789025    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4798203-046e-4ad4-842d-a211d905cd74-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:33:48.789107 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.789065    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:48.789142 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.789133    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghc8q\" (UniqueName: \"kubernetes.io/projected/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-api-access-ghc8q\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:48.789189 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.789171    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/506537b2-c447-4523-95f5-a53bdc768c84-root\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.798458 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.798442    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 31 00:33:48.890380 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890349    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghc8q\" (UniqueName: \"kubernetes.io/projected/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-api-access-ghc8q\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:48.890380 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890382    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/506537b2-c447-4523-95f5-a53bdc768c84-root\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.890554 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890401    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/506537b2-c447-4523-95f5-a53bdc768c84-metrics-client-ca\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.890554 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890424    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlwjc\" (UniqueName: \"kubernetes.io/projected/e4798203-046e-4ad4-842d-a211d905cd74-kube-api-access-wlwjc\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:33:48.890554 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890475    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/506537b2-c447-4523-95f5-a53bdc768c84-root\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.890554 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890476    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.890730 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890558    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-accelerators-collector-config\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.890730 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890596    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:48.890730 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890616    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:48.890730 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890664    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4798203-046e-4ad4-842d-a211d905cd74-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:33:48.890730 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890697    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:48.890971 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890731    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-textfile\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.890971 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890756    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlq92\" (UniqueName: \"kubernetes.io/projected/506537b2-c447-4523-95f5-a53bdc768c84-kube-api-access-zlq92\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.890971 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890803    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-tls\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.890971 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890826    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:48.890971 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890853    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4798203-046e-4ad4-842d-a211d905cd74-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:33:48.890971 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890876    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-wtmp\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.890971 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890917    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/506537b2-c447-4523-95f5-a53bdc768c84-sys\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.890971 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890944    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4798203-046e-4ad4-842d-a211d905cd74-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:33:48.890971 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890972    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:48.891421 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.890974    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:48.891421 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.891146    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/506537b2-c447-4523-95f5-a53bdc768c84-metrics-client-ca\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.891421 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.891167    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-accelerators-collector-config\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.891421 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.891261    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/506537b2-c447-4523-95f5-a53bdc768c84-sys\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.891421 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.891268    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-textfile\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.891421 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.891396    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-wtmp\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.892008 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.891942    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:48.892008 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.891957    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4798203-046e-4ad4-842d-a211d905cd74-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:33:48.892917 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.892891    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:48.894772 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.894742    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4798203-046e-4ad4-842d-a211d905cd74-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:33:48.894867 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.894807    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-tls\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.894867 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.894834    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4798203-046e-4ad4-842d-a211d905cd74-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:33:48.894933 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.894831    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:48.894933 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.894902    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:48.895289 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.895272    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.899352 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.899325    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlq92\" (UniqueName: \"kubernetes.io/projected/506537b2-c447-4523-95f5-a53bdc768c84-kube-api-access-zlq92\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:48.899454 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.899428    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlwjc\" (UniqueName: \"kubernetes.io/projected/e4798203-046e-4ad4-842d-a211d905cd74-kube-api-access-wlwjc\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:33:48.899534 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:48.899512    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghc8q\" (UniqueName: \"kubernetes.io/projected/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-api-access-ghc8q\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:49.012647 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.012580    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-console/console-7b5d6654d7-rbxn5"]
Oct 31 00:33:49.025044 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.025017    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:33:49.041193 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.041164    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b5d6654d7-rbxn5"]
Oct 31 00:33:49.041330 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.041289    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.051187 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.051169    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Oct 31 00:33:49.095882 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.095695    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:33:49.114577 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.114553    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:33:49.124353 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:49.124330    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod506537b2_c447_4523_95f5_a53bdc768c84.slice/crio-9d1097cb6f5c08c431b261dbc3da752f1763bee4b06a3ba5f828bfc054100e4b WatchSource:0}: Error finding container 9d1097cb6f5c08c431b261dbc3da752f1763bee4b06a3ba5f828bfc054100e4b: Status 404 returned error can't find the container with id 9d1097cb6f5c08c431b261dbc3da752f1763bee4b06a3ba5f828bfc054100e4b
Oct 31 00:33:49.193171 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.193135    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.193324 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.193192    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.193324 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.193288    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.193415 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.193335    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sv6t\" (UniqueName: \"kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.193415 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.193391    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.193484 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.193419    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.193484 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.193464    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-tmp\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.193578 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.193493    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.295065 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.294979    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.295065 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.295030    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.295310 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.295091    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.295310 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.295127    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sv6t\" (UniqueName: \"kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.295310 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.295145    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.295310 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.295162    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.295310 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.295180    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-tmp\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.295310 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.295196    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.295616 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.295598    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-tmp\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.295861 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.295840    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.296426 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.296405    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.296426 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.296421    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.296597 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.296471    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.298104 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.298077    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.298243 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.298209    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.303750 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.303727    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sv6t\" (UniqueName: \"kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.318349 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.318329    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"]
Oct 31 00:33:49.320446 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:49.320425    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4798203_046e_4ad4_842d_a211d905cd74.slice/crio-e8daca4e69149b72de51e98abf18f62b4779832fe5107b7cdcf20917da9f2ddc WatchSource:0}: Error finding container e8daca4e69149b72de51e98abf18f62b4779832fe5107b7cdcf20917da9f2ddc: Status 404 returned error can't find the container with id e8daca4e69149b72de51e98abf18f62b4779832fe5107b7cdcf20917da9f2ddc
Oct 31 00:33:49.368346 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.368319    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:49.439792 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.439605    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"]
Oct 31 00:33:49.448483 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:49.448444    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af6f8e7_3e6c_4e48_9944_fa06042a5e57.slice/crio-7c8428d86a49eace18fc7d505868127daac4d7e71324d139a86b2102da239277 WatchSource:0}: Error finding container 7c8428d86a49eace18fc7d505868127daac4d7e71324d139a86b2102da239277: Status 404 returned error can't find the container with id 7c8428d86a49eace18fc7d505868127daac4d7e71324d139a86b2102da239277
Oct 31 00:33:49.646395 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.646360    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxblw" event={"ID":"506537b2-c447-4523-95f5-a53bdc768c84","Type":"ContainerStarted","Data":"9d1097cb6f5c08c431b261dbc3da752f1763bee4b06a3ba5f828bfc054100e4b"}
Oct 31 00:33:49.647471 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.647444    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n" event={"ID":"6af6f8e7-3e6c-4e48-9944-fa06042a5e57","Type":"ContainerStarted","Data":"7c8428d86a49eace18fc7d505868127daac4d7e71324d139a86b2102da239277"}
Oct 31 00:33:49.649091 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.649068    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8" event={"ID":"e4798203-046e-4ad4-842d-a211d905cd74","Type":"ContainerStarted","Data":"7a22b580020989a0d569d2e96418d7d764dc8670c60d34a678605ca3382e4c8a"}
Oct 31 00:33:49.649175 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.649111    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8" event={"ID":"e4798203-046e-4ad4-842d-a211d905cd74","Type":"ContainerStarted","Data":"daa642736d3db539695aafa72ed301bafd2a84535f05230d54eb70f9ca389fd4"}
Oct 31 00:33:49.649175 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.649131    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8" event={"ID":"e4798203-046e-4ad4-842d-a211d905cd74","Type":"ContainerStarted","Data":"e8daca4e69149b72de51e98abf18f62b4779832fe5107b7cdcf20917da9f2ddc"}
Oct 31 00:33:49.673368 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.673348    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7b5d6654d7-rbxn5"]
Oct 31 00:33:49.767908 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.767883    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 00:33:49.788942 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.788906    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 00:33:49.789090 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.789076    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:49.794061 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.794032    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 31 00:33:49.794199 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.794090    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 31 00:33:49.794199 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.794117    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 31 00:33:49.794199 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.794174    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 31 00:33:49.794199 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.794187    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 31 00:33:49.794443 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.794250    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 31 00:33:49.794443 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.794268    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 31 00:33:49.794443 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.794039    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 31 00:33:49.794443 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.794363    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tztrh\""
Oct 31 00:33:49.794662 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.794481    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 31 00:33:49.899997 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.899919    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:49.899997 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.899958    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kz46w\" (UniqueName: \"kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-kube-api-access-kz46w\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:49.899997 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.899987    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:49.900270 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.900136    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:49.900270 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.900172    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:49.900270 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.900204    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-out\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:49.900367 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.900276    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:49.900367 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.900320    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-web-config\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:49.900437 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.900370    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-volume\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:49.900437 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.900416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:49.900515 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.900443    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:49.900515 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.900480    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:49.900584 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:49.900525    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.001359 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.001322    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-volume\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.001528 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.001380    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.001528 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.001414    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.001528 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.001447    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.001528 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.001464    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.001720 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.001605    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.001720 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.001645    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz46w\" (UniqueName: \"kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-kube-api-access-kz46w\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.001720 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.001682    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.001860 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.001744    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.001860 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.001776    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.001860 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.001805    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-out\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.001860 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.001829    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.002049 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.001864    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-web-config\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.003173 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.002780    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.003720 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.003649    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.003986 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.003784    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.005411 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.005387    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.005838 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.005770    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-volume\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.005962 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.005943    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-out\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.006431 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.006396    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.007030 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.006545    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.007030 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.006763    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.007030 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.006964    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.007030 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.007008    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-web-config\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.008401 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.008384    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.010154 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.010133    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz46w\" (UniqueName: \"kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-kube-api-access-kz46w\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.202111 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.201819    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:33:50.509265 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.509163    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 00:33:50.511404 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:50.511376    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61be19ab_d9e4_49ad_9a50_4e7ff89d7bcf.slice/crio-c54eb23e869163f2d6c2849805e4f4f97ac0bd3ca3408f20c729e1bea6c1d1f8 WatchSource:0}: Error finding container c54eb23e869163f2d6c2849805e4f4f97ac0bd3ca3408f20c729e1bea6c1d1f8: Status 404 returned error can't find the container with id c54eb23e869163f2d6c2849805e4f4f97ac0bd3ca3408f20c729e1bea6c1d1f8
Oct 31 00:33:50.654962 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.654929    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5d6654d7-rbxn5" event={"ID":"1e2c6645-71a9-4a48-883d-22c96ab5ab1b","Type":"ContainerStarted","Data":"548c1fed8a98133e123a50f5eb121873215832c4634ac4281589e94170435d6d"}
Oct 31 00:33:50.655124 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.654983    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5d6654d7-rbxn5" event={"ID":"1e2c6645-71a9-4a48-883d-22c96ab5ab1b","Type":"ContainerStarted","Data":"f910692db9b6381b02717abc4eff2dfc740a1e9be1b1489b3bd3aa8f1645b9a6"}
Oct 31 00:33:50.656100 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.656077    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf","Type":"ContainerStarted","Data":"c54eb23e869163f2d6c2849805e4f4f97ac0bd3ca3408f20c729e1bea6c1d1f8"}
Oct 31 00:33:50.675035 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.674993    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-console/console-7b5d6654d7-rbxn5" podStartSLOduration=2.674981461 podStartE2EDuration="2.674981461s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:33:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:50.673798569 +0000 UTC m=+43.959564066" watchObservedRunningTime="2026-10-31 00:33:50.674981461 +0000 UTC m=+43.960746936"
Oct 31 00:33:50.761068 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.760999    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"]
Oct 31 00:33:50.781693 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.781666    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"]
Oct 31 00:33:50.781811 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.781764    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:50.801143 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.800767    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 31 00:33:50.801143 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.800823    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 31 00:33:50.801143 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.800918    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 31 00:33:50.801143 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.800952    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 31 00:33:50.801143 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.801017    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 31 00:33:50.801143 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.801108    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vpdhx\""
Oct 31 00:33:50.801620 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.801591    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-96j6jpgdnbr1c\""
Oct 31 00:33:50.912367 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.912179    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:50.912489 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.912387    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:50.912489 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.912416    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82fa81b0-268b-497e-acc1-ac9eb4a97afb-metrics-client-ca\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:50.912609 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.912562    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-grpc-tls\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:50.912683 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.912664    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82fa81b0-268b-497e-acc1-ac9eb4a97afb-tmp\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:50.912734 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.912705    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2mh5\" (UniqueName: \"kubernetes.io/projected/82fa81b0-268b-497e-acc1-ac9eb4a97afb-kube-api-access-j2mh5\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:50.912807 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.912788    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:50.912869 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.912819    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:50.912869 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:50.912837    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-tls\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.013782 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.013277    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82fa81b0-268b-497e-acc1-ac9eb4a97afb-tmp\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.013782 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.013333    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2mh5\" (UniqueName: \"kubernetes.io/projected/82fa81b0-268b-497e-acc1-ac9eb4a97afb-kube-api-access-j2mh5\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.013782 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.013385    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.013782 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.013412    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.013782 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.013442    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-tls\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.013782 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.013484    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.013782 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.013512    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.013782 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.013537    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82fa81b0-268b-497e-acc1-ac9eb4a97afb-metrics-client-ca\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.013782 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.013606    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-grpc-tls\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.013782 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.013736    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82fa81b0-268b-497e-acc1-ac9eb4a97afb-tmp\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.015606 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.015168    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82fa81b0-268b-497e-acc1-ac9eb4a97afb-metrics-client-ca\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.017336 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.017312    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.017520 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.017494    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-grpc-tls\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.018081 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.018059    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.019681 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.019654    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-tls\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.019923 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.019905    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.020283 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.020198    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.023873 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.023825    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2mh5\" (UniqueName: \"kubernetes.io/projected/82fa81b0-268b-497e-acc1-ac9eb4a97afb-kube-api-access-j2mh5\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.164378 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.164353    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:51.455066 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.454773    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"]
Oct 31 00:33:51.458833 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:51.458803    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82fa81b0_268b_497e_acc1_ac9eb4a97afb.slice/crio-d9800bfe7079bdd9eae6f80ac2ebe511c7947bd094f1433f31d50b96cc60272e WatchSource:0}: Error finding container d9800bfe7079bdd9eae6f80ac2ebe511c7947bd094f1433f31d50b96cc60272e: Status 404 returned error can't find the container with id d9800bfe7079bdd9eae6f80ac2ebe511c7947bd094f1433f31d50b96cc60272e
Oct 31 00:33:51.663849 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.663767    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8" event={"ID":"e4798203-046e-4ad4-842d-a211d905cd74","Type":"ContainerStarted","Data":"00df9f1233532b825a606ff2d4c2187ef48fe17a2051c72936e815f9e53f32f8"}
Oct 31 00:33:51.665753 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.665720    2581 generic.go:356] "Generic (PLEG): container finished" podID="506537b2-c447-4523-95f5-a53bdc768c84" containerID="a057492122a8a5c2c48430a567aa0aa0b9029b4899e4e814147d58b133a89152" exitCode=0
Oct 31 00:33:51.666308 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.666287    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxblw" event={"ID":"506537b2-c447-4523-95f5-a53bdc768c84","Type":"ContainerDied","Data":"a057492122a8a5c2c48430a567aa0aa0b9029b4899e4e814147d58b133a89152"}
Oct 31 00:33:51.667646 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.667622    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt" event={"ID":"82fa81b0-268b-497e-acc1-ac9eb4a97afb","Type":"ContainerStarted","Data":"d9800bfe7079bdd9eae6f80ac2ebe511c7947bd094f1433f31d50b96cc60272e"}
Oct 31 00:33:51.670281 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.670243    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n" event={"ID":"6af6f8e7-3e6c-4e48-9944-fa06042a5e57","Type":"ContainerStarted","Data":"b9618333fcb41cfb851d57c15deaaa5a990dfed6201c52b8ffb87cfbb45c6d56"}
Oct 31 00:33:51.670367 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.670314    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n" event={"ID":"6af6f8e7-3e6c-4e48-9944-fa06042a5e57","Type":"ContainerStarted","Data":"a29ea11c12487bc0a989ab5bea477fdef82d3e47d99cf891944c4c4dcdad08f3"}
Oct 31 00:33:51.670367 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.670346    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n" event={"ID":"6af6f8e7-3e6c-4e48-9944-fa06042a5e57","Type":"ContainerStarted","Data":"b81564f4246e3037773671410c33a11cd981e939ee582ce1931e93076bfc804f"}
Oct 31 00:33:51.686308 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.686270    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8" podStartSLOduration=2.194941151 podStartE2EDuration="3.686255422s" totalImagesPullingTime="1.491314271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:51.685076838 +0000 UTC m=+44.970842314" watchObservedRunningTime="2026-10-31 00:33:51.686255422 +0000 UTC m=+44.972020902"
Oct 31 00:33:51.728146 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:51.728101    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n" podStartSLOduration=1.837423625 podStartE2EDuration="3.728088414s" totalImagesPullingTime="1.890664789s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:51.727409275 +0000 UTC m=+45.013174753" watchObservedRunningTime="2026-10-31 00:33:51.728088414 +0000 UTC m=+45.013853888"
Oct 31 00:33:52.676349 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:52.676310    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxblw" event={"ID":"506537b2-c447-4523-95f5-a53bdc768c84","Type":"ContainerStarted","Data":"77a8c5b82be2b5ca21921e636c7cffdeafe0505dafd184e3bcd933014f749abe"}
Oct 31 00:33:52.676538 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:52.676380    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cxblw" event={"ID":"506537b2-c447-4523-95f5-a53bdc768c84","Type":"ContainerStarted","Data":"9a40c8dda7ce63c0a449e09efcd9753db5538843ac905b54d0ee13245e4fb0ab"}
Oct 31 00:33:52.678606 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:52.678577    2581 generic.go:356] "Generic (PLEG): container finished" podID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerID="0428f2cde44cbd021e0aa208861892848797adfc8e218141361b09a55688adb5" exitCode=0
Oct 31 00:33:52.678726 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:52.678664    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf","Type":"ContainerDied","Data":"0428f2cde44cbd021e0aa208861892848797adfc8e218141361b09a55688adb5"}
Oct 31 00:33:52.704283 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:52.704243    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cxblw" podStartSLOduration=2.906685588 podStartE2EDuration="4.704210901s" totalImagesPullingTime="1.707977073s" totalInitContainerRuntime="89.54824ms" isStatefulPod=true podCreationTimestamp="2026-10-31 00:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:52.702450779 +0000 UTC m=+45.988216251" watchObservedRunningTime="2026-10-31 00:33:52.704210901 +0000 UTC m=+45.989976376"
Oct 31 00:33:53.165592 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:53.165553    2581 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:53.165754 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:53.165652    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:53.170964 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:53.170939    2581 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:53.644856 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:53.644826    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-67n7t"]
Oct 31 00:33:53.662556 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:53.662524    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-67n7t"]
Oct 31 00:33:53.662694 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:53.662640    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-67n7t"
Oct 31 00:33:53.667778 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:53.667757    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xhskg\""
Oct 31 00:33:53.668394 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:53.668376    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 31 00:33:53.694545 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:53.694524    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:33:53.844336 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:53.844309    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c68937ea-3c3b-46d1-9646-a9fa24c89cde-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-67n7t\" (UID: \"c68937ea-3c3b-46d1-9646-a9fa24c89cde\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-67n7t"
Oct 31 00:33:53.844660 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:53.844368    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctxjg\" (UniqueName: \"kubernetes.io/projected/c68937ea-3c3b-46d1-9646-a9fa24c89cde-kube-api-access-ctxjg\") pod \"monitoring-plugin-77f4f76594-67n7t\" (UID: \"c68937ea-3c3b-46d1-9646-a9fa24c89cde\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-67n7t"
Oct 31 00:33:53.945528 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:53.945494    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctxjg\" (UniqueName: \"kubernetes.io/projected/c68937ea-3c3b-46d1-9646-a9fa24c89cde-kube-api-access-ctxjg\") pod \"monitoring-plugin-77f4f76594-67n7t\" (UID: \"c68937ea-3c3b-46d1-9646-a9fa24c89cde\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-67n7t"
Oct 31 00:33:53.945640 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:53.945590    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c68937ea-3c3b-46d1-9646-a9fa24c89cde-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-67n7t\" (UID: \"c68937ea-3c3b-46d1-9646-a9fa24c89cde\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-67n7t"
Oct 31 00:33:53.948586 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:53.948330    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c68937ea-3c3b-46d1-9646-a9fa24c89cde-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-67n7t\" (UID: \"c68937ea-3c3b-46d1-9646-a9fa24c89cde\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-67n7t"
Oct 31 00:33:53.954775 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:53.954754    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctxjg\" (UniqueName: \"kubernetes.io/projected/c68937ea-3c3b-46d1-9646-a9fa24c89cde-kube-api-access-ctxjg\") pod \"monitoring-plugin-77f4f76594-67n7t\" (UID: \"c68937ea-3c3b-46d1-9646-a9fa24c89cde\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-67n7t"
Oct 31 00:33:53.990484 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:53.990464    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-77f4f76594-67n7t"
Oct 31 00:33:54.272964 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:54.272895    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-77f4f76594-67n7t"]
Oct 31 00:33:54.277262 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:54.277234    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc68937ea_3c3b_46d1_9646_a9fa24c89cde.slice/crio-5efc17396649c3f6a5c79bb1af01b3e86783d9fbc0f8c29a82c6515b806cf997 WatchSource:0}: Error finding container 5efc17396649c3f6a5c79bb1af01b3e86783d9fbc0f8c29a82c6515b806cf997: Status 404 returned error can't find the container with id 5efc17396649c3f6a5c79bb1af01b3e86783d9fbc0f8c29a82c6515b806cf997
Oct 31 00:33:54.628623 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:54.628603    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ws48k"
Oct 31 00:33:54.711507 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:54.711478    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf","Type":"ContainerStarted","Data":"035e2f2b0b1e7053ef010e77779a63094a0c3131f185ee10cd6fc3de764c0892"}
Oct 31 00:33:54.711605 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:54.711564    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf","Type":"ContainerStarted","Data":"53a3ba0a2bf0513c5434f7ce6959d62deca5275bd3ef3a9a40daa7f0e9408529"}
Oct 31 00:33:54.711605 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:54.711599    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf","Type":"ContainerStarted","Data":"5adb67082cd8c7a6873038d1edb5bbef2cbf9b31758b02677f8637e8a2709d98"}
Oct 31 00:33:54.711719 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:54.711625    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf","Type":"ContainerStarted","Data":"7797b051f38d38064000634e02b76a74762fc30b302e5847220e748108dcb202"}
Oct 31 00:33:54.716621 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:54.716402    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt" event={"ID":"82fa81b0-268b-497e-acc1-ac9eb4a97afb","Type":"ContainerStarted","Data":"a2eef58166cc88c3faca989e6903f6ccc9e222de875fb24adaacc29c7f482647"}
Oct 31 00:33:54.716621 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:54.716493    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt" event={"ID":"82fa81b0-268b-497e-acc1-ac9eb4a97afb","Type":"ContainerStarted","Data":"3b346790b701820ac7e6ef16e5292aed555da4a395091444d1180ed811bfc6da"}
Oct 31 00:33:54.716621 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:54.716539    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt" event={"ID":"82fa81b0-268b-497e-acc1-ac9eb4a97afb","Type":"ContainerStarted","Data":"c6840e0229537ed03b6cd1237558792252b0a24a2414030984bca0c53912e115"}
Oct 31 00:33:54.718494 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:54.718466    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-67n7t" event={"ID":"c68937ea-3c3b-46d1-9646-a9fa24c89cde","Type":"ContainerStarted","Data":"5efc17396649c3f6a5c79bb1af01b3e86783d9fbc0f8c29a82c6515b806cf997"}
Oct 31 00:33:55.002157 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.002129    2581 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 31 00:33:55.006033 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.006011    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.011858 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.011822    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 31 00:33:55.012268 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.012060    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 31 00:33:55.012268 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.012130    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 31 00:33:55.012430 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.012276    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 31 00:33:55.028233 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.027977    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 31 00:33:55.028233 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.028170    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 31 00:33:55.028233 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.028197    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 31 00:33:55.075552 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.075524    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 31 00:33:55.075552 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.075523    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 31 00:33:55.076142 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.076118    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 31 00:33:55.076254 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.076214    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vfg6j\""
Oct 31 00:33:55.076332 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.076320    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 31 00:33:55.076425 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.076409    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8dk9u6m88n9h1\""
Oct 31 00:33:55.076555 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.076543    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 31 00:33:55.076646 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.076632    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 31 00:33:55.076715 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.076699    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 31 00:33:55.076788 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.076743    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 31 00:33:55.076860 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.076791    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 31 00:33:55.160601 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.160525    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.160818 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.160795    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.160818 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.160821    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbwmm\" (UniqueName: \"kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-kube-api-access-qbwmm\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.160996 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.160846    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.160996 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.160861    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.160996 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.160881    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.160996 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.160898    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.161296 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.161275    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.161357 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.161310    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.161403 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.161362    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.161403 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.161395    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.161475 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.161433    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.161475 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.161467    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.161553 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.161489    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.161553 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.161510    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.161553 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.161533    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.161680 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.161559    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.161680 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.161593    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.161680 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.161625    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.161680 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.161643    2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.262917 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.262885    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263044 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.262934    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263044 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.262997    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbwmm\" (UniqueName: \"kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-kube-api-access-qbwmm\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263044 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.263033    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263186 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.263047    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263186 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.263108    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263186 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.263140    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263186 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.263161    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263186 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.263176    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263430 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.263195    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263430 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.263242    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263430 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.263275    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263430 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.263303    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263430 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.263321    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263430 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.263339    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263430 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.263356    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263430 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.263377    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263430 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.263402    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263899 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.263451    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.263899 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.263474    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.265735 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.264933    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.265735 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.265349    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.265735 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.265642    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.265934 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.265912    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.268631 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.268591    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.269814 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.269126    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.270916 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.270890    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.271037 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.270925    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.271899 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.271875    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.271989 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.271898    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.271989 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.271910    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.274367 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.274347    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.276014 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.275907    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.276014 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.275976    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.276184 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.276165    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.276521 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.276501    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.276606 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.276586    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.279027 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.278995    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbwmm\" (UniqueName: \"kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-kube-api-access-qbwmm\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.279857 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.279836    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.281964 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.281942    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.370755 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.370724    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:33:55.665723 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.665697    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 31 00:33:55.667287 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:33:55.667259    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ff7973a_3f8a_4da8_a4c1_6d76b11515d1.slice/crio-c8f693e8fea1e5d57d49dbb75d40f50d1bd08291aab6528c24cb4b7efd042a8c WatchSource:0}: Error finding container c8f693e8fea1e5d57d49dbb75d40f50d1bd08291aab6528c24cb4b7efd042a8c: Status 404 returned error can't find the container with id c8f693e8fea1e5d57d49dbb75d40f50d1bd08291aab6528c24cb4b7efd042a8c
Oct 31 00:33:55.725941 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.725463    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt" event={"ID":"82fa81b0-268b-497e-acc1-ac9eb4a97afb","Type":"ContainerStarted","Data":"30dc73164115fb66b101010908ff7c06c7d16c9ff1ba4ecd1cbf2e11331c6001"}
Oct 31 00:33:55.725941 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.725540    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt" event={"ID":"82fa81b0-268b-497e-acc1-ac9eb4a97afb","Type":"ContainerStarted","Data":"d2b6274e5a95527ded6c8c60d987dac27cc297b9b4c34ac68d4673c69248c2ca"}
Oct 31 00:33:55.725941 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.725584    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt" event={"ID":"82fa81b0-268b-497e-acc1-ac9eb4a97afb","Type":"ContainerStarted","Data":"7844d01d2a2dda4e0211433335df073c34dd3a1dc7b0e9f0aa91a351a07b3c3b"}
Oct 31 00:33:55.725941 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.725845    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:33:55.731674 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.731649    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf","Type":"ContainerStarted","Data":"331be75192e767f5448811f39db2a03bfcdb46e4cf4961cde018c0d6da6e5bd3"}
Oct 31 00:33:55.731799 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.731710    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf","Type":"ContainerStarted","Data":"729817cbed6fb64229d3bb028f486c9eeb937e8490a44246f6566aabcf4edec1"}
Oct 31 00:33:55.733363 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.733337    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1","Type":"ContainerStarted","Data":"c8f693e8fea1e5d57d49dbb75d40f50d1bd08291aab6528c24cb4b7efd042a8c"}
Oct 31 00:33:55.764720 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.764661    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt" podStartSLOduration=2.620778418 podStartE2EDuration="5.76464084s" totalImagesPullingTime="3.143862422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:33:50 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:55.763023007 +0000 UTC m=+49.048788483" watchObservedRunningTime="2026-10-31 00:33:55.76464084 +0000 UTC m=+49.050406316"
Oct 31 00:33:55.799873 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:55.799802    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.143393501 podStartE2EDuration="6.799785744s" totalImagesPullingTime="3.641561058s" totalInitContainerRuntime="14.831185ms" isStatefulPod=false podCreationTimestamp="2026-10-31 00:33:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:55.797600957 +0000 UTC m=+49.083366458" watchObservedRunningTime="2026-10-31 00:33:55.799785744 +0000 UTC m=+49.085551263"
Oct 31 00:33:56.738990 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:56.738957    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-77f4f76594-67n7t" event={"ID":"c68937ea-3c3b-46d1-9646-a9fa24c89cde","Type":"ContainerStarted","Data":"2bb240f77588bdd773aecf30adab63afb1bf39bb0c2b8ba8692ad22177efe2b1"}
Oct 31 00:33:56.739515 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:56.739132    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-67n7t"
Oct 31 00:33:56.740731 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:56.740703    2581 generic.go:356] "Generic (PLEG): container finished" podID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerID="af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d" exitCode=0
Oct 31 00:33:56.740852 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:56.740731    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1","Type":"ContainerDied","Data":"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d"}
Oct 31 00:33:56.744732 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:56.744716    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-67n7t"
Oct 31 00:33:56.757795 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:56.757757    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-77f4f76594-67n7t" podStartSLOduration=2.087081145 podStartE2EDuration="3.757743915s" totalImagesPullingTime="1.67066277s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:33:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:33:56.756205034 +0000 UTC m=+50.041970521" watchObservedRunningTime="2026-10-31 00:33:56.757743915 +0000 UTC m=+50.043509391"
Oct 31 00:33:57.011827 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:57.011753    2581 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b5d6654d7-rbxn5"]
Oct 31 00:33:59.368627 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:59.368597    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:33:59.757411 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:33:59.757375    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1","Type":"ContainerStarted","Data":"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85"}
Oct 31 00:34:00.767641 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:00.767610    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1","Type":"ContainerStarted","Data":"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d"}
Oct 31 00:34:00.768032 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:00.767695    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1","Type":"ContainerStarted","Data":"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca"}
Oct 31 00:34:00.768032 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:00.767720    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1","Type":"ContainerStarted","Data":"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7"}
Oct 31 00:34:00.768032 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:00.767748    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1","Type":"ContainerStarted","Data":"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25"}
Oct 31 00:34:00.768032 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:00.767771    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1","Type":"ContainerStarted","Data":"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612"}
Oct 31 00:34:00.802493 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:00.802445    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.88280277 podStartE2EDuration="6.802430397s" totalImagesPullingTime="2.889208978s" totalInitContainerRuntime="30.418649ms" isStatefulPod=false podCreationTimestamp="2026-10-31 00:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:34:00.799570277 +0000 UTC m=+54.085335766" watchObservedRunningTime="2026-10-31 00:34:00.802430397 +0000 UTC m=+54.088195872"
Oct 31 00:34:01.747355 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:01.747324    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:02.589491 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:02.589465    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:05.371057 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:05.371029    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:08.397101 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:08.397063    2581 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-579b9db4b-hb7q9"]
Oct 31 00:34:10.429474 ip-10-0-143-7 kubenswrapper[2581]: E1031 00:34:10.429439    2581 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:34:12.826089 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:12.826054    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs\") pod \"network-metrics-daemon-wcnrx\" (UID: \"0883a925-b7f8-44b8-a889-4d3cc5af9fe8\") " pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:34:12.829513 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:12.829493    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 31 00:34:12.838681 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:12.838654    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs\") pod \"network-metrics-daemon-wcnrx\" (UID: \"0883a925-b7f8-44b8-a889-4d3cc5af9fe8\") " pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:34:12.865864 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:12.865839    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-87knn\""
Oct 31 00:34:12.873072 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:12.873054    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:34:12.926827 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:12.926793    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f68jv\" (UniqueName: \"kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv\") pod \"network-check-target-wf75m\" (UID: \"26ab7116-31a7-404c-8a01-6502edf9f5ce\") " pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:34:12.926946 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:12.926876    2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:34:12.931879 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:12.931827    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 31 00:34:12.932534 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:12.932470    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 00:34:12.939523 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:12.939504    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:34:12.941149 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:12.941114    2581 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 31 00:34:12.950479 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:12.950443    2581 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f68jv\" (UniqueName: \"kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv\") pod \"network-check-target-wf75m\" (UID: \"26ab7116-31a7-404c-8a01-6502edf9f5ce\") " pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:34:13.141766 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:13.141741    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wcnrx"]
Oct 31 00:34:13.143949 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:34:13.143922    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0883a925_b7f8_44b8_a889_4d3cc5af9fe8.slice/crio-f830a534e525123941c29f57ef11e0e53ff99698f95c469947360348d1ef731f WatchSource:0}: Error finding container f830a534e525123941c29f57ef11e0e53ff99698f95c469947360348d1ef731f: Status 404 returned error can't find the container with id f830a534e525123941c29f57ef11e0e53ff99698f95c469947360348d1ef731f
Oct 31 00:34:13.157522 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:13.157502    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-v94lw\""
Oct 31 00:34:13.164554 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:13.164538    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:34:13.170702 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:13.170683    2581 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-qhb2k\""
Oct 31 00:34:13.177974 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:13.177953    2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:34:13.436873 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:13.436846    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zdznl"]
Oct 31 00:34:13.438036 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:34:13.438012    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90fdba20_20ae_405d_bd58_0756cc1fdcad.slice/crio-72348916979ff0fa963b73b16187624f5ffd8cdd9b40f4feb208ea375361abbe WatchSource:0}: Error finding container 72348916979ff0fa963b73b16187624f5ffd8cdd9b40f4feb208ea375361abbe: Status 404 returned error can't find the container with id 72348916979ff0fa963b73b16187624f5ffd8cdd9b40f4feb208ea375361abbe
Oct 31 00:34:13.453396 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:13.453379    2581 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wf75m"]
Oct 31 00:34:13.455148 ip-10-0-143-7 kubenswrapper[2581]: W1031 00:34:13.455124    2581 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26ab7116_31a7_404c_8a01_6502edf9f5ce.slice/crio-381d2c0a559a7af6889d0a9f5bf242d3959794284d48396f7baa357acc3a9c55 WatchSource:0}: Error finding container 381d2c0a559a7af6889d0a9f5bf242d3959794284d48396f7baa357acc3a9c55: Status 404 returned error can't find the container with id 381d2c0a559a7af6889d0a9f5bf242d3959794284d48396f7baa357acc3a9c55
Oct 31 00:34:13.817516 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:13.817482    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wf75m" event={"ID":"26ab7116-31a7-404c-8a01-6502edf9f5ce","Type":"ContainerStarted","Data":"381d2c0a559a7af6889d0a9f5bf242d3959794284d48396f7baa357acc3a9c55"}
Oct 31 00:34:13.818927 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:13.818897    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zdznl" event={"ID":"90fdba20-20ae-405d-bd58-0756cc1fdcad","Type":"ContainerStarted","Data":"72348916979ff0fa963b73b16187624f5ffd8cdd9b40f4feb208ea375361abbe"}
Oct 31 00:34:13.820126 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:13.820098    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wcnrx" event={"ID":"0883a925-b7f8-44b8-a889-4d3cc5af9fe8","Type":"ContainerStarted","Data":"f830a534e525123941c29f57ef11e0e53ff99698f95c469947360348d1ef731f"}
Oct 31 00:34:14.827916 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:14.827878    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wcnrx" event={"ID":"0883a925-b7f8-44b8-a889-4d3cc5af9fe8","Type":"ContainerStarted","Data":"40bf661c32d9a416a3e759a2cb1c17ecbd1a7072dc08cde1c1b94b0d246af719"}
Oct 31 00:34:14.828465 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:14.827945    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wcnrx" event={"ID":"0883a925-b7f8-44b8-a889-4d3cc5af9fe8","Type":"ContainerStarted","Data":"8d4fbb4654d980a125b903c150c40c6de02bd4c501796bdb5a009a44410a503f"}
Oct 31 00:34:14.846918 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:14.846874    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wcnrx" podStartSLOduration=66.559411965 podStartE2EDuration="1m7.846862556s" totalImagesPullingTime="1.287450591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:34:14.84589847 +0000 UTC m=+68.131663946" watchObservedRunningTime="2026-10-31 00:34:14.846862556 +0000 UTC m=+68.132628030"
Oct 31 00:34:17.844570 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:17.844528    2581 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wf75m" event={"ID":"26ab7116-31a7-404c-8a01-6502edf9f5ce","Type":"ContainerStarted","Data":"bcdc2467751f5ca304a4bcfc1ed9997ec565545f395e33e1d02c2229a55ead36"}
Oct 31 00:34:17.845130 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:17.844718    2581 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:34:17.862611 ip-10-0-143-7 kubenswrapper[2581]: I1031 00:34:17.862562    2581 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wf75m" podStartSLOduration=67.351418445 podStartE2EDuration="1m10.86254933s" totalImagesPullingTime="3.511130885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:33:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:34:17.861509767 +0000 UTC m=+71.147275244" watchObservedRunningTime="2026-10-31 00:34:17.86254933 +0000 UTC m=+71.148314805"
Oct 31 00:34:18.848989 ip-10-0-143-7 systemd[1]: Stopping Kubernetes Kubelet...
Oct 31 00:34:18.873641 ip-10-0-143-7 systemd[1]: kubelet.service: Deactivated successfully.
Oct 31 00:34:18.873815 ip-10-0-143-7 systemd[1]: Stopped Kubernetes Kubelet.
Oct 31 00:34:18.873995 ip-10-0-143-7 systemd[1]: kubelet.service: Consumed 4.514s CPU time.
Oct 31 00:34:18.895709 ip-10-0-143-7 systemd[1]: Starting Kubernetes Kubelet...
Oct 31 00:34:18.967056 ip-10-0-143-7 kubenswrapper[5946]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 00:34:18.967056 ip-10-0-143-7 kubenswrapper[5946]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Oct 31 00:34:18.967056 ip-10-0-143-7 kubenswrapper[5946]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 00:34:18.967056 ip-10-0-143-7 kubenswrapper[5946]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Oct 31 00:34:18.969282 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969182    5946 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:34:18.969282 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969281    5946 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:34:18.969282 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969285    5946 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969288    5946 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969291    5946 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969294    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969297    5946 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969299    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969302    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969305    5946 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969308    5946 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969310    5946 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969313    5946 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969315    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969318    5946 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969320    5946 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969323    5946 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969326    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969329    5946 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969331    5946 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969341    5946 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969344    5946 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:34:18.969386 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969347    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969349    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969352    5946 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969355    5946 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969357    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969360    5946 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969362    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969365    5946 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969368    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969371    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969373    5946 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969376    5946 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969378    5946 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969381    5946 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969384    5946 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969387    5946 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969390    5946 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969393    5946 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969395    5946 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:34:18.969889 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969398    5946 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969400    5946 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969403    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969406    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969408    5946 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969411    5946 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969413    5946 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969416    5946 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969419    5946 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969421    5946 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969423    5946 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969428    5946 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969433    5946 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969436    5946 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969440    5946 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969444    5946 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969447    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969450    5946 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969452    5946 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969455    5946 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:34:18.970388 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969458    5946 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969460    5946 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969463    5946 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969466    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969468    5946 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969471    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969479    5946 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969482    5946 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969485    5946 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969487    5946 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969490    5946 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969493    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969495    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969497    5946 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969500    5946 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969505    5946 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969509    5946 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969513    5946 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969517    5946 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:34:18.970884 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969520    5946 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969523    5946 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969526    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969529    5946 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969531    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969534    5946 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969538    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969541    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969544    5946 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969547    5946 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969549    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969552    5946 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969555    5946 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969557    5946 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969560    5946 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969562    5946 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969565    5946 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969567    5946 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969570    5946 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969572    5946 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:34:18.971362 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969575    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969578    5946 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969584    5946 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969587    5946 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969589    5946 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.969592    5946 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970344    5946 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970352    5946 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970359    5946 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970363    5946 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970365    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970368    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970371    5946 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970375    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970377    5946 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970380    5946 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970383    5946 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970385    5946 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970388    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970391    5946 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:34:18.971857 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970394    5946 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970399    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970401    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970404    5946 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970407    5946 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970409    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970412    5946 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970416    5946 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970419    5946 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970422    5946 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970425    5946 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970429    5946 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970433    5946 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970437    5946 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970440    5946 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970442    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970445    5946 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970448    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970450    5946 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:34:18.972433 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970454    5946 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970458    5946 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970460    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970463    5946 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970466    5946 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970469    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970471    5946 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970474    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970478    5946 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970480    5946 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970483    5946 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970486    5946 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970488    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970491    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970494    5946 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970497    5946 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970500    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970502    5946 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970505    5946 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970507    5946 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:34:18.972912 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970510    5946 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970513    5946 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970516    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970518    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970521    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970524    5946 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970526    5946 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970529    5946 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970531    5946 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970534    5946 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970536    5946 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970539    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970542    5946 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970545    5946 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970548    5946 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970551    5946 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970553    5946 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970556    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970559    5946 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970561    5946 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:34:18.973425 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970564    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970567    5946 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970569    5946 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970572    5946 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970574    5946 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970577    5946 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970580    5946 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970582    5946 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970585    5946 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970587    5946 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970590    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970592    5946 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970595    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970597    5946 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970600    5946 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970602    5946 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970605    5946 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970607    5946 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970610    5946 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:34:18.973921 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970612    5946 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970615    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970617    5946 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970620    5946 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970622    5946 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970626    5946 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970629    5946 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970632    5946 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970635    5946 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970637    5946 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970640    5946 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970643    5946 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970645    5946 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.970648    5946 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971129    5946 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971136    5946 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971139    5946 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971143    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971146    5946 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:34:18.974407 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971149    5946 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971152    5946 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971154    5946 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971157    5946 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971160    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971162    5946 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971165    5946 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971167    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971170    5946 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971173    5946 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971175    5946 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971178    5946 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971181    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971183    5946 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971186    5946 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971189    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971191    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971194    5946 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971196    5946 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:34:18.974869 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971200    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971202    5946 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971205    5946 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971208    5946 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971210    5946 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971213    5946 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971229    5946 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971232    5946 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971234    5946 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971237    5946 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971239    5946 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971242    5946 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971246    5946 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971250    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971253    5946 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971256    5946 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971259    5946 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971261    5946 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971264    5946 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971266    5946 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:34:18.975508 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971270    5946 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971272    5946 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971275    5946 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971278    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971280    5946 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971283    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971286    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971288    5946 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971291    5946 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971293    5946 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971297    5946 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971299    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971302    5946 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971305    5946 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971307    5946 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971310    5946 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971312    5946 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971315    5946 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971317    5946 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971320    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:34:18.976283 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971322    5946 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971325    5946 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971328    5946 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971331    5946 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971334    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971336    5946 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971339    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971342    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971345    5946 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971347    5946 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971350    5946 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971352    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971354    5946 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971357    5946 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971360    5946 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971362    5946 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971365    5946 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971368    5946 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971370    5946 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:34:18.976798 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971373    5946 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971377    5946 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971381    5946 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971384    5946 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971386    5946 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971390    5946 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971393    5946 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971396    5946 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971399    5946 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971401    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971404    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971406    5946 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971409    5946 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971412    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971414    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971417    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971419    5946 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971422    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971424    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:34:18.977288 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971426    5946 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971429    5946 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971432    5946 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.971435    5946 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971524    5946 flags.go:64] FLAG: --address="0.0.0.0"
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971531    5946 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971542    5946 flags.go:64] FLAG: --anonymous-auth="true"
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971547    5946 flags.go:64] FLAG: --application-metrics-count-limit="100"
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971551    5946 flags.go:64] FLAG: --authentication-token-webhook="false"
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971554    5946 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971558    5946 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971562    5946 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971566    5946 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971569    5946 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971572    5946 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971575    5946 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971579    5946 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971582    5946 flags.go:64] FLAG: --cgroup-root=""
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971585    5946 flags.go:64] FLAG: --cgroups-per-qos="true"
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971588    5946 flags.go:64] FLAG: --client-ca-file=""
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971590    5946 flags.go:64] FLAG: --cloud-provider="external"
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971593    5946 flags.go:64] FLAG: --cluster-dns="[]"
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971601    5946 flags.go:64] FLAG: --cluster-domain=""
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971604    5946 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Oct 31 00:34:18.977761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971607    5946 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971613    5946 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971616    5946 flags.go:64] FLAG: --container-log-max-files="5"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971620    5946 flags.go:64] FLAG: --container-log-max-size="10Mi"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971623    5946 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971627    5946 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971630    5946 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971633    5946 flags.go:64] FLAG: --contention-profiling="false"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971636    5946 flags.go:64] FLAG: --cpu-cfs-quota="true"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971639    5946 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971642    5946 flags.go:64] FLAG: --cpu-manager-policy="none"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971651    5946 flags.go:64] FLAG: --cpu-manager-policy-options=""
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971655    5946 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971658    5946 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971662    5946 flags.go:64] FLAG: --enable-debugging-handlers="true"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971664    5946 flags.go:64] FLAG: --enable-load-reader="false"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971668    5946 flags.go:64] FLAG: --enable-server="true"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971670    5946 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971675    5946 flags.go:64] FLAG: --event-burst="100"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971678    5946 flags.go:64] FLAG: --event-qps="50"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971681    5946 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971685    5946 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971688    5946 flags.go:64] FLAG: --eviction-hard=""
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971692    5946 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Oct 31 00:34:18.978411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971695    5946 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971698    5946 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971704    5946 flags.go:64] FLAG: --eviction-soft=""
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971707    5946 flags.go:64] FLAG: --eviction-soft-grace-period=""
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971710    5946 flags.go:64] FLAG: --exit-on-lock-contention="false"
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971713    5946 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971716    5946 flags.go:64] FLAG: --experimental-mounter-path=""
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971721    5946 flags.go:64] FLAG: --fail-cgroupv1="true"
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971724    5946 flags.go:64] FLAG: --fail-swap-on="true"
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971729    5946 flags.go:64] FLAG: --feature-gates=""
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971733    5946 flags.go:64] FLAG: --file-check-frequency="20s"
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971736    5946 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971740    5946 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971743    5946 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971746    5946 flags.go:64] FLAG: --healthz-port="10248"
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971749    5946 flags.go:64] FLAG: --help="false"
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971752    5946 flags.go:64] FLAG: --hostname-override="ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971755    5946 flags.go:64] FLAG: --housekeeping-interval="10s"
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971758    5946 flags.go:64] FLAG: --http-check-frequency="20s"
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971761    5946 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971770    5946 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971773    5946 flags.go:64] FLAG: --image-gc-high-threshold="85"
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971777    5946 flags.go:64] FLAG: --image-gc-low-threshold="80"
Oct 31 00:34:18.979011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971780    5946 flags.go:64] FLAG: --image-service-endpoint=""
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971783    5946 flags.go:64] FLAG: --kernel-memcg-notification="false"
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971786    5946 flags.go:64] FLAG: --kube-api-burst="100"
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971789    5946 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971793    5946 flags.go:64] FLAG: --kube-api-qps="50"
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971798    5946 flags.go:64] FLAG: --kube-reserved=""
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971802    5946 flags.go:64] FLAG: --kube-reserved-cgroup=""
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971806    5946 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971810    5946 flags.go:64] FLAG: --kubelet-cgroups=""
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971812    5946 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971815    5946 flags.go:64] FLAG: --lock-file=""
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971818    5946 flags.go:64] FLAG: --log-cadvisor-usage="false"
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971821    5946 flags.go:64] FLAG: --log-flush-frequency="5s"
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971824    5946 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971830    5946 flags.go:64] FLAG: --log-json-split-stream="false"
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971833    5946 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971838    5946 flags.go:64] FLAG: --log-text-split-stream="false"
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971841    5946 flags.go:64] FLAG: --logging-format="text"
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971846    5946 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971849    5946 flags.go:64] FLAG: --make-iptables-util-chains="true"
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971852    5946 flags.go:64] FLAG: --manifest-url=""
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971855    5946 flags.go:64] FLAG: --manifest-url-header=""
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971859    5946 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971862    5946 flags.go:64] FLAG: --max-open-files="1000000"
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971867    5946 flags.go:64] FLAG: --max-pods="110"
Oct 31 00:34:18.979589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971870    5946 flags.go:64] FLAG: --maximum-dead-containers="-1"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971873    5946 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971878    5946 flags.go:64] FLAG: --memory-manager-policy="None"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971881    5946 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971884    5946 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971890    5946 flags.go:64] FLAG: --node-ip="0.0.0.0"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971893    5946 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971900    5946 flags.go:64] FLAG: --node-status-max-images="50"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971903    5946 flags.go:64] FLAG: --node-status-update-frequency="10s"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971906    5946 flags.go:64] FLAG: --oom-score-adj="-999"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971909    5946 flags.go:64] FLAG: --pod-cidr=""
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971912    5946 flags.go:64] FLAG: --pod-manifest-path=""
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971914    5946 flags.go:64] FLAG: --pod-max-pids="-1"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971917    5946 flags.go:64] FLAG: --pods-per-core="0"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971920    5946 flags.go:64] FLAG: --port="10250"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971923    5946 flags.go:64] FLAG: --protect-kernel-defaults="false"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971926    5946 flags.go:64] FLAG: --provider-id="aws:///us-east-2a/i-04763f1704efb3225"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971929    5946 flags.go:64] FLAG: --qos-reserved=""
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971932    5946 flags.go:64] FLAG: --read-only-port="10255"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971935    5946 flags.go:64] FLAG: --register-node="true"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971938    5946 flags.go:64] FLAG: --register-with-taints=""
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971942    5946 flags.go:64] FLAG: --registry-burst="10"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971945    5946 flags.go:64] FLAG: --registry-qps="5"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971949    5946 flags.go:64] FLAG: --reserved-cpus=""
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971952    5946 flags.go:64] FLAG: --reserved-memory=""
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971957    5946 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Oct 31 00:34:18.980230 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971960    5946 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971963    5946 flags.go:64] FLAG: --rotate-certificates="false"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971966    5946 flags.go:64] FLAG: --rotate-server-certificates="false"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971969    5946 flags.go:64] FLAG: --runonce="false"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971972    5946 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971975    5946 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971978    5946 flags.go:64] FLAG: --seccomp-default="false"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971981    5946 flags.go:64] FLAG: --serialize-image-pulls="true"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971984    5946 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971987    5946 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971990    5946 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971993    5946 flags.go:64] FLAG: --storage-driver-password="root"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971996    5946 flags.go:64] FLAG: --storage-driver-secure="false"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.971999    5946 flags.go:64] FLAG: --storage-driver-table="stats"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972002    5946 flags.go:64] FLAG: --storage-driver-user="root"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972005    5946 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972008    5946 flags.go:64] FLAG: --sync-frequency="1m0s"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972011    5946 flags.go:64] FLAG: --system-cgroups=""
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972013    5946 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972018    5946 flags.go:64] FLAG: --system-reserved-cgroup=""
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972021    5946 flags.go:64] FLAG: --tls-cert-file=""
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972024    5946 flags.go:64] FLAG: --tls-cipher-suites="[]"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972028    5946 flags.go:64] FLAG: --tls-min-version=""
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972031    5946 flags.go:64] FLAG: --tls-private-key-file=""
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972034    5946 flags.go:64] FLAG: --topology-manager-policy="none"
Oct 31 00:34:18.980878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972037    5946 flags.go:64] FLAG: --topology-manager-policy-options=""
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972040    5946 flags.go:64] FLAG: --topology-manager-scope="container"
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972042    5946 flags.go:64] FLAG: --v="2"
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972046    5946 flags.go:64] FLAG: --version="false"
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972052    5946 flags.go:64] FLAG: --vmodule=""
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972055    5946 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972060    5946 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972214    5946 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972230    5946 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972234    5946 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972236    5946 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972240    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972242    5946 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972245    5946 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972248    5946 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972250    5946 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972253    5946 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972256    5946 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972258    5946 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972261    5946 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972270    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:34:18.981490 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972273    5946 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972277    5946 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972281    5946 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972284    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972287    5946 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972290    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972292    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972295    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972297    5946 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972300    5946 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972302    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972305    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972308    5946 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972310    5946 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972313    5946 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972317    5946 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972320    5946 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972323    5946 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972326    5946 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972329    5946 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:34:18.982017 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972331    5946 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972334    5946 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972336    5946 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972339    5946 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972342    5946 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972344    5946 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972346    5946 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972349    5946 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972352    5946 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972354    5946 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972357    5946 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972359    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972367    5946 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972370    5946 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972373    5946 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972376    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972378    5946 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972381    5946 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972383    5946 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972386    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:34:18.982518 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972388    5946 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972391    5946 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972393    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972396    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972398    5946 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972401    5946 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972403    5946 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972407    5946 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972410    5946 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972413    5946 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972416    5946 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972419    5946 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972421    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972424    5946 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972427    5946 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972429    5946 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972431    5946 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972434    5946 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972437    5946 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:34:18.983008 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972440    5946 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972442    5946 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972445    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972448    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972450    5946 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972453    5946 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972461    5946 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972464    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972466    5946 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972469    5946 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972472    5946 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972475    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972477    5946 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972480    5946 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972483    5946 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972486    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972488    5946 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972490    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972493    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972495    5946 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:34:18.983559 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972513    5946 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:34:18.984097 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972517    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:34:18.984097 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972521    5946 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:34:18.984097 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972524    5946 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:34:18.984097 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972526    5946 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:34:18.984097 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972531    5946 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:34:18.984097 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972535    5946 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:34:18.984097 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972538    5946 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:34:18.984097 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972541    5946 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:34:18.984097 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972543    5946 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:34:18.984097 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972546    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:34:18.984097 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972549    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:34:18.984097 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972552    5946 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:34:18.984097 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.972578    5946 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 00:34:18.984097 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972628    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:34:18.984097 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972632    5946 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972636    5946 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972642    5946 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972645    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972653    5946 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972656    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972659    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972661    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972664    5946 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972666    5946 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972669    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972671    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972674    5946 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972677    5946 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972679    5946 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972682    5946 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972684    5946 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972688    5946 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972691    5946 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972693    5946 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:34:18.984493 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972697    5946 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972700    5946 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972702    5946 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972705    5946 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972707    5946 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972710    5946 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972712    5946 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972715    5946 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972717    5946 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972720    5946 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972723    5946 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972726    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972728    5946 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972731    5946 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972733    5946 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972736    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972738    5946 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972746    5946 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972749    5946 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972752    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:34:18.985006 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972754    5946 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972757    5946 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972759    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972762    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972764    5946 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972767    5946 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972769    5946 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972772    5946 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972774    5946 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972779    5946 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972781    5946 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972784    5946 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972788    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972790    5946 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972793    5946 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972795    5946 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972798    5946 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972800    5946 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972803    5946 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:34:18.985596 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972806    5946 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972808    5946 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972811    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972813    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972816    5946 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972818    5946 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972821    5946 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972823    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972826    5946 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972829    5946 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972831    5946 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972839    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972842    5946 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972845    5946 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972847    5946 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972850    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972852    5946 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972855    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972858    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972860    5946 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:34:18.986241 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972863    5946 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972866    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972869    5946 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972872    5946 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972874    5946 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972880    5946 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972885    5946 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972888    5946 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972891    5946 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972894    5946 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972896    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972899    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972901    5946 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972904    5946 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972907    5946 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972910    5946 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972913    5946 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972916    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972919    5946 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:34:18.986799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972922    5946 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972925    5946 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972928    5946 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972930    5946 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972933    5946 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972941    5946 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.972944    5946 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.977974    5946 server.go:525] "Kubelet version" kubeletVersion="v1.35.9"
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.977991    5946 server.go:527] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.978009    5946 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.978014    5946 watchdog_linux.go:138] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978081    5946 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978086    5946 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978090    5946 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978093    5946 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978096    5946 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978099    5946 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978102    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978105    5946 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978107    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:34:18.987268 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978110    5946 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978113    5946 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978115    5946 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978118    5946 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978121    5946 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978124    5946 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978128    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978131    5946 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978133    5946 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978136    5946 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978139    5946 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978141    5946 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978144    5946 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978147    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978150    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978153    5946 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978155    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978158    5946 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978161    5946 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978163    5946 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:34:18.987759 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978167    5946 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978170    5946 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978173    5946 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978176    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978179    5946 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978181    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978184    5946 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978187    5946 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978189    5946 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978192    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978194    5946 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978197    5946 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978200    5946 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978202    5946 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978205    5946 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978207    5946 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978210    5946 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978214    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978231    5946 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:34:18.988260 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978236    5946 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978240    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978244    5946 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978248    5946 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978252    5946 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978255    5946 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978258    5946 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978261    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978265    5946 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978269    5946 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978272    5946 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978275    5946 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978278    5946 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978281    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978284    5946 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978286    5946 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978289    5946 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978291    5946 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978294    5946 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:34:18.988805 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978297    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978299    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978302    5946 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978304    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978307    5946 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978309    5946 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978312    5946 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978315    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978318    5946 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978320    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978323    5946 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978326    5946 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978329    5946 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978332    5946 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978335    5946 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978338    5946 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978341    5946 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978343    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978346    5946 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978348    5946 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:34:18.989549 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978350    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:34:18.990320 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978353    5946 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:34:18.990320 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978356    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:34:18.990320 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978358    5946 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:34:18.990320 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978361    5946 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:34:18.990320 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978363    5946 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:34:18.990320 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978366    5946 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:34:18.990320 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978368    5946 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:34:18.990320 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978371    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:34:18.990320 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978375    5946 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:34:18.990320 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978379    5946 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:34:18.990320 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978382    5946 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:34:18.990320 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978386    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:34:18.990320 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978389    5946 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:34:18.990320 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978392    5946 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:34:18.990320 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978394    5946 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:34:18.990320 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978397    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:34:18.990320 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978400    5946 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:34:18.990320 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978402    5946 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:34:18.990797 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.978429    5946 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 00:34:18.990797 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978570    5946 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:34:18.990797 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978575    5946 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:34:18.990797 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978578    5946 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:34:18.990797 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978581    5946 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:34:18.990797 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978584    5946 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:34:18.990797 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978587    5946 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:34:18.990797 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978590    5946 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:34:18.990797 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978593    5946 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:34:18.990797 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978596    5946 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:34:18.990797 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978599    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:34:18.990797 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978601    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:34:18.990797 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978604    5946 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:34:18.990797 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978606    5946 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:34:18.990797 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978609    5946 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:34:18.990797 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978612    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978614    5946 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978617    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978620    5946 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978622    5946 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978625    5946 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978627    5946 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978630    5946 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978632    5946 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978635    5946 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978638    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978640    5946 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978643    5946 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978645    5946 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978648    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978650    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978653    5946 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978655    5946 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978658    5946 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978661    5946 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:34:18.991255 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978663    5946 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978666    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978669    5946 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978671    5946 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978675    5946 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978678    5946 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978680    5946 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978683    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978685    5946 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978688    5946 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978691    5946 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978693    5946 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978696    5946 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978700    5946 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978704    5946 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978708    5946 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978711    5946 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978714    5946 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978716    5946 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:34:18.991799 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978719    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978722    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978724    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978727    5946 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978729    5946 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978732    5946 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978735    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978737    5946 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978740    5946 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978742    5946 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978745    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978747    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978750    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978752    5946 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978755    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978758    5946 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978761    5946 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978763    5946 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978766    5946 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:34:18.992593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978769    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978772    5946 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978774    5946 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978777    5946 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978779    5946 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978782    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978784    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978787    5946 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978789    5946 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978792    5946 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978796    5946 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978799    5946 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978802    5946 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978804    5946 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978807    5946 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978809    5946 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978812    5946 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978814    5946 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978817    5946 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:34:18.993143 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978819    5946 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:34:18.993638 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978823    5946 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:34:18.993638 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978825    5946 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:34:18.993638 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978828    5946 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:34:18.993638 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978830    5946 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:34:18.993638 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978833    5946 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:34:18.993638 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978835    5946 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:34:18.993638 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978838    5946 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:34:18.993638 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978841    5946 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:34:18.993638 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978844    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:34:18.993638 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978846    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:34:18.993638 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978849    5946 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:34:18.993638 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978851    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:34:18.993638 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978854    5946 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:34:18.993638 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978857    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:34:18.993638 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.978880    5946 feature_gate.go:465] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false DRAPartitionableDevices:false EventedPLEG:false KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:true MutatingAdmissionPolicy:false RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true UserNamespacesSupport:true]}
Oct 31 00:34:18.993638 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978912    5946 feature_gate.go:386] unrecognized feature gate: ImageStreamImportMode
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978916    5946 feature_gate.go:386] unrecognized feature gate: DualReplica
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978920    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIControlPlaneInstall
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978923    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDC
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978926    5946 feature_gate.go:386] unrecognized feature gate: InsightsConfig
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978930    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiDisk
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978932    5946 feature_gate.go:386] unrecognized feature gate: ShortCertRotation
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978935    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementOpenStack
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978937    5946 feature_gate.go:386] unrecognized feature gate: AzureMultiDisk
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978940    5946 feature_gate.go:386] unrecognized feature gate: ClusterUpdateAcceptRisks
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978942    5946 feature_gate.go:386] unrecognized feature gate: GCPSovereignCloudInstall
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978945    5946 feature_gate.go:386] unrecognized feature gate: UpgradeStatus
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978947    5946 feature_gate.go:386] unrecognized feature gate: GCPDualStackInstall
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978950    5946 feature_gate.go:386] unrecognized feature gate: OVNObservability
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978953    5946 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpoints
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978955    5946 feature_gate.go:386] unrecognized feature gate: NewOLM
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978958    5946 feature_gate.go:386] unrecognized feature gate: CRIOCredentialProviderConfig
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978960    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUpstreamParity
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978963    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIComputeInstall
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978965    5946 feature_gate.go:386] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Oct 31 00:34:18.994166 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978972    5946 feature_gate.go:386] unrecognized feature gate: ProvisioningRequestAvailable
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978975    5946 feature_gate.go:386] unrecognized feature gate: BootcNodeManagement
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978977    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationOpenStack
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978980    5946 feature_gate.go:386] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978983    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978986    5946 feature_gate.go:386] unrecognized feature gate: MultiDiskSetup
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978988    5946 feature_gate.go:386] unrecognized feature gate: KMSEncryptionProvider
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978991    5946 feature_gate.go:386] unrecognized feature gate: ImageModeStatusReporting
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978993    5946 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerificationPKI
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978996    5946 feature_gate.go:386] unrecognized feature gate: AWSDualStackInstall
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.978999    5946 feature_gate.go:386] unrecognized feature gate: ConfigurablePKI
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979002    5946 feature_gate.go:386] unrecognized feature gate: EventTTL
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979005    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationAWS
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979007    5946 feature_gate.go:386] unrecognized feature gate: EtcdBackendQuota
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979010    5946 feature_gate.go:386] unrecognized feature gate: ManagedBootImagesCPMS
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979013    5946 feature_gate.go:386] unrecognized feature gate: Example2
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979016    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigration
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979018    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementGCP
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979021    5946 feature_gate.go:386] unrecognized feature gate: AutomatedEtcdBackup
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979024    5946 feature_gate.go:386] unrecognized feature gate: OSStreams
Oct 31 00:34:18.994689 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979026    5946 feature_gate.go:386] unrecognized feature gate: IrreconcilableMachineConfig
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979029    5946 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNS
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979032    5946 feature_gate.go:386] unrecognized feature gate: TLSAdherence
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979035    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementBareMetal
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979037    5946 feature_gate.go:386] unrecognized feature gate: ExternalSnapshotMetadata
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979040    5946 feature_gate.go:386] unrecognized feature gate: MixedCPUsAllocation
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979043    5946 feature_gate.go:386] unrecognized feature gate: KMSEncryption
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979045    5946 feature_gate.go:386] unrecognized feature gate: AWSDedicatedHosts
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979048    5946 feature_gate.go:386] unrecognized feature gate: AzureWorkloadIdentity
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979051    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstallIBMCloud
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979053    5946 feature_gate.go:386] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979056    5946 feature_gate.go:386] unrecognized feature gate: NewOLMConfigAPI
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979060    5946 feature_gate.go:386] unrecognized feature gate: VSphereHostVMGroupZonal
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979063    5946 feature_gate.go:386] unrecognized feature gate: OpenShiftPodSecurityAdmission
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979065    5946 feature_gate.go:386] unrecognized feature gate: CRDCompatibilityRequirementOperator
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979070    5946 feature_gate.go:409] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979073    5946 feature_gate.go:386] unrecognized feature gate: NewOLMPreflightPermissionChecks
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979076    5946 feature_gate.go:386] unrecognized feature gate: DNSNameResolver
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979079    5946 feature_gate.go:386] unrecognized feature gate: MultiArchInstallAzure
Oct 31 00:34:18.995176 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979081    5946 feature_gate.go:386] unrecognized feature gate: BootImageSkewEnforcement
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979084    5946 feature_gate.go:386] unrecognized feature gate: NutanixMultiSubnets
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979088    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIMigrationVSphere
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979090    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAzure
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979094    5946 feature_gate.go:386] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979097    5946 feature_gate.go:386] unrecognized feature gate: BuildCSIVolumes
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979099    5946 feature_gate.go:386] unrecognized feature gate: NewOLMBoxCutterRuntime
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979102    5946 feature_gate.go:386] unrecognized feature gate: EVPN
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979105    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiVCenterDay2
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979108    5946 feature_gate.go:386] unrecognized feature gate: ClusterVersionOperatorConfiguration
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979111    5946 feature_gate.go:386] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979113    5946 feature_gate.go:386] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979116    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979118    5946 feature_gate.go:386] unrecognized feature gate: VSphereMultiNetworks
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979121    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagement
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979123    5946 feature_gate.go:386] unrecognized feature gate: SigstoreImageVerification
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979126    5946 feature_gate.go:386] unrecognized feature gate: ExternalOIDCExternalClaimsSourcing
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979129    5946 feature_gate.go:386] unrecognized feature gate: AzureDualStackInstall
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979131    5946 feature_gate.go:386] unrecognized feature gate: ConfidentialCluster
Oct 31 00:34:18.995656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979134    5946 feature_gate.go:386] unrecognized feature gate: InsightsOnDemandDataGather
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979137    5946 feature_gate.go:386] unrecognized feature gate: VSphereMixedNodeEnv
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979139    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementAWS
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979142    5946 feature_gate.go:386] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979144    5946 feature_gate.go:386] unrecognized feature gate: ClusterMonitoringConfig
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979147    5946 feature_gate.go:386] unrecognized feature gate: AWSEuropeanSovereignCloudInstall
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979151    5946 feature_gate.go:386] unrecognized feature gate: OnPremDNSRecords
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979154    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIMachineManagementPowerVS
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979156    5946 feature_gate.go:386] unrecognized feature gate: ClusterAPIInstall
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979159    5946 feature_gate.go:386] unrecognized feature gate: VolumeGroupSnapshot
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979161    5946 feature_gate.go:386] unrecognized feature gate: NewOLMOwnSingleNamespace
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979164    5946 feature_gate.go:386] unrecognized feature gate: AzureClusterHostedDNSInstall
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979168    5946 feature_gate.go:407] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979171    5946 feature_gate.go:386] unrecognized feature gate: Example
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979175    5946 feature_gate.go:386] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979178    5946 feature_gate.go:386] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979180    5946 feature_gate.go:386] unrecognized feature gate: UserNamespacesPodSecurityStandards
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979183    5946 feature_gate.go:386] unrecognized feature gate: NoRegistryClusterInstall
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979189    5946 feature_gate.go:386] unrecognized feature gate: NetworkConnect
Oct 31 00:34:18.996149 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979192    5946 feature_gate.go:386] unrecognized feature gate: AdditionalStorageConfig
Oct 31 00:34:18.996694 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979195    5946 feature_gate.go:386] unrecognized feature gate: MetricsCollectionProfiles
Oct 31 00:34:18.996694 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979197    5946 feature_gate.go:386] unrecognized feature gate: SignatureStores
Oct 31 00:34:18.996694 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979200    5946 feature_gate.go:386] unrecognized feature gate: GatewayAPIWithoutOLM
Oct 31 00:34:18.996694 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979202    5946 feature_gate.go:386] unrecognized feature gate: AWSClusterHostedDNSInstall
Oct 31 00:34:18.996694 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979205    5946 feature_gate.go:386] unrecognized feature gate: ClusterUpdatePreflight
Oct 31 00:34:18.996694 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979208    5946 feature_gate.go:386] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Oct 31 00:34:18.996694 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979210    5946 feature_gate.go:386] unrecognized feature gate: NoOverlayMode
Oct 31 00:34:18.996694 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:18.979213    5946 feature_gate.go:386] unrecognized feature gate: AzureDedicatedHosts
Oct 31 00:34:18.996694 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.979305    5946 server.go:957] "Client rotation is on, will bootstrap in background"
Oct 31 00:34:18.996694 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.980259    5946 bootstrap.go:85] "Current kubeconfig file contents are still valid, no bootstrap necessary"
Oct 31 00:34:18.996694 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.980317    5946 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-client-current.pem"
Oct 31 00:34:18.996694 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.980500    5946 server.go:1014] "Starting client certificate rotation"
Oct 31 00:34:18.996694 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.980673    5946 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Oct 31 00:34:18.996694 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.980725    5946 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-10-30 00:28:07 +0000 UTC" deadline="2028-08-16 13:25:42.910707454 +0000 UTC"
Oct 31 00:34:18.996694 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.980769    5946 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15732h51m23.929941176s"
Oct 31 00:34:18.996694 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.981013    5946 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 00:34:18.997087 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.982088    5946 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Oct 31 00:34:18.997087 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.983538    5946 log.go:25] "Validated CRI v1 runtime API"
Oct 31 00:34:18.997087 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.985391    5946 log.go:25] "Validated CRI v1 image API"
Oct 31 00:34:18.997087 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.986172    5946 server.go:1424] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Oct 31 00:34:18.997087 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.989298    5946 fs.go:135] Filesystem UUIDs: map[2b5a8051-3cdc-4ec6-8e19-ed00e6f78f54:/dev/nvme0n1p4 5ec7ac56-1aaf-4e6f-bf06-73d4edae3578:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Oct 31 00:34:18.997261 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.989357    5946 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:24 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:26 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/06d3ae65be837623b620e551c3ad9a59234c1dd8a8ea8c94b9c57b1a1e24e782/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/06d3ae65be837623b620e551c3ad9a59234c1dd8a8ea8c94b9c57b1a1e24e782/userdata/shm major:0 minor:97 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/093ca6ba9183eebb21515723150a834bacea4d33046d9f55558fc5f246af546e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/093ca6ba9183eebb21515723150a834bacea4d33046d9f55558fc5f246af546e/userdata/shm major:0 minor:80 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/16adc2d08ec3a80f2102398375c3a21ad418981115137bf5c3ec579fd6ebea43/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/16adc2d08ec3a80f2102398375c3a21ad418981115137bf5c3ec579fd6ebea43/userdata/shm major:0 minor:207 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/1f7453db944a767efe3032f2f57d99527f6ba17a122d6c8edc3e744347af5ccd/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/1f7453db944a767efe3032f2f57d99527f6ba17a122d6c8edc3e744347af5ccd/userdata/shm major:0 minor:76 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/381d2c0a559a7af6889d0a9f5bf242d3959794284d48396f7baa357acc3a9c55/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/381d2c0a559a7af6889d0a9f5bf242d3959794284d48396f7baa357acc3a9c55/userdata/shm major:0 minor:512 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/472e73657b21b4b25654d2e7484627b3b0aa2bc12bb409ff9b0e6e4af280fd29/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/472e73657b21b4b25654d2e7484627b3b0aa2bc12bb409ff9b0e6e4af280fd29/userdata/shm major:0 minor:94 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/52f7ea9a62d9c565d76e1b3cbcab6cca76bdb6a674e8caf8b014357d71978c35/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/52f7ea9a62d9c565d76e1b3cbcab6cca76bdb6a674e8caf8b014357d71978c35/userdata/shm major:0 minor:249 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/5efc17396649c3f6a5c79bb1af01b3e86783d9fbc0f8c29a82c6515b806cf997/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/5efc17396649c3f6a5c79bb1af01b3e86783d9fbc0f8c29a82c6515b806cf997/userdata/shm major:0 minor:395 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/63af29665d5fd3255d1b19fdc5cce7f204b69dcd711c61f2c7cfcf86285f771c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/63af29665d5fd3255d1b19fdc5cce7f204b69dcd711c61f2c7cfcf86285f771c/userdata/shm major:0 minor:84 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/72348916979ff0fa963b73b16187624f5ffd8cdd9b40f4feb208ea375361abbe/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/72348916979ff0fa963b73b16187624f5ffd8cdd9b40f4feb208ea375361abbe/userdata/shm major:0 minor:510 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/76b05dc3df1ffe648a33eb8fb2b102295235d3042c71f1017412960b4f09e4ff/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/76b05dc3df1ffe648a33eb8fb2b102295235d3042c71f1017412960b4f09e4ff/userdata/shm major:0 minor:209 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7c299a3043f0a079b20d78d440dc4211bdbb58955fee38c6137e812d96795504/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7c299a3043f0a079b20d78d440dc4211bdbb58955fee38c6137e812d96795504/userdata/shm major:0 minor:68 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/7c8428d86a49eace18fc7d505868127daac4d7e71324d139a86b2102da239277/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/7c8428d86a49eace18fc7d505868127daac4d7e71324d139a86b2102da239277/userdata/shm major:0 minor:296 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/82a7f8c3d05eddccebf4f83dcd2fc461c57375d2130e29c022defca00005e367/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/82a7f8c3d05eddccebf4f83dcd2fc461c57375d2130e29c022defca00005e367/userdata/shm major:0 minor:90 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/8f9aad4a22467b6b1f05aee4d3026871f1cc98a52c3f301d1c1ddb0cde549352/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/8f9aad4a22467b6b1f05aee4d3026871f1cc98a52c3f301d1c1ddb0cde549352/userdata/shm major:0 minor:51 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9a67d896966aed131375804909522399a11dd0980b09077cbb6497282a208133/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9a67d896966aed131375804909522399a11dd0980b09077cbb6497282a208133/userdata/shm major:0 minor:72 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/9d1097cb6f5c08c431b261dbc3da752f1763bee4b06a3ba5f828bfc054100e4b/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/9d1097cb6f5c08c431b261dbc3da752f1763bee4b06a3ba5f828bfc054100e4b/userdata/shm major:0 minor:292 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/a33a4ec8d8ae616c47c8b62e20445a8474a9fc60f2986e0b1a5ded0ba841b466/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/a33a4ec8d8ae616c47c8b62e20445a8474a9fc60f2986e0b1a5ded0ba841b466/userdata/shm major:0 minor:47 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/adf334f33e47c7fcc6dbacf70ec1250e8f01a728479f699821d8ffaf197845ea/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/adf334f33e47c7fcc6dbacf70ec1250e8f01a728479f699821d8ffaf197845ea/userdata/shm major:0 minor:239 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/b887ee3e2bc7e26ec6174b3ad1c9553f3d02530e41b5d4759e0ed750de2ed962/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/b887ee3e2bc7e26ec6174b3ad1c9553f3d02530e41b5d4759e0ed750de2ed962/userdata/shm major:0 minor:205 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c54eb23e869163f2d6c2849805e4f4f97ac0bd3ca3408f20c729e1bea6c1d1f8/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c54eb23e869163f2d6c2849805e4f4f97ac0bd3ca3408f20c729e1bea6c1d1f8/userdata/shm major:0 minor:336 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/c8f693e8fea1e5d57d49dbb75d40f50d1bd08291aab6528c24cb4b7efd042a8c/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/c8f693e8fea1e5d57d49dbb75d40f50d1bd08291aab6528c24cb4b7efd042a8c/userdata/shm major:0 minor:459 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/d9800bfe7079bdd9eae6f80ac2ebe511c7947bd094f1433f31d50b96cc60272e/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/d9800bfe7079bdd9eae6f80ac2ebe511c7947bd094f1433f31d50b96cc60272e/userdata/shm major:0 minor:340 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/e8daca4e69149b72de51e98abf18f62b4779832fe5107b7cdcf20917da9f2ddc/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/e8daca4e69149b72de51e98abf18f62b4779832fe5107b7cdcf20917da9f2ddc/userdata/shm major:0 minor:290 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f830a534e525123941c29f57ef11e0e53ff99698f95c469947360348d1ef731f/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f830a534e525123941c29f57ef11e0e53ff99698f95c469947360348d1ef731f/userdata/shm major:0 minor:504 fsType:tmpfs blockSize:0} /run/containers/storage/overlay-containers/f910692db9b6381b02717abc4eff2dfc740a1e9be1b1489b3bd3aa8f1645b9a6/userdata/shm:{mountpoint:/run/containers/storage/overlay-containers/f910692db9b6381b02717abc4eff2dfc740a1e9be1b1489b3bd3aa8f1645b9a6/userdata/shm major:0 minor:310 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:32 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0420aed9-f163-474d-a19f-2db0bfdb32e6/volumes/kubernetes.io~projected/kube-api-access-qmwt7:{mountpoint:/var/lib/kubelet/pods/0420aed9-f163-474d-a19f-2db0bfdb32e6/volumes/kubernetes.io~projected/kube-api-access-qmwt7 major:0 minor:63 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0883a925-b7f8-44b8-a889-4d3cc5af9fe8/volumes/kubernetes.io~projected/kube-api-access-m5sj7:{mountpoint:/var/lib/kubelet/pods/0883a925-b7f8-44b8-a889-4d3cc5af9fe8/volumes/kubernetes.io~projected/kube-api-access-m5sj7 major:0 minor:58 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0883a925-b7f8-44b8-a889-4d3cc5af9fe8/volumes/kubernetes.io~secret/metrics-certs:{mountpoint:/var/lib/kubelet/pods/0883a925-b7f8-44b8-a889-4d3cc5af9fe8/volumes/kubernetes.io~secret/metrics-certs major:0 minor:500 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/0b7e45fa-6f09-4d02-bc42-e89d46d954b6/volumes/kubernetes.io~projected/kube-api-access-5m5kc:{mountpoint:/var/lib/kubelet/pods/0b7e45fa-6f09-4d02-bc42-e89d46d954b6/volumes/kubernetes.io~projected/kube-api-access-5m5kc major:0 minor:65 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1e2c6645-71a9-4a48-883d-22c96ab5ab1b/volumes/kubernetes.io~projected/kube-api-access-8sv6t:{mountpoint:/var/lib/kubelet/pods/1e2c6645-71a9-4a48-883d-22c96ab5ab1b/volumes/kubernetes.io~projected/kube-api-access-8sv6t major:0 minor:300 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1e2c6645-71a9-4a48-883d-22c96ab5ab1b/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/1e2c6645-71a9-4a48-883d-22c96ab5ab1b/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:299 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1e2c6645-71a9-4a48-883d-22c96ab5ab1b/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/1e2c6645-71a9-4a48-883d-22c96ab5ab1b/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:298 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volume-subpaths/web-config/config-reloader/2:{mountpoint:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volume-subpaths/web-config/config-reloader/2 major:0 minor:442 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volume-subpaths/web-config/init-config-reloader/2:{mountpoint:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volume-subpaths/web-config/init-config-reloader/2 major:0 minor:442 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volume-subpaths/web-config/prometheus/15:{mountpoint:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volume-subpaths/web-config/prometheus/15 major:0 minor:442 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~empty-dir/config-out major:0 minor:448 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~projected/kube-api-access-qbwmm:{mountpoint:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~projected/kube-api-access-qbwmm major:0 minor:454 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~projected/tls-assets major:0 minor:455 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/config:{mountpoint:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/config major:0 minor:456 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:449 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/secret-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/secret-kube-rbac-proxy major:0 minor:453 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/secret-metrics-client-certs:{mountpoint:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/secret-metrics-client-certs major:0 minor:450 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web major:0 minor:451 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls:{mountpoint:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls major:0 minor:452 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls:{mountpoint:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls major:0 minor:446 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file:{mountpoint:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file major:0 minor:447 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/web-config major:0 minor:442 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/26ab7116-31a7-404c-8a01-6502edf9f5ce/volumes/kubernetes.io~projected/kube-api-access-f68jv:{mountpoint:/var/lib/kubelet/pods/26ab7116-31a7-404c-8a01-6502edf9f5ce/volumes/kubernetes.io~projected/kube-api-access-f68jv major:0 minor:507 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34b2bd3f-0955-482d-bf8e-0ec7de5a226a/volumes/kubernetes.io~empty-dir/etc-tuned:{mountpoint:/var/lib/kubelet/pods/34b2bd3f-0955-482d-bf8e-0ec7de5a226a/volumes/kubernetes.io~empty-dir/etc-tuned major:0 minor:61 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34b2bd3f-0955-482d-bf8e-0ec7de5a226a/volumes/kubernetes.io~empty-dir/tmp:{mountpoint:/var/lib/kubelet/pods/34b2bd3f-0955-482d-bf8e-0ec7de5a226a/volumes/kubernetes.io~empty-dir/tmp major:0 minor:60 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/34b2bd3f-0955-482d-bf8e-0ec7de5a226a/volumes/kubernetes.io~projected/kube-api-access-thmlk:{mountpoint:/var/lib/kubelet/pods/34b2bd3f-0955-482d-bf8e-0ec7de5a226a/volumes/kubernetes.io~projected/kube-api-access-thmlk major:0 minor:66 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/45efeeda-0c9c-461c-bb19-c43de5b9566a/volumes/kubernetes.io~projected/kube-api-access-llfdt:{mountpoint:/var/lib/kubelet/pods/45efeeda-0c9c-461c-bb19-c43de5b9566a/volumes/kubernetes.io~projected/kube-api-access-llfdt major:0 minor:64 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/506537b2-c447-4523-95f5-a53bdc768c84/volumes/kubernetes.io~projected/kube-api-access-zlq92:{mountpoint:/var/lib/kubelet/pods/506537b2-c447-4523-95f5-a53bdc768c84/volumes/kubernetes.io~projected/kube-api-access-zlq92 major:0 minor:288 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/506537b2-c447-4523-95f5-a53bdc768c84/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/506537b2-c447-4523-95f5-a53bdc768c84/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config major:0 minor:284 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/506537b2-c447-4523-95f5-a53bdc768c84/volumes/kubernetes.io~secret/node-exporter-tls:{mountpoint:/var/lib/kubelet/pods/506537b2-c447-4523-95f5-a53bdc768c84/volumes/kubernetes.io~secret/node-exporter-tls major:0 minor:286 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/610ed88a-261c-4503-b776-4a0c20b6cb07/volumes/kubernetes.io~projected/kube-api-access-crwrm:{mountpoint:/var/lib/kubelet/pods/610ed88a-261c-4503-b776-4a0c20b6cb07/volumes/kubernetes.io~projected/kube-api-access-crwrm major:0 minor:232 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/610ed88a-261c-4503-b776-4a0c20b6cb07/volumes/kubernetes.io~secret/console-oauth-config:{mountpoint:/var/lib/kubelet/pods/610ed88a-261c-4503-b776-4a0c20b6cb07/volumes/kubernetes.io~secret/console-oauth-config major:0 minor:230 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/610ed88a-261c-4503-b776-4a0c20b6cb07/volumes/kubernetes.io~secret/console-serving-cert:{mountpoint:/var/lib/kubelet/pods/610ed88a-261c-4503-b776-4a0c20b6cb07/volumes/kubernetes.io~secret/console-serving-cert major:0 minor:231 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volume-subpaths/cluster-tls-config/alertmanager/10:{mountpoint:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volume-subpaths/cluster-tls-config/alertmanager/10 major:0 minor:327 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volume-subpaths/web-config/alertmanager/9:{mountpoint:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volume-subpaths/web-config/alertmanager/9 major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volume-subpaths/web-config/config-reloader/6:{mountpoint:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volume-subpaths/web-config/config-reloader/6 major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volume-subpaths/web-config/init-config-reloader/6:{mountpoint:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volume-subpaths/web-config/init-config-reloader/6 major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~empty-dir/config-out:{mountpoint:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~empty-dir/config-out major:0 minor:329 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~projected/kube-api-access-kz46w:{mountpoint:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~projected/kube-api-access-kz46w major:0 minor:335 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~projected/tls-assets:{mountpoint:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~projected/tls-assets major:0 minor:331 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/cluster-tls-config:{mountpoint:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/cluster-tls-config major:0 minor:327 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/config-volume:{mountpoint:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/config-volume major:0 minor:328 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy major:0 minor:322 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric:{mountpoint:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric major:0 minor:334 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web major:0 minor:332 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/secret-alertmanager-main-tls:{mountpoint:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/secret-alertmanager-main-tls major:0 minor:330 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/web-config:{mountpoint:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/web-config major:0 minor:333 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/66f8ebac-f187-49d1-acf8-ec86c904c475/volumes/kubernetes.io~projected/kube-api-access-w4spf:{mountpoint:/var/lib/kubelet/pods/66f8ebac-f187-49d1-acf8-ec86c904c475/volumes/kubernetes.io~projected/kube-api-access-w4spf major:0 minor:57 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6af6f8e7-3e6c-4e48-9944-fa06042a5e57/volumes/kubernetes.io~projected/kube-api-access-ghc8q:{mountpoint:/var/lib/kubelet/pods/6af6f8e7-3e6c-4e48-9944-fa06042a5e57/volumes/kubernetes.io~projected/kube-api-access-ghc8q major:0 minor:289 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6af6f8e7-3e6c-4e48-9944-fa06042a5e57/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/6af6f8e7-3e6c-4e48-9944-fa06042a5e57/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config major:0 minor:285 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6af6f8e7-3e6c-4e48-9944-fa06042a5e57/volumes/kubernetes.io~secret/kube-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/6af6f8e7-3e6c-4e48-9944-fa06042a5e57/volumes/kubernetes.io~secret/kube-state-metrics-tls major:0 minor:282 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/6bd3d849-76a8-410d-8aa1-400e57cbaded/volumes/kubernetes.io~projected/kube-api-access-psclh:{mountpoint:/var/lib/kubelet/pods/6bd3d849-76a8-410d-8aa1-400e57cbaded/volumes/kubernetes.io~projected/kube-api-access-psclh major:0 minor:62 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb/volumes/kubernetes.io~projected/kube-api-access-gw7nf:{mountpoint:/var/lib/kubelet/pods/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb/volumes/kubernetes.io~projected/kube-api-access-gw7nf major:0 minor:204 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb/volumes/kubernetes.io~secret/metrics-tls:{mountpoint:/var/lib/kubelet/pods/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb/volumes/kubernetes.io~secret/metrics-tls major:0 minor:197 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01/volumes/kubernetes.io~secret/agent-certs:{mountpoint:/var/lib/kubelet/pods/7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01/volumes/kubernetes.io~secret/agent-certs major:0 minor:55 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~projected/kube-api-access-j2mh5:{mountpoint:/var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~projected/kube-api-access-j2mh5 major:0 minor:351 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~secret/secret-grpc-tls:{mountpoint:/var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~secret/secret-grpc-tls major:0 minor:346 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy:{mountpoint:/var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy major:0 minor:348 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics:{mountpoint:/var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics major:0 minor:342 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules:{mountpoint:/var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules major:0 minor:350 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web:{mountpoint:/var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web major:0 minor:349 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~secret/secret-thanos-querier-tls:{mountpoint:/var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~secret/secret-thanos-querier-tls major:0 minor:347 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/8f7af1c9-c623-41f4-8923-ea931d7c08ab/volumes/kubernetes.io~projected/kube-api-access-ww699:{mountpoint:/var/lib/kubelet/pods/8f7af1c9-c623-41f4-8923-ea931d7c08ab/volumes/kubernetes.io~projected/kube-api-access-ww699 major:0 minor:67 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/90fdba20-20ae-405d-bd58-0756cc1fdcad/volumes/kubernetes.io~secret/original-pull-secret:{mountpoint:/var/lib/kubelet/pods/90fdba20-20ae-405d-bd58-0756cc1fdcad/volumes/kubernetes.io~secret/original-pull-secret major:0 minor:506 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c55ac10a-0189-4764-b828-098f9ea03f75/volumes/kubernetes.io~projected/kube-api-access-wfw9h:{mountpoint:/var/lib/kubelet/pods/c55ac10a-0189-4764-b828-098f9ea03f75/volumes/kubernetes.io~projected/kube-api-access-wfw9h major:0 minor:203 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c55ac10a-0189-4764-b828-098f9ea03f75/volumes/kubernetes.io~secret/insights-runtime-extractor-tls:{mountpoint:/var/lib/kubelet/pods/c55ac10a-0189-4764-b828-098f9ea03f75/volumes/kubernetes.io~secret/insights-runtime-extractor-tls major:0 minor:45 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c68937ea-3c3b-46d1-9646-a9fa24c89cde/volumes/kubernetes.io~projected/kube-api-access-ctxjg:{mountpoint:/var/lib/kubelet/pods/c68937ea-3c3b-46d1-9646-a9fa24c89cde/volumes/kubernetes.io~projected/kube-api-access-ctxjg major:0 minor:397 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c68937ea-3c3b-46d1-9646-a9fa24c89cde/volumes/kubernetes.io~secret/monitoring-plugin-cert:{mountpoint:/var/lib/kubelet/pods/c68937ea-3c3b-46d1-9646-a9fa24c89cde/volumes/kubernetes.io~secret/monitoring-plugin-cert major:0 minor:396 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c9248850-deda-4b75-b652-9f26255812f8/volumes/kubernetes.io~projected/kube-api-access-hd475:{mountpoint:/var/lib/kubelet/pods/c9248850-deda-4b75-b652-9f26255812f8/volumes/kubernetes.io~projected/kube-api-access-hd475 major:0 minor:202 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/c9248850-deda-4b75-b652-9f26255812f8/volumes/kubernetes.io~secret/cert:{mountpoint:/var/lib/kubelet/pods/c9248850-deda-4b75-b652-9f26255812f8/volumes/kubernetes.io~secret/cert major:0 minor:201 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4/volumes/kubernetes.io~projected/kube-api-access-v9gng:{mountpoint:/var/lib/kubelet/pods/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4/volumes/kubernetes.io~projected/kube-api-access-v9gng major:0 minor:248 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config major:0 minor:247 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4/volumes/kubernetes.io~secret/prometheus-operator-tls:{mountpoint:/var/lib/kubelet/pods/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4/volumes/kubernetes.io~secret/prometheus-operator-tls major:0 minor:246 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1748202-4b8b-4c5d-891e-5f68728124ea/volume-subpaths/run-systemd/ovnkube-controller/6:{mountpoint:/var/lib/kubelet/pods/e1748202-4b8b-4c5d-891e-5f68728124ea/volume-subpaths/run-systemd/ovnkube-controller/6 major:0 minor:26 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1748202-4b8b-4c5d-891e-5f68728124ea/volumes/kubernetes.io~projected/kube-api-access-k422l:{mountpoint:/var/lib/kubelet/pods/e1748202-4b8b-4c5d-891e-5f68728124ea/volumes/kubernetes.io~projected/kube-api-access-k422l major:0 minor:59 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e1748202-4b8b-4c5d-891e-5f68728124ea/volumes/kubernetes.io~secret/ovn-node-metrics-cert:{mountpoint:/var/lib/kubelet/pods/e1748202-4b8b-4c5d-891e-5f68728124ea/volumes/kubernetes.io~secret/ovn-node-metrics-cert major:0 minor:56 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e4798203-046e-4ad4-842d-a211d905cd74/volumes/kubernetes.io~projected/kube-api-access-wlwjc:{mountpoint:/var/lib/kubelet/pods/e4798203-046e-4ad4-842d-a211d905cd74/volumes/kubernetes.io~projected/kube-api-access-wlwjc major:0 minor:287 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e4798203-046e-4ad4-842d-a211d905cd74/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config:{mountpoint:/var/lib/kubelet/pods/e4798203-046e-4ad4-842d-a211d905cd74/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config major:0 minor:277 fsType:tmpfs blockSize:0} /var/lib/kubelet/pods/e4798203-046e-4ad4-842d-a211d905cd74/volumes/kubernetes.io~secret/openshift-state-metrics-tls:{mountpoint:/var/lib/kubelet/pods/e4798203-046e-4ad4-842d-a211d905cd74/volumes/kubernetes.io~secret/openshift-state-metrics-tls major:0 minor:283 fsType:tmpfs blockSize:0} composefs_0-34:{mountpoint:/ major:0 minor:34 fsType:overlay blockSize:0} overlay_0-100:{mountpoint:/var/lib/containers/storage/overlay/2f6698b30bd67bed1fc5792b82f6f8110bf6044f6ccbb4c4bcf7468ebe8e6723/merged major:0 minor:100 fsType:overlay blockSize:0} overlay_0-102:{mountpoint:/var/lib/containers/storage/overlay/54c6908a8507595d938d27794287e4b093ad20156ac18ced0da8ba71ba98db08/merged major:0 minor:102 fsType:overlay blockSize:0} overlay_0-104:{mountpoint:/var/lib/containers/storage/overlay/3f38f42d9900c1c83a00cdc191ea0edc27d5c7b06eaf663a0733ca064eae075f/merged major:0 minor:104 fsType:overlay blockSize:0} overlay_0-106:{mountpoint:/var/lib/containers/storage/overlay/58b13bb0c73e7e1a1d1dc43935797d350001a078dcc4c0b1d321c6d8a92e5a84/merged major:0 minor:106 fsType:overlay blockSize:0} overlay_0-111:{mountpoint:/var/lib/containers/storage/overlay/ac1f93eee47a99b9371692f49d88e0e245153452b581bbc978baacb188441662/merged major:0 minor:111 fsType:overlay blockSize:0} overlay_0-119:{mountpoint:/var/lib/containers/storage/overlay/2f716cbbefc0e8347c60f6f454c4b47e94e69830352bea5d9efb01cbb5c9d847/merged major:0 minor:119 fsType:overlay blockSize:0} overlay_0-124:{mountpoint:/var/lib/containers/storage/overlay/caeb83768be8e0ff245a3c662dba3e514a887160f66361c6d67240a53807886c/merged major:0 minor:124 fsType:overlay blockSize:0} overlay_0-127:{mountpoint:/var/lib/containers/storage/overlay/4128ccaede27d5fd3fb46c177627544ed7a510094c6aafa4409b6f9f5af2463c/merged major:0 minor:127 fsType:overlay blockSize:0} overlay_0-132:{mountpoint:/var/lib/containers/storage/overlay/e217d58ae0ede0f1332b83f966282019febaf876ebdf298674b4dae55322fa36/merged major:0 minor:132 fsType:overlay blockSize:0} overlay_0-134:{mountpoint:/var/lib/containers/storage/overlay/3b9886d5b81cb3854ce7a4b6706d0a289d7c0d2923d2a85d965b4408d852634e/merged major:0 minor:134 fsType:overlay blockSize:0} overlay_0-139:{mountpoint:/var/lib/containers/storage/overlay/e55fa8205242ca90e12b621e9f272d06be5f9db2c3ea688b5a9ed0d14d384f2e/merged major:0 minor:139 fsType:overlay blockSize:0} overlay_0-140:{mountpoint:/var/lib/containers/storage/overlay/17bc97d4a50f531da7d184f6698df3375952132ef7fc87a873288c26da7992e5/merged major:0 minor:140 fsType:overlay blockSize:0} overlay_0-152:{mountpoint:/var/lib/containers/storage/overlay/c3e1e96e552ea1be3941b3c884bc841e17b9a5f4816072f893c4f81f847baebd/merged major:0 minor:152 fsType:overlay blockSize:0} overlay_0-157:{mountpoint:/var/lib/containers/storage/overlay/4035e8bbc1cbff31a73180a2faf2cd720e10a1d96adb5c899b1dff53ba4738b6/merged major:0 minor:157 fsType:overlay blockSize:0} overlay_0-162:{mountpoint:/var/lib/containers/storage/overlay/d9c90bfdd769be6de94d2f7d39e91978fa27356906867d2e060f931d2146e9c0/merged major:0 minor:162 fsType:overlay blockSize:0} overlay_0-166:{mountpoint:/var/lib/containers/storage/overlay/b133a1186a40037d4150f022255ff4d341f405170001e9d1a172ad726d25b2e9/merged major:0 minor:166 fsType:overlay blockSize:0} overlay_0-169:{mountpoint:/var/lib/containers/storage/overlay/c7a13fc42c429974a34664eaf42ca89a483d8c331c302194ee65bd25c138ead0/merged major:0 minor:169 fsType:overlay blockSize:0} overlay_0-177:{mountpoint:/var/lib/containers/storage/overlay/bda4ca66b2ccff36cc2ac214c82b10d8c006f8cef1d03b2e4393b41132cae4b8/merged major:0 minor:177 fsType:overlay blockSize:0} overlay_0-182:{mountpoint:/var/lib/containers/storage/overlay/006051ab1d48bbfdf7c3ce3f6deb0d86fc68e19910be1869d50a03d66232d3ec/merged major:0 minor:182 fsType:overlay blockSize:0} overlay_0-187:{mountpoint:/var/lib/containers/storage/overlay/51089d65241ff00b2ef7523188f8d1eb02ec3c802e421ee5b4440d9d97edfc7a/merged major:0 minor:187 fsType:overlay blockSize:0} overlay_0-192:{mountpoint:/var/lib/containers/storage/overlay/bf724f9af62ae2120b0e28c03f5350d0c1013d6b4425badad8dbabbf73d18564/merged major:0 minor:192 fsType:overlay blockSize:0} overlay_0-211:{mountpoint:/var/lib/containers/storage/overlay/04797d9e4a0eb193397af739342fcab0517879aebc12c9cf0be9a752ecb18f38/merged major:0 minor:211 fsType:overlay blockSize:0} overlay_0-213:{mountpoint:/var/lib/containers/storage/overlay/1f21a7a530cc891aca17404e8f793bf968a521b4d74862235c7260a034951186/merged major:0 minor:213 fsType:overlay blockSize:0} overlay_0-215:{mountpoint:/var/lib/containers/storage/overlay/693691f74784ccec52064429cccc5e43934dc40719c1fe989c2ce4a3350be3af/merged major:0 minor:215 fsType:overlay blockSize:0} overlay_0-217:{mountpoint:/var/lib/containers/storage/overlay/8f375b94569767989a7acd51a57d3ab1338d21240a2848fc24d34eb6e424bf50/merged major:0 minor:217 fsType:overlay blockSize:0} overlay_0-219:{mountpoint:/var/lib/containers/storage/overlay/3f2ed20d19258f532084ff16eaf7c420630e7621339c5b66340ba7f1dd604956/merged major:0 minor:219 fsType:overlay blockSize:0} overlay_0-225:{mountpoint:/var/lib/containers/storage/overlay/de8c7acd7bb1105c37e2993fca2b7b269db7a7b8356bcca3b07238c2373333a3/merged major:0 minor:225 fsType:overlay blockSize:0} overlay_0-233:{mountpoint:/var/lib/containers/storage/overlay/c8a1bdd152eff3531d45b57fecfbed850c9cf16ca4ab12a0b5d1de9729c33ca9/merged major:0 minor:233 fsType:overlay blockSize:0} overlay_0-241:{mountpoint:/var/lib/containers/storage/overlay/fc179432db654a4e5189289beba4bb20a0e365b4913969bec03d8c0be4bafccf/merged major:0 minor:241 fsType:overlay blockSize:0} overlay_0-251:{mountpoint:/var/lib/containers/storage/overlay/dc68799ab7402aae0ddf78ce000dbeeb29a50652602b5f6af0643ddaf5cb3329/merged major:0 minor:251 fsType:overlay blockSize:0} overlay_0-253:{mountpoint:/var/lib/containers/storage/overlay/84ea0668f3403baec1e0afc009edba82bf4680c23443b63e03143a7c1014106a/merged major:0 minor:253 fsType:overlay blockSize:0} overlay_0-255:{mountpoint:/var/lib/containers/storage/overlay/e9e28518d29c7a5c863ea00d23b0a68d2def43ca47078c15ca345f923f815d88/merged major:0 minor:255 fsType:overlay blockSize:0} overlay_0-261:{mountpoint:/var/lib/containers/storage/overlay/016dc5f0981f649debd57925e8199c00c43bbc30e8acc0a57ec745d4218e5dc6/merged major:0 minor:261 fsType:overlay blockSize:0} overlay_0-266:{mountpoint:/var/lib/containers/storage/overlay/0e217f57f04a8bfc871b107d5fc9964e5bd3ed118a1571015610c8834872f3ef/merged major:0 minor:266 fsType:overlay blockSize:0} overlay_0-272:{mountpoint:/var/lib/containers/storage/overlay/d3e6ecceb56c335abd7cdf743913412735aa353e7bb13873e18195c9ced08255/merged major:0 minor:272 fsType:overlay blockSize:0} overlay_0-294:{mountpoint:/var/lib/containers/storage/overlay/fd4ec57456abe9bada4be8f591c670395eb1a1c069ed9d8e15e43d68ed93bc60/merged major:0 minor:294 fsType:overlay blockSize:0} overlay_0-301:{mountpoint:/var/lib/containers/storage/overlay/db1cefac5ed86d6f9d8fffcc74f48f09fcb6aff457d3f1893782aa255d8a4ca4/merged major:0 minor:301 fsType:overlay blockSize:0} overlay_0-303:{mountpoint:/var/lib/containers/storage/overlay/c6893f3abafe8d2a527730625b7a523b8b31f03558498178167e3680d4beffd2/merged major:0 minor:303 fsType:overlay blockSize:0} overlay_0-305:{mountpoint:/var/lib/containers/storage/overlay/e9c41f8f5a2030d3427d2e115b188d7d14478b43e333feb140003f52d23194db/merged major:0 minor:305 fsType:overlay blockSize:0} overlay_0-313:{mountpoint:/var/lib/containers/storage/overlay/717a8816f11d3118e86c881e236963883d93f4f4ef6e8ebcf734c14f59bbfd43/merged major:0 minor:313 fsType:overlay blockSize:0} overlay_0-315:{mountpoint:/var/lib/containers/storage/overlay/5e1edb031d1e4f39483c1891258f34278624c5baa1bd99bfa4258b346b9f6bb5/merged major:0 minor:315 fsType:overlay blockSize:0} overlay_0-320:{mountpoint:/var/lib/containers/storage/overlay/383e33d2b02741d404d5f151800887a7e8623e74212e3035bedcd904508bfbd0/merged major:0 minor:320 fsType:overlay blockSize:0} overlay_0-338:{mountpoint:/var/lib/containers/storage/overlay/0a34e70403c5fba2fc0d37d7633b2f57793b11b4af8e6297d43d4afcc8024070/merged major:0 minor:338 fsType:overlay blockSize:0} overlay_0-352:{mountpoint:/var/lib/containers/storage/overlay/407f65c1a47ab2753ce9746ef92e6acf94f4a4af99e4102a0dae5794a384cc14/merged major:0 minor:352 fsType:overlay blockSize:0} overlay_0-354:{mountpoint:/var/lib/containers/storage/overlay/0d44b4bac2ec43e0e12295cf40ccae74696defbdeeb2f01fb8f4711b09659705/merged major:0 minor:354 fsType:overlay blockSize:0} overlay_0-356:{mountpoint:/var/lib/containers/storage/overlay/1fe1b0464fc022875778d3ed4b28ce485df31c9c71e2713258501faccac9c61e/merged major:0 minor:356 fsType:overlay blockSize:0} overlay_0-362:{mountpoint:/var/lib/containers/storage/overlay/7774462f3227bbf6a6a94255ae3b0b0f6fafe9b1427a2c9db6d2b21050f92037/merged major:0 minor:362 fsType:overlay blockSize:0} overlay_0-363:{mountpoint:/var/lib/containers/storage/overlay/7ae89d025ae0d4f3caa34a7c1438f43942cc54d986e643057121e177f7712acc/merged major:0 minor:363 fsType:overlay blockSize:0} overlay_0-369:{mountpoint:/var/lib/containers/storage/overlay/b2677849f29f598328345c682de38362705a5182cdca5af6ab65e9bef948f84c/merged major:0 minor:369 fsType:overlay blockSize:0} overlay_0-374:{mountpoint:/var/lib/containers/storage/overlay/ba6a3be0653868fec18ba5f21b480754fe553de5017d9080ff16377a3825d734/merged major:0 minor:374 fsType:overlay blockSize:0} overlay_0-379:{mountpoint:/var/lib/containers/storage/overlay/6a18545ddfd336a5bbaaab708b786516e98fd0ddb7a82c11a929e0a898d77a1f/merged major:0 minor:379 fsType:overlay blockSize:0} overlay_0-384:{mountpoint:/var/lib/containers/storage/overlay/d6dd16f1c482e6ae704f1f8e44594b6f4df4e6b343891d7e122e0204e0d82d9d/merged major:0 minor:384 fsType:overlay blockSize:0} overlay_0-390:{mountpoint:/var/lib/containers/storage/overlay/cd9cbe19e0880b777480b8126ff5490283e3857e8617ea03bc71a6dffe9c0aca/merged major:0 minor:390 fsType:overlay blockSize:0} overlay_0-402:{mountpoint:/var/lib/containers/storage/overlay/4b1be001142dc4f0718f7ed7a35a8e4fbf552df85743bfa3c1ca5cdf609fbf85/merged major:0 minor:402 fsType:overlay blockSize:0} overlay_0-404:{mountpoint:/var/lib/containers/storage/overlay/b4db384042f753b236e89c0c6b79b2f74b9eab0b3730ab10761f541e97538295/merged major:0 minor:404 fsType:overlay blockSize:0} overlay_0-406:{mountpoint:/var/lib/containers/storage/overlay/fbd9bab883aab5061850965d6f3f41d7905f343cd5bee8055e4a46e3f23d48be/merged major:0 minor:406 fsType:overlay blockSize:0} overlay_0-412:{mountpoint:/var/lib/containers/storage/overlay/5092e70b25dfcbc72af2389ca909b45522f1990e693c5ec45d886c7644ef8c00/merged major:0 minor:412 fsType:overlay blockSize:0} overlay_0-417:{mountpoint:/var/lib/containers/storage/overlay/a89e502b41464cca63bb9cadf5ac151b6ac1a4d90ddce5295e81de8eb2e0b5ae/merged major:0 minor:417 fsType:overlay blockSize:0} overlay_0-422:{mountpoint:/var/lib/containers/storage/overlay/0ea8c0d775db215a7f0e1894c5137384ae6efdfc0fa8ec70a33c0479e0d1f4ec/merged major:0 minor:422 fsType:overlay blockSize:0} overlay_0-427:{mountpoint:/var/lib/containers/storage/overlay/beb717ca20e8b5abea3dee5794e881512e46c60f6fd2728ef7a54d810c1a4b5c/merged major:0 minor:427 fsType:overlay blockSize:0} overlay_0-432:{mountpoint:/var/lib/containers/storage/overlay/f16f0c3897591175d7612f6f0b512dde9d49aea7f203ffcd763a5d2312fc2a4a/merged major:0 minor:432 fsType:overlay blockSize:0} overlay_0-437:{mountpoint:/var/lib/containers/storage/overlay/9551031a02a29c5120fba2d41f641714320e6c4898afe4b6b9f045e38125b93b/merged major:0 minor:437 fsType:overlay blockSize:0} overlay_0-457:{mountpoint:/var/lib/containers/storage/overlay/add9e93c69ebabe745201a45843b8e42c7147ff5f706f5b0d541df8094d9cccb/merged major:0 minor:457 fsType:overlay blockSize:0} overlay_0-464:{mountpoint:/var/lib/containers/storage/overlay/89a52dae7fe9044c8603e96103f38461cf55979944bf2cf19f9406b517c4a84f/merged major:0 minor:464 fsType:overlay blockSize:0} overlay_0-466:{mountpoint:/var/lib/containers/storage/overlay/30b53932a3de99eff19f9d1d81b5afd4d38d674d780681bdfce258965ac60d4e/merged major:0 minor:466 fsType:overlay blockSize:0} overlay_0-468:{mountpoint:/var/lib/containers/storage/overlay/968d304d33dd583c422ed53b1190a3f36bebb359931400a7fbdcdce257ed17f1/merged major:0 minor:468 fsType:overlay blockSize:0} overlay_0-474:{mountpoint:/var/lib/containers/storage/overlay/0b85c1a295102b4b82e1e79aa9bb261779a6bbb1e30faa15b4148b0698b5344d/merged major:0 minor:474 fsType:overlay blockSize:0} overlay_0-480:{mountpoint:/var/lib/containers/storage/overlay/27995bf4676216ef4462edcd3d1a311b1c9ba8444eb646fc2a6e57a61babcfe6/merged major:0 minor:480 fsType:overlay blockSize:0} overlay_0-485:{mountpoint:/var/lib/containers/storage/overlay/117d181b98fb5836102adb1d359ca49a27f59c27615cc21fd59cd9c52762d4a7/merged major:0 minor:485 fsType:overlay blockSize:0} overlay_0-49:{mountpoint:/var/lib/containers/storage/overlay/5861595de02d32945cf0a73ead9114881723fa63ef06b001bc4dcc6e3bbf9410/merged major:0 minor:49 fsType:overlay blockSize:0} overlay_0-490:{mountpoint:/var/lib/containers/storage/overlay/04230fc78eea2d440a452309f977ce971b12dce510511987129d7ae6b665813f/merged major:0 minor:490 fsType:overlay blockSize:0} overlay_0-495:{mountpoint:/var/lib/containers/storage/overlay/831c8a267474de149a76495cd48f2691fad73226376a14c4ff65cf4c62c8e169/merged major:0 minor:495 fsType:overlay blockSize:0} overlay_0-508:{mountpoint:/var/lib/containers/storage/overlay/9fb2502e8083f1689f294a5a73911eff683a6d5212ab614a2b1c7d6090375cd6/merged major:0 minor:508 fsType:overlay blockSize:0} overlay_0-514:{mountpoint:/var/lib/containers/storage/overlay/a5ad26ec2b8f697b5d8febe218a1897c7c439187c1f10e5e9309d1ed5ce903c3/merged major:0 minor:514 fsType:overlay blockSize:0} overlay_0-516:{mountpoint:/var/lib/containers/storage/overlay/d5afdb5b2a99e5a1e6bec00921049c71d769d6b7e99ccb04f391a61704a2c5cd/merged major:0 minor:516 fsType:overlay blockSize:0} overlay_0-518:{mountpoint:/var/lib/containers/storage/overlay/1b810ecf0f12de8a4196ade16a79eaa67d66caf37a7d47079352032f8b7e9f55/merged major:0 minor:518 fsType:overlay blockSize:0} overlay_0-520:{mountpoint:/var/lib/containers/storage/overlay/4f30b321eee58fe64491acf2c6f5b180760b9f44d0d9926f95c7bdc4e7a2b03e/merged major:0 minor:520 fsType:overlay blockSize:0} overlay_0-526:{mountpoint:/var/lib/containers/storage/overlay/f8a6763ddf048c23f004ecb2f8ae2195a31db1ce4b5102dbc010d75d12841faa/merged major:0 minor:526 fsType:overlay blockSize:0} overlay_0-53:{mountpoint:/var/lib/containers/storage/overlay/87b1fc04ad9040f283f40daa4d296e2e6df3103b27982f1ee67e934448daeced/merged major:0 minor:53 fsType:overlay blockSize:0} overlay_0-531:{mountpoint:/var/lib/containers/storage/overlay/1adb27ad9b5ee6a281f264e98cc4a05927c547cb781db7485b8d8b5ad7d1e43e/merged major:0 minor:531 fsType:overlay blockSize:0} overlay_0-70:{mountpoint:/var/lib/containers/storage/overlay/5f4ff2106eb9c79019a03a12d30518a86a1805c388c57c9d1f4f712115255fb9/merged major:0 minor:70 fsType:overlay blockSize:0} overlay_0-74:{mountpoint:/var/lib/containers/storage/overlay/bb96d2c7a336df957d76c4df7d1e43757909b2587af4114eb9f0efab525c0abc/merged major:0 minor:74 fsType:overlay blockSize:0} overlay_0-78:{mountpoint:/var/lib/containers/storage/overlay/30ac5f07f0bceafddb50c3295bc849d1c20868c4d4d71ff6708b5f09089f69d9/merged major:0 minor:78 fsType:overlay blockSize:0} overlay_0-82:{mountpoint:/var/lib/containers/storage/overlay/e5491e369b9f502fb43255896a93712101c23630ae6a5cfb0fc134fc51615f2e/merged major:0 minor:82 fsType:overlay blockSize:0} overlay_0-86:{mountpoint:/var/lib/containers/storage/overlay/8e8460bbe5d0013b12422057a99cd8258415261c296eaf42e40ce1d938a4a4b1/merged major:0 minor:86 fsType:overlay blockSize:0} overlay_0-88:{mountpoint:/var/lib/containers/storage/overlay/47b7f09be39fc43472eb5b3c5e46bd23dc6f91d3c2cf1fc1a422694bd581fc42/merged major:0 minor:88 fsType:overlay blockSize:0} overlay_0-92:{mountpoint:/var/lib/containers/storage/overlay/7e60d88f6775cb3c823aa64abf20d10e26f1a51fd7c391891af799c3ce166e78/merged major:0 minor:92 fsType:overlay blockSize:0} overlay_0-96:{mountpoint:/var/lib/containers/storage/overlay/6edbefaece806a0ccd7aa28fd38e8392bcb18ef4cf5df1520f09bc686a680fd9/merged major:0 minor:96 fsType:overlay blockSize:0}]
Oct 31 00:34:18.999389 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.998896    5946 manager.go:217] Machine: {Timestamp:2026-10-31 00:34:18.998420879 +0000 UTC m=+0.071460951 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100287 MemoryCapacity:33164333056 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23696cce784fc6b37b0ac6eec84b73 SystemUUID:ec23696c-ce78-4fc6-b37b-0ac6eec84b73 BootID:16f837e7-c902-479b-9f27-3d9ac09de4f0 Filesystems:[{Device:overlay_0-266 DeviceMajor:0 DeviceMinor:266 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/secret-kube-rbac-proxy DeviceMajor:0 DeviceMinor:453 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-96 DeviceMajor:0 DeviceMinor:96 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/610ed88a-261c-4503-b776-4a0c20b6cb07/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:230 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/506537b2-c447-4523-95f5-a53bdc768c84/volumes/kubernetes.io~secret/node-exporter-tls DeviceMajor:0 DeviceMinor:286 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-320 DeviceMajor:0 DeviceMinor:320 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0883a925-b7f8-44b8-a889-4d3cc5af9fe8/volumes/kubernetes.io~secret/metrics-certs DeviceMajor:0 DeviceMinor:500 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f830a534e525123941c29f57ef11e0e53ff99698f95c469947360348d1ef731f/userdata/shm DeviceMajor:0 DeviceMinor:504 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-272 DeviceMajor:0 DeviceMinor:272 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/506537b2-c447-4523-95f5-a53bdc768c84/volumes/kubernetes.io~secret/node-exporter-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:284 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-294 DeviceMajor:0 DeviceMinor:294 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-301 DeviceMajor:0 DeviceMinor:301 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/secret-prometheus-k8s-tls DeviceMajor:0 DeviceMinor:446 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-468 DeviceMajor:0 DeviceMinor:468 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:32 Capacity:16582168576 Type:vfs Inodes:1048576 HasInodes:true} {Device:/var/lib/kubelet/pods/66f8ebac-f187-49d1-acf8-ec86c904c475/volumes/kubernetes.io~projected/kube-api-access-w4spf DeviceMajor:0 DeviceMinor:57 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-157 DeviceMajor:0 DeviceMinor:157 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-215 DeviceMajor:0 DeviceMinor:215 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4/volumes/kubernetes.io~projected/kube-api-access-v9gng DeviceMajor:0 DeviceMinor:248 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-404 DeviceMajor:0 DeviceMinor:404 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-427 DeviceMajor:0 DeviceMinor:427 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~projected/kube-api-access-qbwmm DeviceMajor:0 DeviceMinor:454 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/06d3ae65be837623b620e551c3ad9a59234c1dd8a8ea8c94b9c57b1a1e24e782/userdata/shm DeviceMajor:0 DeviceMinor:97 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-217 DeviceMajor:0 DeviceMinor:217 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-225 DeviceMajor:0 DeviceMinor:225 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-356 DeviceMajor:0 DeviceMinor:356 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-363 DeviceMajor:0 DeviceMinor:363 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-495 DeviceMajor:0 DeviceMinor:495 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/381d2c0a559a7af6889d0a9f5bf242d3959794284d48396f7baa357acc3a9c55/userdata/shm DeviceMajor:0 DeviceMinor:512 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-152 DeviceMajor:0 DeviceMinor:152 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-480 DeviceMajor:0 DeviceMinor:480 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-508 DeviceMajor:0 DeviceMinor:508 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-34 DeviceMajor:0 DeviceMinor:34 Capacity:6422528 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/run/containers/storage/overlay-containers/63af29665d5fd3255d1b19fdc5cce7f204b69dcd711c61f2c7cfcf86285f771c/userdata/shm DeviceMajor:0 DeviceMinor:84 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-139 DeviceMajor:0 DeviceMinor:139 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb/volumes/kubernetes.io~secret/metrics-tls DeviceMajor:0 DeviceMinor:197 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/e4798203-046e-4ad4-842d-a211d905cd74/volumes/kubernetes.io~projected/kube-api-access-wlwjc DeviceMajor:0 DeviceMinor:287 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-metric DeviceMajor:0 DeviceMinor:334 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-362 DeviceMajor:0 DeviceMinor:362 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-402 DeviceMajor:0 DeviceMinor:402 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9d1097cb6f5c08c431b261dbc3da752f1763bee4b06a3ba5f828bfc054100e4b/userdata/shm DeviceMajor:0 DeviceMinor:292 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-49 DeviceMajor:0 DeviceMinor:49 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c9248850-deda-4b75-b652-9f26255812f8/volumes/kubernetes.io~secret/cert DeviceMajor:0 DeviceMinor:201 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4/volumes/kubernetes.io~secret/prometheus-operator-tls DeviceMajor:0 DeviceMinor:246 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/52f7ea9a62d9c565d76e1b3cbcab6cca76bdb6a674e8caf8b014357d71978c35/userdata/shm DeviceMajor:0 DeviceMinor:249 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/config-volume DeviceMajor:0 DeviceMinor:328 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:332 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-432 DeviceMajor:0 DeviceMinor:432 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/9a67d896966aed131375804909522399a11dd0980b09077cbb6497282a208133/userdata/shm DeviceMajor:0 DeviceMinor:72 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-78 DeviceMajor:0 DeviceMinor:78 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/82a7f8c3d05eddccebf4f83dcd2fc461c57375d2130e29c022defca00005e367/userdata/shm DeviceMajor:0 DeviceMinor:90 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-251 DeviceMajor:0 DeviceMinor:251 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~secret/secret-thanos-querier-tls DeviceMajor:0 DeviceMinor:347 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-417 DeviceMajor:0 DeviceMinor:417 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/config DeviceMajor:0 DeviceMinor:456 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volume-subpaths/web-config/prometheus/15 DeviceMajor:0 DeviceMinor:442 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7c299a3043f0a079b20d78d440dc4211bdbb58955fee38c6137e812d96795504/userdata/shm DeviceMajor:0 DeviceMinor:68 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-70 DeviceMajor:0 DeviceMinor:70 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-82 DeviceMajor:0 DeviceMinor:82 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/610ed88a-261c-4503-b776-4a0c20b6cb07/volumes/kubernetes.io~projected/kube-api-access-crwrm DeviceMajor:0 DeviceMinor:232 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-255 DeviceMajor:0 DeviceMinor:255 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/506537b2-c447-4523-95f5-a53bdc768c84/volumes/kubernetes.io~projected/kube-api-access-zlq92 DeviceMajor:0 DeviceMinor:288 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c54eb23e869163f2d6c2849805e4f4f97ac0bd3ca3408f20c729e1bea6c1d1f8/userdata/shm DeviceMajor:0 DeviceMinor:336 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-406 DeviceMajor:0 DeviceMinor:406 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-74 DeviceMajor:0 DeviceMinor:74 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01/volumes/kubernetes.io~secret/agent-certs DeviceMajor:0 DeviceMinor:55 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/45efeeda-0c9c-461c-bb19-c43de5b9566a/volumes/kubernetes.io~projected/kube-api-access-llfdt DeviceMajor:0 DeviceMinor:64 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0b7e45fa-6f09-4d02-bc42-e89d46d954b6/volumes/kubernetes.io~projected/kube-api-access-5m5kc DeviceMajor:0 DeviceMinor:65 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-140 DeviceMajor:0 DeviceMinor:140 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-187 DeviceMajor:0 DeviceMinor:187 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb/volumes/kubernetes.io~projected/kube-api-access-gw7nf DeviceMajor:0 DeviceMinor:204 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/610ed88a-261c-4503-b776-4a0c20b6cb07/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:231 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/var/lib/kubelet/pods/6af6f8e7-3e6c-4e48-9944-fa06042a5e57/volumes/kubernetes.io~secret/kube-state-metrics-tls DeviceMajor:0 DeviceMinor:282 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:349 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-rules DeviceMajor:0 DeviceMinor:350 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-369 DeviceMajor:0 DeviceMinor:369 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volume-subpaths/cluster-tls-config/alertmanager/10 DeviceMajor:0 DeviceMinor:327 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:442 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/thanos-prometheus-http-client-file DeviceMajor:0 DeviceMinor:447 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/5efc17396649c3f6a5c79bb1af01b3e86783d9fbc0f8c29a82c6515b806cf997/userdata/shm DeviceMajor:0 DeviceMinor:395 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/secret-prometheus-k8s-thanos-sidecar-tls DeviceMajor:0 DeviceMinor:452 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:455 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/90fdba20-20ae-405d-bd58-0756cc1fdcad/volumes/kubernetes.io~secret/original-pull-secret DeviceMajor:0 DeviceMinor:506 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-514 DeviceMajor:0 DeviceMinor:514 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:24 Capacity:16582164480 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/093ca6ba9183eebb21515723150a834bacea4d33046d9f55558fc5f246af546e/userdata/shm DeviceMajor:0 DeviceMinor:80 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-86 DeviceMajor:0 DeviceMinor:86 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-305 DeviceMajor:0 DeviceMinor:305 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-338 DeviceMajor:0 DeviceMinor:338 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/d9800bfe7079bdd9eae6f80ac2ebe511c7947bd094f1433f31d50b96cc60272e/userdata/shm DeviceMajor:0 DeviceMinor:340 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volume-subpaths/web-config/config-reloader/2 DeviceMajor:0 DeviceMinor:442 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-518 DeviceMajor:0 DeviceMinor:518 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/34b2bd3f-0955-482d-bf8e-0ec7de5a226a/volumes/kubernetes.io~empty-dir/tmp DeviceMajor:0 DeviceMinor:60 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-192 DeviceMajor:0 DeviceMinor:192 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/7c8428d86a49eace18fc7d505868127daac4d7e71324d139a86b2102da239277/userdata/shm DeviceMajor:0 DeviceMinor:296 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:329 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/adf334f33e47c7fcc6dbacf70ec1250e8f01a728479f699821d8ffaf197845ea/userdata/shm DeviceMajor:0 DeviceMinor:239 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-241 DeviceMajor:0 DeviceMinor:241 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-437 DeviceMajor:0 DeviceMinor:437 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-466 DeviceMajor:0 DeviceMinor:466 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-490 DeviceMajor:0 DeviceMinor:490 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-119 DeviceMajor:0 DeviceMinor:119 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-390 DeviceMajor:0 DeviceMinor:390 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-422 DeviceMajor:0 DeviceMinor:422 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volume-subpaths/web-config/init-config-reloader/2 DeviceMajor:0 DeviceMinor:442 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-111 DeviceMajor:0 DeviceMinor:111 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/b887ee3e2bc7e26ec6174b3ad1c9553f3d02530e41b5d4759e0ed750de2ed962/userdata/shm DeviceMajor:0 DeviceMinor:205 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/16adc2d08ec3a80f2102398375c3a21ad418981115137bf5c3ec579fd6ebea43/userdata/shm DeviceMajor:0 DeviceMinor:207 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-211 DeviceMajor:0 DeviceMinor:211 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e4798203-046e-4ad4-842d-a211d905cd74/volumes/kubernetes.io~secret/openshift-state-metrics-tls DeviceMajor:0 DeviceMinor:283 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/1e2c6645-71a9-4a48-883d-22c96ab5ab1b/volumes/kubernetes.io~secret/console-oauth-config DeviceMajor:0 DeviceMinor:299 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-315 DeviceMajor:0 DeviceMinor:315 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/secret-alertmanager-main-tls DeviceMajor:0 DeviceMinor:330 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/34b2bd3f-0955-482d-bf8e-0ec7de5a226a/volumes/kubernetes.io~projected/kube-api-access-thmlk DeviceMajor:0 DeviceMinor:66 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-88 DeviceMajor:0 DeviceMinor:88 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-162 DeviceMajor:0 DeviceMinor:162 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c68937ea-3c3b-46d1-9646-a9fa24c89cde/volumes/kubernetes.io~projected/kube-api-access-ctxjg DeviceMajor:0 DeviceMinor:397 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:449 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-531 DeviceMajor:0 DeviceMinor:531 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/0883a925-b7f8-44b8-a889-4d3cc5af9fe8/volumes/kubernetes.io~projected/kube-api-access-m5sj7 DeviceMajor:0 DeviceMinor:58 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-127 DeviceMajor:0 DeviceMinor:127 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-177 DeviceMajor:0 DeviceMinor:177 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/web-config DeviceMajor:0 DeviceMinor:333 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy-metrics DeviceMajor:0 DeviceMinor:342 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-354 DeviceMajor:0 DeviceMinor:354 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6bd3d849-76a8-410d-8aa1-400e57cbaded/volumes/kubernetes.io~projected/kube-api-access-psclh DeviceMajor:0 DeviceMinor:62 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/8f7af1c9-c623-41f4-8923-ea931d7c08ab/volumes/kubernetes.io~projected/kube-api-access-ww699 DeviceMajor:0 DeviceMinor:67 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-134 DeviceMajor:0 DeviceMinor:134 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1e2c6645-71a9-4a48-883d-22c96ab5ab1b/volumes/kubernetes.io~projected/kube-api-access-8sv6t DeviceMajor:0 DeviceMinor:300 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-352 DeviceMajor:0 DeviceMinor:352 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/8f9aad4a22467b6b1f05aee4d3026871f1cc98a52c3f301d1c1ddb0cde549352/userdata/shm DeviceMajor:0 DeviceMinor:51 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-313 DeviceMajor:0 DeviceMinor:313 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volume-subpaths/web-config/config-reloader/6 DeviceMajor:0 DeviceMinor:333 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/secret-metrics-client-certs DeviceMajor:0 DeviceMinor:450 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/e4798203-046e-4ad4-842d-a211d905cd74/volumes/kubernetes.io~secret/openshift-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:277 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/e1748202-4b8b-4c5d-891e-5f68728124ea/volumes/kubernetes.io~projected/kube-api-access-k422l DeviceMajor:0 DeviceMinor:59 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/c9248850-deda-4b75-b652-9f26255812f8/volumes/kubernetes.io~projected/kube-api-access-hd475 DeviceMajor:0 DeviceMinor:202 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/c55ac10a-0189-4764-b828-098f9ea03f75/volumes/kubernetes.io~projected/kube-api-access-wfw9h DeviceMajor:0 DeviceMinor:203 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-261 DeviceMajor:0 DeviceMinor:261 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~secret/secret-grpc-tls DeviceMajor:0 DeviceMinor:346 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~secret/secret-thanos-querier-kube-rbac-proxy DeviceMajor:0 DeviceMinor:348 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-412 DeviceMajor:0 DeviceMinor:412 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-169 DeviceMajor:0 DeviceMinor:169 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-219 DeviceMajor:0 DeviceMinor:219 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-233 DeviceMajor:0 DeviceMinor:233 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~projected/kube-api-access-kz46w DeviceMajor:0 DeviceMinor:335 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/26ab7116-31a7-404c-8a01-6502edf9f5ce/volumes/kubernetes.io~projected/kube-api-access-f68jv DeviceMajor:0 DeviceMinor:507 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/72348916979ff0fa963b73b16187624f5ffd8cdd9b40f4feb208ea375361abbe/userdata/shm DeviceMajor:0 DeviceMinor:510 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-526 DeviceMajor:0 DeviceMinor:526 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volume-subpaths/web-config/init-config-reloader/6 DeviceMajor:0 DeviceMinor:333 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-457 DeviceMajor:0 DeviceMinor:457 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-474 DeviceMajor:0 DeviceMinor:474 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-485 DeviceMajor:0 DeviceMinor:485 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/1f7453db944a767efe3032f2f57d99527f6ba17a122d6c8edc3e744347af5ccd/userdata/shm DeviceMajor:0 DeviceMinor:76 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-92 DeviceMajor:0 DeviceMinor:92 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-124 DeviceMajor:0 DeviceMinor:124 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/6af6f8e7-3e6c-4e48-9944-fa06042a5e57/volumes/kubernetes.io~secret/kube-state-metrics-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:285 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/1e2c6645-71a9-4a48-883d-22c96ab5ab1b/volumes/kubernetes.io~secret/console-serving-cert DeviceMajor:0 DeviceMinor:298 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/82fa81b0-268b-497e-acc1-ac9eb4a97afb/volumes/kubernetes.io~projected/kube-api-access-j2mh5 DeviceMajor:0 DeviceMinor:351 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~empty-dir/config-out DeviceMajor:0 DeviceMinor:448 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/e1748202-4b8b-4c5d-891e-5f68728124ea/volumes/kubernetes.io~secret/ovn-node-metrics-cert DeviceMajor:0 DeviceMinor:56 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/0420aed9-f163-474d-a19f-2db0bfdb32e6/volumes/kubernetes.io~projected/kube-api-access-qmwt7 DeviceMajor:0 DeviceMinor:63 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-102 DeviceMajor:0 DeviceMinor:102 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-106 DeviceMajor:0 DeviceMinor:106 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/f910692db9b6381b02717abc4eff2dfc740a1e9be1b1489b3bd3aa8f1645b9a6/userdata/shm DeviceMajor:0 DeviceMinor:310 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/cluster-tls-config DeviceMajor:0 DeviceMinor:327 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-379 DeviceMajor:0 DeviceMinor:379 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes/kubernetes.io~secret/secret-prometheus-k8s-kube-rbac-proxy-web DeviceMajor:0 DeviceMinor:451 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/6af6f8e7-3e6c-4e48-9944-fa06042a5e57/volumes/kubernetes.io~projected/kube-api-access-ghc8q DeviceMajor:0 DeviceMinor:289 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-464 DeviceMajor:0 DeviceMinor:464 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-516 DeviceMajor:0 DeviceMinor:516 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/a33a4ec8d8ae616c47c8b62e20445a8474a9fc60f2986e0b1a5ded0ba841b466/userdata/shm DeviceMajor:0 DeviceMinor:47 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/34b2bd3f-0955-482d-bf8e-0ec7de5a226a/volumes/kubernetes.io~empty-dir/etc-tuned DeviceMajor:0 DeviceMinor:61 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:/run/containers/storage/overlay-containers/76b05dc3df1ffe648a33eb8fb2b102295235d3042c71f1017412960b4f09e4ff/userdata/shm DeviceMajor:0 DeviceMinor:209 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4/volumes/kubernetes.io~secret/prometheus-operator-kube-rbac-proxy-config DeviceMajor:0 DeviceMinor:247 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-303 DeviceMajor:0 DeviceMinor:303 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~projected/tls-assets DeviceMajor:0 DeviceMinor:331 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-374 DeviceMajor:0 DeviceMinor:374 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/c8f693e8fea1e5d57d49dbb75d40f50d1bd08291aab6528c24cb4b7efd042a8c/userdata/shm DeviceMajor:0 DeviceMinor:459 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-53 DeviceMajor:0 DeviceMinor:53 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/e8daca4e69149b72de51e98abf18f62b4779832fe5107b7cdcf20917da9f2ddc/userdata/shm DeviceMajor:0 DeviceMinor:290 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes/kubernetes.io~secret/secret-alertmanager-kube-rbac-proxy DeviceMajor:0 DeviceMinor:322 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-384 DeviceMajor:0 DeviceMinor:384 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volume-subpaths/web-config/alertmanager/9 DeviceMajor:0 DeviceMinor:333 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-100 DeviceMajor:0 DeviceMinor:100 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-182 DeviceMajor:0 DeviceMinor:182 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c55ac10a-0189-4764-b828-098f9ea03f75/volumes/kubernetes.io~secret/insights-runtime-extractor-tls DeviceMajor:0 DeviceMinor:45 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-253 DeviceMajor:0 DeviceMinor:253 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/c68937ea-3c3b-46d1-9646-a9fa24c89cde/volumes/kubernetes.io~secret/monitoring-plugin-cert DeviceMajor:0 DeviceMinor:396 Capacity:31985733632 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-520 DeviceMajor:0 DeviceMinor:520 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/run/containers/storage/overlay-containers/472e73657b21b4b25654d2e7484627b3b0aa2bc12bb409ff9b0e6e4af280fd29/userdata/shm DeviceMajor:0 DeviceMinor:94 Capacity:67108864 Type:vfs Inodes:4048380 HasInodes:true} {Device:overlay_0-104 DeviceMajor:0 DeviceMinor:104 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-132 DeviceMajor:0 DeviceMinor:132 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:overlay_0-166 DeviceMajor:0 DeviceMinor:166 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:/var/lib/kubelet/pods/e1748202-4b8b-4c5d-891e-5f68728124ea/volume-subpaths/run-systemd/ovnkube-controller/6 DeviceMajor:0 DeviceMinor:26 Capacity:6632869888 Type:vfs Inodes:819200 HasInodes:true} {Device:overlay_0-213 DeviceMajor:0 DeviceMinor:213 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:16adc2d08ec3a80 MacAddress:12:a7:39:cc:68:c5 Speed:10000 Mtu:8901} {Name:381d2c0a559a7af MacAddress:6e:2a:b1:05:70:8b Speed:10000 Mtu:8901} {Name:52f7ea9a62d9c56 MacAddress:c6:80:dc:cd:4b:7c Speed:10000 Mtu:8901} {Name:5efc17396649c3f MacAddress:f2:e1:b2:b8:84:dc Speed:10000 Mtu:8901} {Name:72348916979ff0f MacAddress:36:89:f0:13:78:13 Speed:10000 Mtu:8901} {Name:76b05dc3df1ffe6 MacAddress:7e:97:5e:aa:1c:3e Speed:10000 Mtu:8901} {Name:7c8428d86a49eac MacAddress:16:01:b5:06:b1:bd Speed:10000 Mtu:8901} {Name:adf334f33e47c7f MacAddress:b2:88:58:9e:97:2c Speed:10000 Mtu:8901} {Name:b887ee3e2bc7e26 MacAddress:12:b3:ad:db:09:72 Speed:10000 Mtu:8901} {Name:br-ex MacAddress:02:ff:d1:5f:c9:37 Speed:0 Mtu:9001} {Name:br-int MacAddress:da:09:b3:05:7f:28 Speed:0 Mtu:8901} {Name:c54eb23e869163f MacAddress:86:0e:dc:40:2b:ed Speed:10000 Mtu:8901} {Name:c8f693e8fea1e5d MacAddress:52:bf:b6:3e:63:d7 Speed:10000 Mtu:8901} {Name:d9800bfe7079bdd MacAddress:76:fe:e5:30:87:1b Speed:10000 Mtu:8901} {Name:e8daca4e69149b7 MacAddress:fa:8e:81:d7:7f:93 Speed:10000 Mtu:8901} {Name:ens5 MacAddress:02:ff:d1:5f:c9:37 Speed:0 Mtu:9001} {Name:f830a534e525123 MacAddress:0a:af:b3:f8:7a:46 Speed:10000 Mtu:8901} {Name:f910692db9b6381 MacAddress:72:36:d1:14:64:05 Speed:10000 Mtu:8901} {Name:genev_sys_6081 MacAddress:1e:ff:14:62:9d:2b Speed:0 Mtu:65000} {Name:ovn-k8s-mp0 MacAddress:0a:58:0a:86:00:02 Speed:0 Mtu:8901} {Name:ovs-system MacAddress:06:d1:ae:69:3e:e5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164333056 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Oct 31 00:34:18.999680 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.999393    5946 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Oct 31 00:34:18.999680 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.999439    5946 manager.go:233] Version: {KernelVersion:5.14.0-687.60.1.el9_8.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.8.20261023-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Oct 31 00:34:18.999778 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.999756    5946 container_manager_linux.go:275] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Oct 31 00:34:18.999905 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.999779    5946 container_manager_linux.go:280] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-7.us-east-2.compute.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"/system.slice","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{},"system-reserved-compressible":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Oct 31 00:34:18.999951 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.999908    5946 topology_manager.go:143] "Creating topology manager with none policy"
Oct 31 00:34:18.999951 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.999916    5946 container_manager_linux.go:311] "Creating device plugin manager"
Oct 31 00:34:18.999951 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.999929    5946 manager.go:144] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 00:34:18.999951 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:18.999947    5946 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Oct 31 00:34:19.000057 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.000033    5946 container_manager_linux.go:320] "Creating Dynamic Resource Allocation (DRA) manager"
Oct 31 00:34:19.000193 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.000184    5946 state_mem.go:41] "Initialized" logger="CPUManager state memory"
Oct 31 00:34:19.000383 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.000307    5946 server.go:1235] "Using root directory" path="/var/lib/kubelet"
Oct 31 00:34:19.000383 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.000343    5946 kubelet.go:493] "Attempting to sync node with API server"
Oct 31 00:34:19.000383 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.000355    5946 kubelet.go:394] "Adding static pod path" path="/etc/kubernetes/manifests"
Oct 31 00:34:19.000383 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.000367    5946 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Oct 31 00:34:19.000383 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.000376    5946 kubelet.go:405] "Adding apiserver pod source"
Oct 31 00:34:19.000383 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.000383    5946 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Oct 31 00:34:19.001507 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.001490    5946 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 31 00:34:19.001563 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.001511    5946 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 00:34:19.002005 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.001991    5946 kuberuntime_manager.go:304] "Container runtime initialized" containerRuntime="cri-o" version="1.35.10-3.rhaos4.22.git9383502.el9" apiVersion="v1"
Oct 31 00:34:19.005198 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005182    5946 state_checkpoint.go:81] "State checkpoint: restored pod resource state from checkpoint"
Oct 31 00:34:19.005198 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005194    5946 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Oct 31 00:34:19.005324 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005298    5946 certificate_store.go:147] "Loading cert/key pair from a file" filePath="/var/lib/kubelet/pki/kubelet-server-current.pem"
Oct 31 00:34:19.005494 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005482    5946 kubelet.go:963] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Oct 31 00:34:19.005526 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005511    5946 kubelet.go:990] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Oct 31 00:34:19.005603 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005594    5946 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Oct 31 00:34:19.005648 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005608    5946 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Oct 31 00:34:19.005648 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005615    5946 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Oct 31 00:34:19.005648 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005621    5946 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Oct 31 00:34:19.005648 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005626    5946 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Oct 31 00:34:19.005648 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005632    5946 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Oct 31 00:34:19.005648 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005637    5946 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Oct 31 00:34:19.005648 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005643    5946 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Oct 31 00:34:19.005648 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005651    5946 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Oct 31 00:34:19.005999 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005657    5946 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Oct 31 00:34:19.005999 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005665    5946 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Oct 31 00:34:19.005999 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005675    5946 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Oct 31 00:34:19.005999 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005698    5946 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Oct 31 00:34:19.005999 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.005704    5946 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Oct 31 00:34:19.009024 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.009009    5946 server.go:1263] "Started kubelet"
Oct 31 00:34:19.009129 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.009096    5946 server.go:182] "Starting to listen" address="0.0.0.0" port=10250
Oct 31 00:34:19.009285 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.009118    5946 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Oct 31 00:34:19.009421 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.009407    5946 server_v1.go:49] "podresources" method="list" useActivePods=true
Oct 31 00:34:19.010316 ip-10-0-143-7 systemd[1]: Started Kubernetes Kubelet.
Oct 31 00:34:19.014267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.010512    5946 server.go:254] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Oct 31 00:34:19.019436 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.018692    5946 server.go:317] "Adding debug handlers to kubelet server"
Oct 31 00:34:19.019897 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.019816    5946 fs_resource_analyzer.go:69] "Starting FS ResourceAnalyzer"
Oct 31 00:34:19.019984 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.019912    5946 reflector.go:446] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:34:19.022272 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.020105    5946 volume_manager.go:309] "The desired_state_of_world populator starts"
Oct 31 00:34:19.022272 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.020119    5946 volume_manager.go:311] "Starting Kubelet Volume Manager"
Oct 31 00:34:19.022272 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.020242    5946 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Oct 31 00:34:19.022272 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.020109    5946 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Oct 31 00:34:19.022272 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.021321    5946 reflector.go:446] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:34:19.022272 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.021621    5946 factory.go:55] Registering systemd factory
Oct 31 00:34:19.022272 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.021645    5946 factory.go:223] Registration of the systemd container factory successfully
Oct 31 00:34:19.022272 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.021829    5946 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-10-30 00:28:09 +0000 UTC" deadline="2028-05-10 11:29:26.91086152 +0000 UTC"
Oct 31 00:34:19.022272 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.021870    5946 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13378h55m7.888995154s"
Oct 31 00:34:19.023196 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.022891    5946 factory.go:153] Registering CRI-O factory
Oct 31 00:34:19.023196 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.022914    5946 factory.go:223] Registration of the crio container factory successfully
Oct 31 00:34:19.023196 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.022986    5946 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Oct 31 00:34:19.023196 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.023002    5946 factory.go:103] Registering Raw factory
Oct 31 00:34:19.023196 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.023016    5946 manager.go:1199] Started watching for new ooms in manager
Oct 31 00:34:19.032273 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.024276    5946 manager.go:319] Starting recovery of all containers
Oct 31 00:34:19.032273 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.026905    5946 reflector.go:446] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:34:19.032273 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.031239    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-thanos-prometheus-http-client-file" seLinuxMountContext=""
Oct 31 00:34:19.032541 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.032381    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="506537b2-c447-4523-95f5-a53bdc768c84" volumeName="kubernetes.io/secret/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-tls" seLinuxMountContext=""
Oct 31 00:34:19.032541 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.032420    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82fa81b0-268b-497e-acc1-ac9eb4a97afb" volumeName="kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 31 00:34:19.032541 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.032440    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8f7af1c9-c623-41f4-8923-ea931d7c08ab" volumeName="kubernetes.io/projected/8f7af1c9-c623-41f4-8923-ea931d7c08ab-kube-api-access-ww699" seLinuxMountContext=""
Oct 31 00:34:19.032541 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.032464    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1e2c6645-71a9-4a48-883d-22c96ab5ab1b" volumeName="kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert" seLinuxMountContext=""
Oct 31 00:34:19.032541 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.032480    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-web-config" seLinuxMountContext=""
Oct 31 00:34:19.032541 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.032500    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="45efeeda-0c9c-461c-bb19-c43de5b9566a" volumeName="kubernetes.io/projected/45efeeda-0c9c-461c-bb19-c43de5b9566a-kube-api-access-llfdt" seLinuxMountContext=""
Oct 31 00:34:19.032541 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.032527    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" volumeName="kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-trusted-ca-bundle" seLinuxMountContext=""
Oct 31 00:34:19.032817 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.032553    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" volumeName="kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-main-tls" seLinuxMountContext=""
Oct 31 00:34:19.032817 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.032570    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8f7af1c9-c623-41f4-8923-ea931d7c08ab" volumeName="kubernetes.io/configmap/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-daemon-config" seLinuxMountContext=""
Oct 31 00:34:19.032817 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.032634    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c55ac10a-0189-4764-b828-098f9ea03f75" volumeName="kubernetes.io/projected/c55ac10a-0189-4764-b828-098f9ea03f75-kube-api-access-wfw9h" seLinuxMountContext=""
Oct 31 00:34:19.032817 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.032648    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0420aed9-f163-474d-a19f-2db0bfdb32e6" volumeName="kubernetes.io/projected/0420aed9-f163-474d-a19f-2db0bfdb32e6-kube-api-access-qmwt7" seLinuxMountContext=""
Oct 31 00:34:19.032817 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.032667    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-trusted-ca-bundle" seLinuxMountContext=""
Oct 31 00:34:19.033151 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.032683    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="610ed88a-261c-4503-b776-4a0c20b6cb07" volumeName="kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert" seLinuxMountContext=""
Oct 31 00:34:19.033212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.033179    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c9248850-deda-4b75-b652-9f26255812f8" volumeName="kubernetes.io/projected/c9248850-deda-4b75-b652-9f26255812f8-kube-api-access-hd475" seLinuxMountContext=""
Oct 31 00:34:19.033212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.033208    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4" volumeName="kubernetes.io/configmap/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-metrics-client-ca" seLinuxMountContext=""
Oct 31 00:34:19.033318 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.033240    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b7e45fa-6f09-4d02-bc42-e89d46d954b6" volumeName="kubernetes.io/configmap/0b7e45fa-6f09-4d02-bc42-e89d46d954b6-iptables-alerter-script" seLinuxMountContext=""
Oct 31 00:34:19.033318 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.033255    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1e2c6645-71a9-4a48-883d-22c96ab5ab1b" volumeName="kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca" seLinuxMountContext=""
Oct 31 00:34:19.033318 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.033282    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="506537b2-c447-4523-95f5-a53bdc768c84" volumeName="kubernetes.io/empty-dir/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-textfile" seLinuxMountContext=""
Oct 31 00:34:19.034129 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.033956    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6af6f8e7-3e6c-4e48-9944-fa06042a5e57" volumeName="kubernetes.io/configmap/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-metrics-client-ca" seLinuxMountContext=""
Oct 31 00:34:19.034129 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.033993    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6af6f8e7-3e6c-4e48-9944-fa06042a5e57" volumeName="kubernetes.io/secret/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 31 00:34:19.034129 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034008    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82fa81b0-268b-497e-acc1-ac9eb4a97afb" volumeName="kubernetes.io/configmap/82fa81b0-268b-497e-acc1-ac9eb4a97afb-metrics-client-ca" seLinuxMountContext=""
Oct 31 00:34:19.034129 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034022    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-metrics-client-ca" seLinuxMountContext=""
Oct 31 00:34:19.034129 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034037    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="610ed88a-261c-4503-b776-4a0c20b6cb07" volumeName="kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert" seLinuxMountContext=""
Oct 31 00:34:19.034129 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034067    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c9248850-deda-4b75-b652-9f26255812f8" volumeName="kubernetes.io/secret/c9248850-deda-4b75-b652-9f26255812f8-cert" seLinuxMountContext=""
Oct 31 00:34:19.034129 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034082    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="610ed88a-261c-4503-b776-4a0c20b6cb07" volumeName="kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm" seLinuxMountContext=""
Oct 31 00:34:19.034129 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034095    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1748202-4b8b-4c5d-891e-5f68728124ea" volumeName="kubernetes.io/configmap/e1748202-4b8b-4c5d-891e-5f68728124ea-ovnkube-config" seLinuxMountContext=""
Oct 31 00:34:19.034129 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034109    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34b2bd3f-0955-482d-bf8e-0ec7de5a226a" volumeName="kubernetes.io/empty-dir/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-tmp" seLinuxMountContext=""
Oct 31 00:34:19.034129 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034128    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" volumeName="kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034141    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1748202-4b8b-4c5d-891e-5f68728124ea" volumeName="kubernetes.io/projected/e1748202-4b8b-4c5d-891e-5f68728124ea-kube-api-access-k422l" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034155    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-0" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034168    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-tls" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034182    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-kube-rbac-proxy" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034194    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82fa81b0-268b-497e-acc1-ac9eb4a97afb" volumeName="kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy-rules" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034206    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34b2bd3f-0955-482d-bf8e-0ec7de5a226a" volumeName="kubernetes.io/empty-dir/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-tuned" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034241    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="506537b2-c447-4523-95f5-a53bdc768c84" volumeName="kubernetes.io/secret/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034255    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6af6f8e7-3e6c-4e48-9944-fa06042a5e57" volumeName="kubernetes.io/projected/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-api-access-ghc8q" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034267    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6bd3d849-76a8-410d-8aa1-400e57cbaded" volumeName="kubernetes.io/projected/6bd3d849-76a8-410d-8aa1-400e57cbaded-kube-api-access-psclh" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034284    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4798203-046e-4ad4-842d-a211d905cd74" volumeName="kubernetes.io/secret/e4798203-046e-4ad4-842d-a211d905cd74-openshift-state-metrics-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034296    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-metrics-client-certs" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034308    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" volumeName="kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-out" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034320    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" volumeName="kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034333    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c68937ea-3c3b-46d1-9646-a9fa24c89cde" volumeName="kubernetes.io/projected/c68937ea-3c3b-46d1-9646-a9fa24c89cde-kube-api-access-ctxjg" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034354    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4" volumeName="kubernetes.io/secret/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-prometheus-operator-kube-rbac-proxy-config" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034367    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4798203-046e-4ad4-842d-a211d905cd74" volumeName="kubernetes.io/projected/e4798203-046e-4ad4-842d-a211d905cd74-kube-api-access-wlwjc" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034380    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" volumeName="kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-metric" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034393    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6bd3d849-76a8-410d-8aa1-400e57cbaded" volumeName="kubernetes.io/configmap/6bd3d849-76a8-410d-8aa1-400e57cbaded-whereabouts-flatfile-configmap" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034406    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1748202-4b8b-4c5d-891e-5f68728124ea" volumeName="kubernetes.io/secret/e1748202-4b8b-4c5d-891e-5f68728124ea-ovn-node-metrics-cert" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034420    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-tls-assets" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034434    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="26ab7116-31a7-404c-8a01-6502edf9f5ce" volumeName="kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034466    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="610ed88a-261c-4503-b776-4a0c20b6cb07" volumeName="kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034485    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="610ed88a-261c-4503-b776-4a0c20b6cb07" volumeName="kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034499    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" volumeName="kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-kube-api-access-kz46w" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034513    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" volumeName="kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-web-config" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034539    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01" volumeName="kubernetes.io/secret/7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01-agent-certs" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034552    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1e2c6645-71a9-4a48-883d-22c96ab5ab1b" volumeName="kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034592    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0420aed9-f163-474d-a19f-2db0bfdb32e6" volumeName="kubernetes.io/empty-dir/0420aed9-f163-474d-a19f-2db0bfdb32e6-tmp-dir" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034610    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6bd3d849-76a8-410d-8aa1-400e57cbaded" volumeName="kubernetes.io/configmap/6bd3d849-76a8-410d-8aa1-400e57cbaded-cni-binary-copy" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034623    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82fa81b0-268b-497e-acc1-ac9eb4a97afb" volumeName="kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-tls" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034635    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a2e0e44-ffc6-4199-903b-4eae5ad5aefb" volumeName="kubernetes.io/secret/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-metrics-tls" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034648    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01" volumeName="kubernetes.io/configmap/7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01-konnectivity-ca" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034660    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0883a925-b7f8-44b8-a889-4d3cc5af9fe8" volumeName="kubernetes.io/projected/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-kube-api-access-m5sj7" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034674    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0883a925-b7f8-44b8-a889-4d3cc5af9fe8" volumeName="kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034690    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" volumeName="kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-tls-assets" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034703    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="610ed88a-261c-4503-b776-4a0c20b6cb07" volumeName="kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034715    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" volumeName="kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-volume" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034727    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c55ac10a-0189-4764-b828-098f9ea03f75" volumeName="kubernetes.io/secret/c55ac10a-0189-4764-b828-098f9ea03f75-insights-runtime-extractor-tls" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034739    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-2" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034753    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4798203-046e-4ad4-842d-a211d905cd74" volumeName="kubernetes.io/secret/e4798203-046e-4ad4-842d-a211d905cd74-openshift-state-metrics-tls" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034770    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="506537b2-c447-4523-95f5-a53bdc768c84" volumeName="kubernetes.io/configmap/506537b2-c447-4523-95f5-a53bdc768c84-metrics-client-ca" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034783    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="610ed88a-261c-4503-b776-4a0c20b6cb07" volumeName="kubernetes.io/empty-dir/610ed88a-261c-4503-b776-4a0c20b6cb07-tmp" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034795    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c68937ea-3c3b-46d1-9646-a9fa24c89cde" volumeName="kubernetes.io/secret/c68937ea-3c3b-46d1-9646-a9fa24c89cde-monitoring-plugin-cert" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034808    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config-out" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034823    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6bd3d849-76a8-410d-8aa1-400e57cbaded" volumeName="kubernetes.io/configmap/6bd3d849-76a8-410d-8aa1-400e57cbaded-cni-sysctl-allowlist" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034837    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82fa81b0-268b-497e-acc1-ac9eb4a97afb" volumeName="kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-grpc-tls" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034849    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6af6f8e7-3e6c-4e48-9944-fa06042a5e57" volumeName="kubernetes.io/secret/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-state-metrics-tls" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034862    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1e2c6645-71a9-4a48-883d-22c96ab5ab1b" volumeName="kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034875    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="506537b2-c447-4523-95f5-a53bdc768c84" volumeName="kubernetes.io/projected/506537b2-c447-4523-95f5-a53bdc768c84-kube-api-access-zlq92" seLinuxMountContext=""
Oct 31 00:34:19.034858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034888    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" volumeName="kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-main-db" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034901    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c55ac10a-0189-4764-b828-098f9ea03f75" volumeName="kubernetes.io/configmap/c55ac10a-0189-4764-b828-098f9ea03f75-kube-rbac-proxy-cm" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034915    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1748202-4b8b-4c5d-891e-5f68728124ea" volumeName="kubernetes.io/configmap/e1748202-4b8b-4c5d-891e-5f68728124ea-ovnkube-script-lib" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034929    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-1" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034941    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034959    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82fa81b0-268b-497e-acc1-ac9eb4a97afb" volumeName="kubernetes.io/empty-dir/82fa81b0-268b-497e-acc1-ac9eb4a97afb-tmp" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034970    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4" volumeName="kubernetes.io/projected/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-kube-api-access-v9gng" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034982    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e1748202-4b8b-4c5d-891e-5f68728124ea" volumeName="kubernetes.io/configmap/e1748202-4b8b-4c5d-891e-5f68728124ea-env-overrides" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.034999    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="e4798203-046e-4ad4-842d-a211d905cd74" volumeName="kubernetes.io/configmap/e4798203-046e-4ad4-842d-a211d905cd74-metrics-client-ca" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035012    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1e2c6645-71a9-4a48-883d-22c96ab5ab1b" volumeName="kubernetes.io/empty-dir/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-tmp" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035027    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-kubelet-serving-ca-bundle" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035040    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" volumeName="kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-cluster-tls-config" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035052    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a2e0e44-ffc6-4199-903b-4eae5ad5aefb" volumeName="kubernetes.io/empty-dir/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-tmp-dir" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035064    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1e2c6645-71a9-4a48-883d-22c96ab5ab1b" volumeName="kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035078    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1e2c6645-71a9-4a48-883d-22c96ab5ab1b" volumeName="kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035092    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-serving-certs-ca-bundle" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035104    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82fa81b0-268b-497e-acc1-ac9eb4a97afb" volumeName="kubernetes.io/projected/82fa81b0-268b-497e-acc1-ac9eb4a97afb-kube-api-access-j2mh5" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035117    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82fa81b0-268b-497e-acc1-ac9eb4a97afb" volumeName="kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035130    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-grpc-tls" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035143    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="66f8ebac-f187-49d1-acf8-ec86c904c475" volumeName="kubernetes.io/configmap/66f8ebac-f187-49d1-acf8-ec86c904c475-serviceca" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035158    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="8f7af1c9-c623-41f4-8923-ea931d7c08ab" volumeName="kubernetes.io/configmap/8f7af1c9-c623-41f4-8923-ea931d7c08ab-cni-binary-copy" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035171    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="90fdba20-20ae-405d-bd58-0756cc1fdcad" volumeName="kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035185    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1e2c6645-71a9-4a48-883d-22c96ab5ab1b" volumeName="kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035197    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" volumeName="kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-metrics-client-ca" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035210    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="c55ac10a-0189-4764-b828-098f9ea03f75" volumeName="kubernetes.io/empty-dir/c55ac10a-0189-4764-b828-098f9ea03f75-data-volume" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035244    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-db" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035258    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-kube-api-access-qbwmm" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035273    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-thanos-sidecar-tls" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035285    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6af6f8e7-3e6c-4e48-9944-fa06042a5e57" volumeName="kubernetes.io/configmap/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-state-metrics-custom-resource-state-configmap" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035300    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4" volumeName="kubernetes.io/secret/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-prometheus-operator-tls" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035314    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="0b7e45fa-6f09-4d02-bc42-e89d46d954b6" volumeName="kubernetes.io/projected/0b7e45fa-6f09-4d02-bc42-e89d46d954b6-kube-api-access-5m5kc" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035325    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="506537b2-c447-4523-95f5-a53bdc768c84" volumeName="kubernetes.io/configmap/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-accelerators-collector-config" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035339    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="6af6f8e7-3e6c-4e48-9944-fa06042a5e57" volumeName="kubernetes.io/empty-dir/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-volume-directive-shadow" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035352    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a2e0e44-ffc6-4199-903b-4eae5ad5aefb" volumeName="kubernetes.io/configmap/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-config-volume" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035386    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="7a2e0e44-ffc6-4199-903b-4eae5ad5aefb" volumeName="kubernetes.io/projected/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-kube-api-access-gw7nf" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035400    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" volumeName="kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-kube-rbac-proxy-web" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035414    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="34b2bd3f-0955-482d-bf8e-0ec7de5a226a" volumeName="kubernetes.io/projected/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-kube-api-access-thmlk" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035425    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="66f8ebac-f187-49d1-acf8-ec86c904c475" volumeName="kubernetes.io/projected/66f8ebac-f187-49d1-acf8-ec86c904c475-kube-api-access-w4spf" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035439    5946 reconstruct.go:129] "Volume is marked as uncertain and added into the actual state" pod="" podName="82fa81b0-268b-497e-acc1-ac9eb4a97afb" volumeName="kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy-metrics" seLinuxMountContext=""
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035452    5946 reconstruct.go:97] "Volume reconstruction finished"
Oct 31 00:34:19.037769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.035459    5946 reconciler.go:29] "Reconciler: start to sync state"
Oct 31 00:34:19.039202 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.038594    5946 reconstruct.go:205] "DevicePaths of reconstructed volumes updated"
Oct 31 00:34:19.045861 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.045825    5946 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Oct 31 00:34:19.047702 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.047675    5946 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Oct 31 00:34:19.047797 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.047716    5946 status_manager.go:249] "Starting to sync pod status with apiserver"
Oct 31 00:34:19.047797 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.047750    5946 kubelet.go:2521] "Starting kubelet main sync loop"
Oct 31 00:34:19.047897 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:19.047811    5946 kubelet.go:2545] "Skipping pod synchronization" err="[container runtime status check may not have completed yet, PLEG is not healthy: pleg has yet to be successful]"
Oct 31 00:34:19.052782 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.052762    5946 reflector.go:446] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:161"
Oct 31 00:34:19.067880 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.067852    5946 generic.go:356] "Generic (PLEG): container finished" podID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerID="0428f2cde44cbd021e0aa208861892848797adfc8e218141361b09a55688adb5" exitCode=0
Oct 31 00:34:19.078718 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.078690    5946 generic.go:356] "Generic (PLEG): container finished" podID="483afccfa0bddca2d4a120103d33e513" containerID="9107a5fa6d6e859dd55e66bec7bbf7356b4fb325f4ed80623821dc9c28f5bc8d" exitCode=0
Oct 31 00:34:19.085848 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.085821    5946 generic.go:356] "Generic (PLEG): container finished" podID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerID="af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d" exitCode=0
Oct 31 00:34:19.098797 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.098771    5946 generic.go:356] "Generic (PLEG): container finished" podID="506537b2-c447-4523-95f5-a53bdc768c84" containerID="a057492122a8a5c2c48430a567aa0aa0b9029b4899e4e814147d58b133a89152" exitCode=0
Oct 31 00:34:19.116380 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.116328    5946 generic.go:356] "Generic (PLEG): container finished" podID="6bd3d849-76a8-410d-8aa1-400e57cbaded" containerID="0aa0e09af0a3e0f47f9bf3237a1442e1a6d6c918c59b59c48d099a7824f6c759" exitCode=0
Oct 31 00:34:19.116380 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.116349    5946 generic.go:356] "Generic (PLEG): container finished" podID="6bd3d849-76a8-410d-8aa1-400e57cbaded" containerID="ba37af5a496086497438c5814b048a9594ab8022267c776c69919b494f4e9836" exitCode=0
Oct 31 00:34:19.116380 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.116357    5946 generic.go:356] "Generic (PLEG): container finished" podID="6bd3d849-76a8-410d-8aa1-400e57cbaded" containerID="45803047eab0a1fc709bcfa7afb09bf5f0f9fa9385e95607f25613f8414cf876" exitCode=0
Oct 31 00:34:19.116380 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.116364    5946 generic.go:356] "Generic (PLEG): container finished" podID="6bd3d849-76a8-410d-8aa1-400e57cbaded" containerID="6fa3bbfffdfd7a7769552d2cf3a174f85cd08364174b15da17e75a53637e8f2a" exitCode=0
Oct 31 00:34:19.116380 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.116370    5946 generic.go:356] "Generic (PLEG): container finished" podID="6bd3d849-76a8-410d-8aa1-400e57cbaded" containerID="2434a245b2d1ade2dca2e44d6117946f540d0279c271fd27b4b174fe8a9a1986" exitCode=0
Oct 31 00:34:19.116380 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.116375    5946 generic.go:356] "Generic (PLEG): container finished" podID="6bd3d849-76a8-410d-8aa1-400e57cbaded" containerID="c06156ed0b80d3d13059a84f007c0244c7483d84d5cc5d11ec4d1b2ed12ce99d" exitCode=0
Oct 31 00:34:19.147870 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:19.147850    5946 kubelet.go:2545] "Skipping pod synchronization" err="container runtime status check may not have completed yet"
Oct 31 00:34:19.154149 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.154132    5946 manager.go:324] Recovery completed
Oct 31 00:34:19.179943 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.179919    5946 cpu_manager.go:226] "Starting" policy="none"
Oct 31 00:34:19.179943 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.179939    5946 cpu_manager.go:227] "Reconciling" reconcilePeriod="10s"
Oct 31 00:34:19.180077 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.179959    5946 state_mem.go:41] "Initialized" logger="CPUManager state checkpoint.CPUManager state memory"
Oct 31 00:34:19.180128 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.180112    5946 state_mem.go:94] "Updated default CPUSet" logger="CPUManager state checkpoint.CPUManager state memory" cpuSet=""
Oct 31 00:34:19.180159 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.180131    5946 state_mem.go:102] "Updated CPUSet assignments" logger="CPUManager state checkpoint.CPUManager state memory" assignments={}
Oct 31 00:34:19.180159 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.180153    5946 state_checkpoint.go:142] "restored state from checkpoint" logger="CPUManager state checkpoint"
Oct 31 00:34:19.180214 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.180160    5946 state_checkpoint.go:143] "defaultCPUSet" logger="CPUManager state checkpoint" defaultCpuSet=""
Oct 31 00:34:19.180214 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.180168    5946 policy_none.go:50] "Start"
Oct 31 00:34:19.180214 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.180181    5946 memory_manager.go:187] "Starting memorymanager" policy="None"
Oct 31 00:34:19.180214 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.180194    5946 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Oct 31 00:34:19.193348 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.193327    5946 state_mem.go:77] "Updated machine memory state" logger="Memory Manager state checkpoint"
Oct 31 00:34:19.193348 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.193348    5946 state_checkpoint.go:85] "State checkpoint: restored state from checkpoint" logger="Memory Manager state checkpoint"
Oct 31 00:34:19.193460 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.193355    5946 policy_none.go:44] "Start"
Oct 31 00:34:19.198166 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.198137    5946 node_container_manager_linux.go:130] "Enforcing system reserved compressible on cgroup" cgroupName="/system.slice" limits={"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"}
Oct 31 00:34:19.201336 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.201324    5946 manager.go:341] "Starting Device Plugin manager"
Oct 31 00:34:19.201392 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:19.201348    5946 manager.go:525] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Oct 31 00:34:19.201392 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.201356    5946 server.go:87] "Starting device plugin registration server"
Oct 31 00:34:19.202146 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.202132    5946 eviction_manager.go:194] "Eviction manager: starting control loop"
Oct 31 00:34:19.202205 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.202147    5946 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Oct 31 00:34:19.202276 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.202260    5946 plugin_watcher.go:53] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Oct 31 00:34:19.202396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.202358    5946 plugin_watcher.go:201] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Oct 31 00:34:19.202477 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.202411    5946 plugin_manager.go:119] "The desired_state_of_world populator (plugin watcher) starts"
Oct 31 00:34:19.202477 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.202419    5946 plugin_manager.go:121] "Starting Kubelet Plugin Manager"
Oct 31 00:34:19.202564 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.202476    5946 reconciler.go:167] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-10-31T00:34:19.202394416Z","UUID":"034028f9-da63-470e-80c1-99f7a4b0c67e","Handler":null,"Name":"","Endpoint":""}
Oct 31 00:34:19.204439 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:19.204420    5946 eviction_manager.go:272] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Oct 31 00:34:19.209583 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.209559    5946 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Oct 31 00:34:19.209583 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.209583    5946 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Oct 31 00:34:19.302526 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.302495    5946 kubelet_node_status.go:388] "Setting node annotation to enable volume controller attach/detach"
Oct 31 00:34:19.304689 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.304671    5946 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasSufficientMemory"
Oct 31 00:34:19.304780 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.304700    5946 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasNoDiskPressure"
Oct 31 00:34:19.304780 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.304711    5946 kubelet_node_status.go:683] "Recording event message for node" node="ip-10-0-143-7.us-east-2.compute.internal" event="NodeHasSufficientPID"
Oct 31 00:34:19.304780 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.304758    5946 kubelet_node_status.go:77] "Attempting to register node" node="ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:19.316800 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.316780    5946 kubelet_node_status.go:126] "Node was previously registered" node="ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:19.316863 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.316841    5946 kubelet_node_status.go:80] "Successfully registered node" node="ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:19.348464 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.348419    5946 kubelet.go:2608] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal"]
Oct 31 00:34:19.349102 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.349062    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal" event={"ID":"b5ed8cacd37cfc52fe028fc738a55eb8","Type":"ContainerStarted","Data":"00b94a638f11f3d5cb8618939f99e08e5b305c8c4ba21f4daea7f16004c20ef1"}
Oct 31 00:34:19.349198 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.349111    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal" event={"ID":"b5ed8cacd37cfc52fe028fc738a55eb8","Type":"ContainerStarted","Data":"8f9aad4a22467b6b1f05aee4d3026871f1cc98a52c3f301d1c1ddb0cde549352"}
Oct 31 00:34:19.349198 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.349126    5946 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:19.349198 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.349173    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal" event={"ID":"483afccfa0bddca2d4a120103d33e513","Type":"ContainerStarted","Data":"8ede57a17f63491259a41abd2cc98d1903e58e4f870635559c9f81e85324616a"}
Oct 31 00:34:19.349198 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.349193    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal" event={"ID":"483afccfa0bddca2d4a120103d33e513","Type":"ContainerDied","Data":"9107a5fa6d6e859dd55e66bec7bbf7356b4fb325f4ed80623821dc9c28f5bc8d"}
Oct 31 00:34:19.349424 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.349211    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal" event={"ID":"483afccfa0bddca2d4a120103d33e513","Type":"ContainerStarted","Data":"a33a4ec8d8ae616c47c8b62e20445a8474a9fc60f2986e0b1a5ded0ba841b466"}
Oct 31 00:34:19.349468 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.349455    5946 kubelet.go:3368] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:19.362797 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.362777    5946 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:34:19.362854 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:19.362814    5946 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:19.363280 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.363267    5946 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:34:19.363312 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:19.363301    5946 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:19.439869 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.439807    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/483afccfa0bddca2d4a120103d33e513-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal\" (UID: \"483afccfa0bddca2d4a120103d33e513\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:19.439869 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.439839    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/483afccfa0bddca2d4a120103d33e513-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal\" (UID: \"483afccfa0bddca2d4a120103d33e513\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:19.439869 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.439856    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b5ed8cacd37cfc52fe028fc738a55eb8-config\") pod \"kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal\" (UID: \"b5ed8cacd37cfc52fe028fc738a55eb8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:19.540400 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.540361    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/483afccfa0bddca2d4a120103d33e513-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal\" (UID: \"483afccfa0bddca2d4a120103d33e513\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:19.540513 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.540410    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/483afccfa0bddca2d4a120103d33e513-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal\" (UID: \"483afccfa0bddca2d4a120103d33e513\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:19.540513 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.540438    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b5ed8cacd37cfc52fe028fc738a55eb8-config\") pod \"kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal\" (UID: \"b5ed8cacd37cfc52fe028fc738a55eb8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:19.540513 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.540463    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/483afccfa0bddca2d4a120103d33e513-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal\" (UID: \"483afccfa0bddca2d4a120103d33e513\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:19.540513 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.540487    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b5ed8cacd37cfc52fe028fc738a55eb8-config\") pod \"kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal\" (UID: \"b5ed8cacd37cfc52fe028fc738a55eb8\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:19.540658 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:19.540532    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/483afccfa0bddca2d4a120103d33e513-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal\" (UID: \"483afccfa0bddca2d4a120103d33e513\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:20.001075 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.001039    5946 apiserver.go:52] "Watching apiserver"
Oct 31 00:34:20.009392 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.009370    5946 reflector.go:446] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Oct 31 00:34:20.010186 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.010160    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ws48k","openshift-monitoring/node-exporter-cxblw","openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n","openshift-multus/network-metrics-daemon-wcnrx","openshift-image-registry/node-ca-4pdvd","openshift-monitoring/prometheus-operator-9cd89b74c-khkq6","openshift-insights/insights-runtime-extractor-szr5z","openshift-network-operator/iptables-alerter-jsw5n","openshift-ovn-kubernetes/ovnkube-node-knmm8","openshift-console/console-579b9db4b-hb7q9","openshift-network-diagnostics/network-check-target-wf75m","openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt","openshift-cluster-node-tuning-operator/tuned-mxsc9","openshift-console/console-7b5d6654d7-rbxn5","openshift-dns/node-resolver-4pvl9","openshift-monitoring/monitoring-plugin-77f4f76594-67n7t","openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8","openshift-monitoring/alertmanager-main-0","kube-system/kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal","openshift-ingress-canary/ingress-canary-5sqlr","kube-system/global-pull-secret-syncer-zdznl","openshift-monitoring/prometheus-k8s-0","openshift-multus/multus-additional-cni-plugins-dbnzk","kube-system/konnectivity-agent-p2ntf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal","openshift-multus/multus-j7x85","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"]
Oct 31 00:34:20.014650 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.014621    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:34:20.015032 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.015007    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Oct 31 00:34:20.015133 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.015062    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Oct 31 00:34:20.015307 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.015288    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Oct 31 00:34:20.015413 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.015338    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jwzf5\""
Oct 31 00:34:20.015477 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.015463    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-kxg2f\""
Oct 31 00:34:20.015619 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.015589    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Oct 31 00:34:20.015986 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.015964    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-node-identity-dockercfg-k5rkn\""
Oct 31 00:34:20.015986 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.015972    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Oct 31 00:34:20.016137 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.016015    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Oct 31 00:34:20.016137 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.016130    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Oct 31 00:34:20.016835 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.016815    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Oct 31 00:34:20.017080 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.017062    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Oct 31 00:34:20.017295 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.017277    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Oct 31 00:34:20.017386 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.017281    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-87knn\""
Oct 31 00:34:20.017513 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.017493    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Oct 31 00:34:20.017697 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.017682    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent-dockercfg-8fmps\""
Oct 31 00:34:20.017792 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.017756    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-hkzgb\""
Oct 31 00:34:20.017846 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.017833    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Oct 31 00:34:20.017884 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.017863    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Oct 31 00:34:20.017976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.017963    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Oct 31 00:34:20.018112 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.018097    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lfknl\""
Oct 31 00:34:20.018148 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.018099    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Oct 31 00:34:20.018148 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.018146    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Oct 31 00:34:20.018844 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.018828    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Oct 31 00:34:20.018940 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.018923    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Oct 31 00:34:20.019010 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.018994    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:34:20.019050 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.019006    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cvzdq\""
Oct 31 00:34:20.019293 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.019276    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b29sj\""
Oct 31 00:34:20.020279 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.020264    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Oct 31 00:34:20.020479 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.020465    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"global-pull-secret-syncer-dockercfg-v94lw\""
Oct 31 00:34:20.020552 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.020494    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Oct 31 00:34:20.020552 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.020541    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Oct 31 00:34:20.020828 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.020809    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-check-target-dockercfg-qhb2k\""
Oct 31 00:34:20.020913 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.020847    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Oct 31 00:34:20.020913 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.020856    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Oct 31 00:34:20.020913 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.020896    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Oct 31 00:34:20.020913 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.020911    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Oct 31 00:34:20.021100 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.020935    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Oct 31 00:34:20.021343 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.021323    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Oct 31 00:34:20.021423 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.021389    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Oct 31 00:34:20.021514 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.021498    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ppkcp\""
Oct 31 00:34:20.021692 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.021654    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Oct 31 00:34:20.021785 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.021767    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Oct 31 00:34:20.021880 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.021867    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Oct 31 00:34:20.021936 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.021875    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Oct 31 00:34:20.021936 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.021918    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Oct 31 00:34:20.022027 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.021961    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6p62k\""
Oct 31 00:34:20.022136 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.022024    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Oct 31 00:34:20.022136 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.022099    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Oct 31 00:34:20.022295 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.022277    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kh74f\""
Oct 31 00:34:20.022695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.022679    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Oct 31 00:34:20.022746 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.022680    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Oct 31 00:34:20.022746 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.022683    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Oct 31 00:34:20.023387 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.023368    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"ingress-canary-dockercfg-hwf9w\""
Oct 31 00:34:20.024839 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.024819    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-sf9lg\""
Oct 31 00:34:20.042031 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042008    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-sys\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.042160 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042043    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-run-netns\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.042160 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042074    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-daemon-config\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.042160 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042134    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-run-multus-certs\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.042320 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042183    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-etc-kubernetes\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.042320 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042235    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/90fdba20-20ae-405d-bd58-0756cc1fdcad-kubelet-config\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:34:20.042320 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042281    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-run-ovn\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.042434 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042320    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bd3d849-76a8-410d-8aa1-400e57cbaded-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:34:20.042434 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042339    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-daemon-config\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.042434 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042365    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww699\" (UniqueName: \"kubernetes.io/projected/8f7af1c9-c623-41f4-8923-ea931d7c08ab-kube-api-access-ww699\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.042434 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042426    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:20.042622 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042479    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9gng\" (UniqueName: \"kubernetes.io/projected/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-kube-api-access-v9gng\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:34:20.042622 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.042544    5946 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:20.042622 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042581    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.042774 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042620    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-tmp-dir\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:34:20.042774 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042675    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hd475\" (UniqueName: \"kubernetes.io/projected/c9248850-deda-4b75-b652-9f26255812f8-kube-api-access-hd475\") pod \"ingress-canary-5sqlr\" (UID: \"c9248850-deda-4b75-b652-9f26255812f8\") " pod="openshift-ingress-canary/ingress-canary-5sqlr"
Oct 31 00:34:20.042774 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.042712    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:20.542671681 +0000 UTC m=+1.615711754 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:20.042774 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042722    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-tmp-dir\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:34:20.042774 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042742    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-modprobe-d\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.043019 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042776    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-conf-dir\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.043019 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042803    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:20.043019 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042838    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-host\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.043019 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.042858    5946 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:20.043019 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042862    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-thmlk\" (UniqueName: \"kubernetes.io/projected/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-kube-api-access-thmlk\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.043019 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042878    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-cnibin\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.043019 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.042894    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-var-lib-cni-bin\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.043019 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.042917    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:20.542901357 +0000 UTC m=+1.615941437 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:20.043373 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043062    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-var-lib-openvswitch\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.043373 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043095    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-log-socket\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.043373 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043171    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bd3d849-76a8-410d-8aa1-400e57cbaded-cni-binary-copy\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:34:20.043373 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043250    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psclh\" (UniqueName: \"kubernetes.io/projected/6bd3d849-76a8-410d-8aa1-400e57cbaded-kube-api-access-psclh\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:34:20.043373 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043297    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-system-cni-dir\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.043373 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043321    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-hostroot\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.043976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043379    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6bd3d849-76a8-410d-8aa1-400e57cbaded-cni-binary-copy\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:34:20.043976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043392    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66f8ebac-f187-49d1-acf8-ec86c904c475-serviceca\") pod \"node-ca-4pdvd\" (UID: \"66f8ebac-f187-49d1-acf8-ec86c904c475\") " pod="openshift-image-registry/node-ca-4pdvd"
Oct 31 00:34:20.043976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043465    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-cni-bin\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.043976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043510    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e1748202-4b8b-4c5d-891e-5f68728124ea-ovnkube-script-lib\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.043976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043526    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c55ac10a-0189-4764-b828-098f9ea03f75-crio-socket\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:34:20.043976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043571    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c55ac10a-0189-4764-b828-098f9ea03f75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:34:20.043976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043595    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01-konnectivity-ca\") pod \"konnectivity-agent-p2ntf\" (UID: \"7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01\") " pod="kube-system/konnectivity-agent-p2ntf"
Oct 31 00:34:20.043976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043618    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0420aed9-f163-474d-a19f-2db0bfdb32e6-hosts-file\") pod \"node-resolver-4pvl9\" (UID: \"0420aed9-f163-474d-a19f-2db0bfdb32e6\") " pod="openshift-dns/node-resolver-4pvl9"
Oct 31 00:34:20.043976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043632    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-device-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.043976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043654    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crwrm\" (UniqueName: \"kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:20.043976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043688    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-node-log\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.043976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043775    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c55ac10a-0189-4764-b828-098f9ea03f75-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:34:20.043976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043827    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01-konnectivity-ca\") pod \"konnectivity-agent-p2ntf\" (UID: \"7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01\") " pod="kube-system/konnectivity-agent-p2ntf"
Oct 31 00:34:20.043976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043844    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfw9h\" (UniqueName: \"kubernetes.io/projected/c55ac10a-0189-4764-b828-098f9ea03f75-kube-api-access-wfw9h\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:34:20.043976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043858    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/66f8ebac-f187-49d1-acf8-ec86c904c475-serviceca\") pod \"node-ca-4pdvd\" (UID: \"66f8ebac-f187-49d1-acf8-ec86c904c475\") " pod="openshift-image-registry/node-ca-4pdvd"
Oct 31 00:34:20.043976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043903    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-systemd\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.043976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043930    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-var-lib-kubelet\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.043976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043961    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e1748202-4b8b-4c5d-891e-5f68728124ea-ovnkube-script-lib\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.043984    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llfdt\" (UniqueName: \"kubernetes.io/projected/45efeeda-0c9c-461c-bb19-c43de5b9566a-kube-api-access-llfdt\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044023    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66f8ebac-f187-49d1-acf8-ec86c904c475-host\") pod \"node-ca-4pdvd\" (UID: \"66f8ebac-f187-49d1-acf8-ec86c904c475\") " pod="openshift-image-registry/node-ca-4pdvd"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044050    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044092    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-run-netns\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.044108    5946 configmap.go:193] Couldn't get configMap openshift-console/service-ca: object "openshift-console"/"service-ca" not registered
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044154    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-lib-modules\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.044168    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:20.544154068 +0000 UTC m=+1.617194131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"service-ca" not registered
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044200    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6bd3d849-76a8-410d-8aa1-400e57cbaded-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044233    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs\") pod \"network-metrics-daemon-wcnrx\" (UID: \"0883a925-b7f8-44b8-a889-4d3cc5af9fe8\") " pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044250    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/90fdba20-20ae-405d-bd58-0756cc1fdcad-dbus\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044265    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-cni-netd\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044288    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e1748202-4b8b-4c5d-891e-5f68728124ea-ovnkube-config\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044336    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-metrics-tls\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044371    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-sysctl-conf\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044385    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6bd3d849-76a8-410d-8aa1-400e57cbaded-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044400    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bd3d849-76a8-410d-8aa1-400e57cbaded-cnibin\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044443    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0420aed9-f163-474d-a19f-2db0bfdb32e6-tmp-dir\") pod \"node-resolver-4pvl9\" (UID: \"0420aed9-f163-474d-a19f-2db0bfdb32e6\") " pod="openshift-dns/node-resolver-4pvl9"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044467    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-metrics-certs\") pod \"network-metrics-daemon-wcnrx\" (UID: \"0883a925-b7f8-44b8-a889-4d3cc5af9fe8\") " pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044485    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-sys-fs\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044523    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw7nf\" (UniqueName: \"kubernetes.io/projected/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-kube-api-access-gw7nf\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044550    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e1748202-4b8b-4c5d-891e-5f68728124ea-ovnkube-config\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.044573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044553    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-metrics-tls\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044586    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b7e45fa-6f09-4d02-bc42-e89d46d954b6-host-slash\") pod \"iptables-alerter-jsw5n\" (UID: \"0b7e45fa-6f09-4d02-bc42-e89d46d954b6\") " pod="openshift-network-operator/iptables-alerter-jsw5n"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044570    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0420aed9-f163-474d-a19f-2db0bfdb32e6-tmp-dir\") pod \"node-resolver-4pvl9\" (UID: \"0420aed9-f163-474d-a19f-2db0bfdb32e6\") " pod="openshift-dns/node-resolver-4pvl9"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044625    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044683    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.044703    5946 configmap.go:193] Couldn't get configMap openshift-console/console-config: object "openshift-console"/"console-config" not registered
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.044737    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:20.544728203 +0000 UTC m=+1.617768275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"console-config" not registered
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044759    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-kubelet\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044779    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-config-volume\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044794    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-tmp\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044830    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmwt7\" (UniqueName: \"kubernetes.io/projected/0420aed9-f163-474d-a19f-2db0bfdb32e6-kube-api-access-qmwt7\") pod \"node-resolver-4pvl9\" (UID: \"0420aed9-f163-474d-a19f-2db0bfdb32e6\") " pod="openshift-dns/node-resolver-4pvl9"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044859    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4spf\" (UniqueName: \"kubernetes.io/projected/66f8ebac-f187-49d1-acf8-ec86c904c475-kube-api-access-w4spf\") pod \"node-ca-4pdvd\" (UID: \"66f8ebac-f187-49d1-acf8-ec86c904c475\") " pod="openshift-image-registry/node-ca-4pdvd"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044883    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-tmp\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044886    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044916    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k422l\" (UniqueName: \"kubernetes.io/projected/e1748202-4b8b-4c5d-891e-5f68728124ea-kube-api-access-k422l\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.044932    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-sysctl-d\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045003    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-config-volume\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045044    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-run\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045064    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-tuned\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045086    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f7af1c9-c623-41f4-8923-ea931d7c08ab-cni-binary-copy\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045106    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b7e45fa-6f09-4d02-bc42-e89d46d954b6-iptables-alerter-script\") pod \"iptables-alerter-jsw5n\" (UID: \"0b7e45fa-6f09-4d02-bc42-e89d46d954b6\") " pod="openshift-network-operator/iptables-alerter-jsw5n"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045121    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m5kc\" (UniqueName: \"kubernetes.io/projected/0b7e45fa-6f09-4d02-bc42-e89d46d954b6-kube-api-access-5m5kc\") pod \"iptables-alerter-jsw5n\" (UID: \"0b7e45fa-6f09-4d02-bc42-e89d46d954b6\") " pod="openshift-network-operator/iptables-alerter-jsw5n"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045136    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045154    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/610ed88a-261c-4503-b776-4a0c20b6cb07-tmp\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045154    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-tuned\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045247    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e1748202-4b8b-4c5d-891e-5f68728124ea-env-overrides\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045251    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/610ed88a-261c-4503-b776-4a0c20b6cb07-tmp\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045273    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9248850-deda-4b75-b652-9f26255812f8-cert\") pod \"ingress-canary-5sqlr\" (UID: \"c9248850-deda-4b75-b652-9f26255812f8\") " pod="openshift-ingress-canary/ingress-canary-5sqlr"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045298    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-run-k8s-cni-cncf-io\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045300    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8f7af1c9-c623-41f4-8923-ea931d7c08ab-cni-binary-copy\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045344    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/0b7e45fa-6f09-4d02-bc42-e89d46d954b6-iptables-alerter-script\") pod \"iptables-alerter-jsw5n\" (UID: \"0b7e45fa-6f09-4d02-bc42-e89d46d954b6\") " pod="openshift-network-operator/iptables-alerter-jsw5n"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045350    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01-agent-certs\") pod \"konnectivity-agent-p2ntf\" (UID: \"7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01\") " pod="kube-system/konnectivity-agent-p2ntf"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045386    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-socket-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045408    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-registration-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045423    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e1748202-4b8b-4c5d-891e-5f68728124ea-env-overrides\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045431    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-etc-selinux\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045477    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9248850-deda-4b75-b652-9f26255812f8-cert\") pod \"ingress-canary-5sqlr\" (UID: \"c9248850-deda-4b75-b652-9f26255812f8\") " pod="openshift-ingress-canary/ingress-canary-5sqlr"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045476    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-run-openvswitch\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045506    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f68jv\" (UniqueName: \"kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv\") pod \"network-check-target-wf75m\" (UID: \"26ab7116-31a7-404c-8a01-6502edf9f5ce\") " pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045525    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5sj7\" (UniqueName: \"kubernetes.io/projected/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-kube-api-access-m5sj7\") pod \"network-metrics-daemon-wcnrx\" (UID: \"0883a925-b7f8-44b8-a889-4d3cc5af9fe8\") " pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045545    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/90fdba20-20ae-405d-bd58-0756cc1fdcad-original-pull-secret\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045559    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045585    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-etc-openvswitch\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045614    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-kubernetes\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045619    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01-agent-certs\") pod \"konnectivity-agent-p2ntf\" (UID: \"7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01\") " pod="kube-system/konnectivity-agent-p2ntf"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045630    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-var-lib-kubelet\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045658    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bd3d849-76a8-410d-8aa1-400e57cbaded-system-cni-dir\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045723    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6bd3d849-76a8-410d-8aa1-400e57cbaded-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:34:20.045721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045757    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-cni-dir\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.047127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045775    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-socket-dir-parent\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.047127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045811    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-var-lib-cni-multus\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.047127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045839    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.047127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045894    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:34:20.047127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045912    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-systemd-units\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.047127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045919    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6bd3d849-76a8-410d-8aa1-400e57cbaded-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:34:20.047127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045927    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1748202-4b8b-4c5d-891e-5f68728124ea-ovn-node-metrics-cert\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.047127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.045972    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c55ac10a-0189-4764-b828-098f9ea03f75-data-volume\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:34:20.047127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.046001    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:20.047127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.046026    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-slash\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.047127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.046051    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-run-systemd\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.047127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.046084    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1748202-4b8b-4c5d-891e-5f68728124ea-ovn-node-metrics-cert\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.047127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.046086    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c55ac10a-0189-4764-b828-098f9ea03f75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:34:20.047127 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.046098    5946 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:20.047127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.046082    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c55ac10a-0189-4764-b828-098f9ea03f75-data-volume\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:34:20.047127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.046118    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-sysconfig\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.047127 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.046243    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:20.54620524 +0000 UTC m=+1.619245320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:20.047127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.046345    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c55ac10a-0189-4764-b828-098f9ea03f75-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:34:20.053090 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.053069    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thmlk\" (UniqueName: \"kubernetes.io/projected/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-kube-api-access-thmlk\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.053243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.053203    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww699\" (UniqueName: \"kubernetes.io/projected/8f7af1c9-c623-41f4-8923-ea931d7c08ab-kube-api-access-ww699\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.053308 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.053279    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-psclh\" (UniqueName: \"kubernetes.io/projected/6bd3d849-76a8-410d-8aa1-400e57cbaded-kube-api-access-psclh\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:34:20.053457 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.053436    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hd475\" (UniqueName: \"kubernetes.io/projected/c9248850-deda-4b75-b652-9f26255812f8-kube-api-access-hd475\") pod \"ingress-canary-5sqlr\" (UID: \"c9248850-deda-4b75-b652-9f26255812f8\") " pod="openshift-ingress-canary/ingress-canary-5sqlr"
Oct 31 00:34:20.053533 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.053453    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw7nf\" (UniqueName: \"kubernetes.io/projected/7a2e0e44-ffc6-4199-903b-4eae5ad5aefb-kube-api-access-gw7nf\") pod \"dns-default-ws48k\" (UID: \"7a2e0e44-ffc6-4199-903b-4eae5ad5aefb\") " pod="openshift-dns/dns-default-ws48k"
Oct 31 00:34:20.053685 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.053665    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f68jv\" (UniqueName: \"kubernetes.io/projected/26ab7116-31a7-404c-8a01-6502edf9f5ce-kube-api-access-f68jv\") pod \"network-check-target-wf75m\" (UID: \"26ab7116-31a7-404c-8a01-6502edf9f5ce\") " pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:34:20.053767 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.053689    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4spf\" (UniqueName: \"kubernetes.io/projected/66f8ebac-f187-49d1-acf8-ec86c904c475-kube-api-access-w4spf\") pod \"node-ca-4pdvd\" (UID: \"66f8ebac-f187-49d1-acf8-ec86c904c475\") " pod="openshift-image-registry/node-ca-4pdvd"
Oct 31 00:34:20.053767 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.053749    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5sj7\" (UniqueName: \"kubernetes.io/projected/0883a925-b7f8-44b8-a889-4d3cc5af9fe8-kube-api-access-m5sj7\") pod \"network-metrics-daemon-wcnrx\" (UID: \"0883a925-b7f8-44b8-a889-4d3cc5af9fe8\") " pod="openshift-multus/network-metrics-daemon-wcnrx"
Oct 31 00:34:20.053841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.053764    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmwt7\" (UniqueName: \"kubernetes.io/projected/0420aed9-f163-474d-a19f-2db0bfdb32e6-kube-api-access-qmwt7\") pod \"node-resolver-4pvl9\" (UID: \"0420aed9-f163-474d-a19f-2db0bfdb32e6\") " pod="openshift-dns/node-resolver-4pvl9"
Oct 31 00:34:20.054008 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.053992    5946 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: object "openshift-console"/"kube-root-ca.crt" not registered
Oct 31 00:34:20.054054 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.054014    5946 projected.go:291] Couldn't get configMap openshift-console/openshift-service-ca.crt: object "openshift-console"/"openshift-service-ca.crt" not registered
Oct 31 00:34:20.054054 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.054028    5946 projected.go:196] Error preparing data for projected volume kube-api-access-crwrm for pod openshift-console/console-579b9db4b-hb7q9: [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:20.054054 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.054037    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m5kc\" (UniqueName: \"kubernetes.io/projected/0b7e45fa-6f09-4d02-bc42-e89d46d954b6-kube-api-access-5m5kc\") pod \"iptables-alerter-jsw5n\" (UID: \"0b7e45fa-6f09-4d02-bc42-e89d46d954b6\") " pod="openshift-network-operator/iptables-alerter-jsw5n"
Oct 31 00:34:20.054154 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.054041    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-llfdt\" (UniqueName: \"kubernetes.io/projected/45efeeda-0c9c-461c-bb19-c43de5b9566a-kube-api-access-llfdt\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.054154 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.054097    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:20.554083384 +0000 UTC m=+1.627123463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-crwrm" (UniqueName: "kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:20.054344 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.054308    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k422l\" (UniqueName: \"kubernetes.io/projected/e1748202-4b8b-4c5d-891e-5f68728124ea-kube-api-access-k422l\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.055181 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.055165    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfw9h\" (UniqueName: \"kubernetes.io/projected/c55ac10a-0189-4764-b828-098f9ea03f75-kube-api-access-wfw9h\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:34:20.114943 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.114918    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Oct 31 00:34:20.115470 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.115250    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 31 00:34:20.115470 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.115252    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Oct 31 00:34:20.115470 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.115437    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Oct 31 00:34:20.115689 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.115665    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Oct 31 00:34:20.116139 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.115943    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 31 00:34:20.116139 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.115977    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 31 00:34:20.116139 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.115992    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Oct 31 00:34:20.116139 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.116027    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Oct 31 00:34:20.116139 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.116029    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Oct 31 00:34:20.116139 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.116041    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Oct 31 00:34:20.116139 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.116042    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 31 00:34:20.116139 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.116055    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Oct 31 00:34:20.116139 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.116091    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Oct 31 00:34:20.116139 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.116132    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 31 00:34:20.116606 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.116208    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-metrics-client-ca\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:34:20.116606 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.116400    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 31 00:34:20.116606 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.116449    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Oct 31 00:34:20.116606 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.116461    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 31 00:34:20.116606 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.116470    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tztrh\""
Oct 31 00:34:20.116606 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.116471    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 31 00:34:20.116606 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.116532    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Oct 31 00:34:20.116879 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.116766    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 31 00:34:20.116879 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.116776    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 31 00:34:20.116879 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.116769    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 31 00:34:20.117025 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.116926    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Oct 31 00:34:20.117204 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117189    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 31 00:34:20.117300 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117211    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 31 00:34:20.117300 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117255    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 31 00:34:20.117300 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117237    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Oct 31 00:34:20.117300 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117282    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 31 00:34:20.117300 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117282    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 31 00:34:20.117300 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117297    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 31 00:34:20.117610 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117310    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 31 00:34:20.117610 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117465    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Oct 31 00:34:20.117610 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117500    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 31 00:34:20.117610 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117535    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-p9q7z\""
Oct 31 00:34:20.117610 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117540    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Oct 31 00:34:20.117610 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117547    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-vpdhx\""
Oct 31 00:34:20.117610 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117535    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Oct 31 00:34:20.117610 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117563    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-kgtx2\""
Oct 31 00:34:20.117610 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117579    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xhskg\""
Oct 31 00:34:20.117610 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117584    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-96j6jpgdnbr1c\""
Oct 31 00:34:20.117960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117623    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Oct 31 00:34:20.117960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117623    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vfg6j\""
Oct 31 00:34:20.117960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117936    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 31 00:34:20.118090 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.117987    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Oct 31 00:34:20.118090 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.118015    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8dk9u6m88n9h1\""
Oct 31 00:34:20.118090 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.118077    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-nch2p\""
Oct 31 00:34:20.118373 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.118290    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 31 00:34:20.122385 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.122359    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 31 00:34:20.123769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.123750    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9gng\" (UniqueName: \"kubernetes.io/projected/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-kube-api-access-v9gng\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:34:20.124163 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.124141    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 31 00:34:20.125188 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.125164    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:34:20.126173 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.126144    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4-prometheus-operator-tls\") pod \"prometheus-operator-9cd89b74c-khkq6\" (UID: \"cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4\") " pod="openshift-monitoring/prometheus-operator-9cd89b74c-khkq6"
Oct 31 00:34:20.126606 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.126586    5946 kubelet.go:3368] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:20.126691 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.126674    5946 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Oct 31 00:34:20.126953 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.126935    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 31 00:34:20.136913 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.136893    5946 warnings.go:107] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Oct 31 00:34:20.136992 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.136943    5946 kubelet.go:3370] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-7.us-east-2.compute.internal"
Oct 31 00:34:20.147051 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147032    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:20.147127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147057    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.147127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147073    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.147127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147090    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.147127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147105    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-sysctl-d\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.147359 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147187    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-run-ovn-kubernetes\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.147359 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147214    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-sysctl-d\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.147359 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147257    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-run\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.147359 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147299    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-web-config\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.147359 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147312    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:20.147359 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147333    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.147359 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147336    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-run\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.147359 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147333    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147377    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82fa81b0-268b-497e-acc1-ac9eb4a97afb-metrics-client-ca\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147395    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-socket-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147416    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-registration-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147425    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147442    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147468    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctxjg\" (UniqueName: \"kubernetes.io/projected/c68937ea-3c3b-46d1-9646-a9fa24c89cde-kube-api-access-ctxjg\") pod \"monitoring-plugin-77f4f76594-67n7t\" (UID: \"c68937ea-3c3b-46d1-9646-a9fa24c89cde\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-67n7t"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147474    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-socket-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147495    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-kubernetes\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147501    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-registration-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147511    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-web-config\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147555    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-kubernetes\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147523    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147517    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147589    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-grpc-tls\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147603    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/82fa81b0-268b-497e-acc1-ac9eb4a97afb-metrics-client-ca\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147631    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147658    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-cni-dir\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147685    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-state-metrics-tls\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:34:20.147695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147687    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147723    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-systemd-units\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147748    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-sys\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147761    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-cni-dir\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147767    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbwmm\" (UniqueName: \"kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-kube-api-access-qbwmm\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147811    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-grpc-tls\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147818    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kz46w\" (UniqueName: \"kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-kube-api-access-kz46w\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147814    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-systemd-units\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147836    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-sys\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147844    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147895    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-tls\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147930    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147925    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.147966    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148077    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-tls\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148151    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148185    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-modprobe-d\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148208    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148238    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148355    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-modprobe-d\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148362    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148383    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-conf-dir\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148407    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148423    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-cnibin\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148437    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-log-socket\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148455    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-accelerators-collector-config\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148484    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zlq92\" (UniqueName: \"kubernetes.io/projected/506537b2-c447-4523-95f5-a53bdc768c84-kube-api-access-zlq92\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148487    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-cnibin\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148495    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-conf-dir\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148504    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-log-socket\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148525    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148551    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148575    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148577    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148600    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-system-cni-dir\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148663    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-cni-bin\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.148657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148669    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config-out\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148683    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-accelerators-collector-config\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.148692    5946 configmap.go:193] Couldn't get configMap openshift-console/trusted-ca-bundle: object "openshift-console"/"trusted-ca-bundle" not registered
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148700    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c55ac10a-0189-4764-b828-098f9ea03f75-crio-socket\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148717    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148727    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148733    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-system-cni-dir\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.148749    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:20.648733203 +0000 UTC m=+1.721773275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"trusted-ca-bundle" not registered
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148748    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-cni-bin\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148781    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148790    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c55ac10a-0189-4764-b828-098f9ea03f75-crio-socket\") pod \"insights-runtime-extractor-szr5z\" (UID: \"c55ac10a-0189-4764-b828-098f9ea03f75\") " pod="openshift-insights/insights-runtime-extractor-szr5z"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148807    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148836    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-device-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148887    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-device-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.148912    5946 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148938    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148949    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghc8q\" (UniqueName: \"kubernetes.io/projected/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-api-access-ghc8q\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.148981    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.148996    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:20.648957561 +0000 UTC m=+1.721997634 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149040    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149068    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-var-lib-kubelet\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149118    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-var-lib-kubelet\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149169    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66f8ebac-f187-49d1-acf8-ec86c904c475-host\") pod \"node-ca-4pdvd\" (UID: \"66f8ebac-f187-49d1-acf8-ec86c904c475\") " pod="openshift-image-registry/node-ca-4pdvd"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149212    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/90fdba20-20ae-405d-bd58-0756cc1fdcad-dbus\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149252    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-sysctl-conf\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149258    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/66f8ebac-f187-49d1-acf8-ec86c904c475-host\") pod \"node-ca-4pdvd\" (UID: \"66f8ebac-f187-49d1-acf8-ec86c904c475\") " pod="openshift-image-registry/node-ca-4pdvd"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149262    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149278    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149313    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/90fdba20-20ae-405d-bd58-0756cc1fdcad-dbus\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149366    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149394    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149410    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-sysctl-conf\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149420    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149542    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149584    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sv6t\" (UniqueName: \"kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149611    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149617    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b7e45fa-6f09-4d02-bc42-e89d46d954b6-host-slash\") pod \"iptables-alerter-jsw5n\" (UID: \"0b7e45fa-6f09-4d02-bc42-e89d46d954b6\") " pod="openshift-network-operator/iptables-alerter-jsw5n"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149644    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-metrics-client-ca\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149645    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149651    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/0b7e45fa-6f09-4d02-bc42-e89d46d954b6-host-slash\") pod \"iptables-alerter-jsw5n\" (UID: \"0b7e45fa-6f09-4d02-bc42-e89d46d954b6\") " pod="openshift-network-operator/iptables-alerter-jsw5n"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149690    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149717    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-out\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149742    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149772    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149801    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149833    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-out\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.149872    5946 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149877    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-tls-assets\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149918    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4798203-046e-4ad4-842d-a211d905cd74-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.149926    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:20.649910941 +0000 UTC m=+1.722951015 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149952    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149955    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-run-k8s-cni-cncf-io\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149977    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149986    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-run-k8s-cni-cncf-io\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.149998    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-etc-selinux\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150026    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-run-openvswitch\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150055    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150065    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-etc-selinux\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150085    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150092    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-run-openvswitch\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.150048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150085    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4798203-046e-4ad4-842d-a211d905cd74-metrics-client-ca\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150181    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4798203-046e-4ad4-842d-a211d905cd74-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150197    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-etc-openvswitch\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150257    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-var-lib-kubelet\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150267    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-web-config\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150285    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bd3d849-76a8-410d-8aa1-400e57cbaded-system-cni-dir\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150285    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150304    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-etc-openvswitch\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150311    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150345    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-tmp\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150347    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6bd3d849-76a8-410d-8aa1-400e57cbaded-system-cni-dir\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150378    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-socket-dir-parent\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150357    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-var-lib-kubelet\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150408    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-var-lib-cni-multus\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150427    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e4798203-046e-4ad4-842d-a211d905cd74-openshift-state-metrics-tls\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150441    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150461    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-multus-socket-dir-parent\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150471    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/506537b2-c447-4523-95f5-a53bdc768c84-metrics-client-ca\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150498    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150501    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-volume\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150470    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-tmp\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150509    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-var-lib-cni-multus\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150527    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150588    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-volume-directive-shadow\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150617    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150736    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-volume\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.150922    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/506537b2-c447-4523-95f5-a53bdc768c84-metrics-client-ca\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151439    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151470    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-slash\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151495    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-run-systemd\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151517    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-sysconfig\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151539    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c68937ea-3c3b-46d1-9646-a9fa24c89cde-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-67n7t\" (UID: \"c68937ea-3c3b-46d1-9646-a9fa24c89cde\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-67n7t"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151565    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlwjc\" (UniqueName: \"kubernetes.io/projected/e4798203-046e-4ad4-842d-a211d905cd74-kube-api-access-wlwjc\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151586    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151606    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-run-netns\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151628    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-run-multus-certs\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151649    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-etc-kubernetes\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151692    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/90fdba20-20ae-405d-bd58-0756cc1fdcad-kubelet-config\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151707    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-run-ovn\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151729    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bd3d849-76a8-410d-8aa1-400e57cbaded-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151746    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/506537b2-c447-4523-95f5-a53bdc768c84-root\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151760    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82fa81b0-268b-497e-acc1-ac9eb4a97afb-tmp\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151780    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151797    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151812    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-host\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151851    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151866    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-var-lib-cni-bin\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151881    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-var-lib-openvswitch\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151881    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151898    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-tls\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151920    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2mh5\" (UniqueName: \"kubernetes.io/projected/82fa81b0-268b-497e-acc1-ac9eb4a97afb-kube-api-access-j2mh5\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151945    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151951    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/90fdba20-20ae-405d-bd58-0756cc1fdcad-kubelet-config\") pod \"global-pull-secret-syncer-zdznl\" (UID: \"90fdba20-20ae-405d-bd58-0756cc1fdcad\") " pod="kube-system/global-pull-secret-syncer-zdznl"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.151965    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-hostroot\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152000    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152008    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-hostroot\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152030    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152047    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-run-ovn\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152059    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152087    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4798203-046e-4ad4-842d-a211d905cd74-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152113    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6bd3d849-76a8-410d-8aa1-400e57cbaded-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152139    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0420aed9-f163-474d-a19f-2db0bfdb32e6-hosts-file\") pod \"node-resolver-4pvl9\" (UID: \"0420aed9-f163-474d-a19f-2db0bfdb32e6\") " pod="openshift-dns/node-resolver-4pvl9"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152176    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-node-log\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152178    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/82fa81b0-268b-497e-acc1-ac9eb4a97afb-tmp\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152200    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-systemd\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152240    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152256    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-wtmp\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.152281    5946 configmap.go:193] Couldn't get configMap openshift-console/console-config: object "openshift-console"/"console-config" not registered
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152293    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-run-netns\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152319    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-lib-modules\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152339    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-host\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152346    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152375    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-cni-netd\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152389    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152403    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bd3d849-76a8-410d-8aa1-400e57cbaded-cnibin\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152419    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-var-lib-cni-bin\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152429    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/506537b2-c447-4523-95f5-a53bdc768c84-sys\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152444    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-var-lib-openvswitch\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152456    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152484    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-sys-fs\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152499    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152569    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-slash\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152617    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-run-systemd\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152620    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/82fa81b0-268b-497e-acc1-ac9eb4a97afb-secret-thanos-querier-tls\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152669    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152519    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152683    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-sysconfig\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152701    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152717    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-kubelet\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152732    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-textfile\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152749    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152886    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152892    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.152841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152905    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c68937ea-3c3b-46d1-9646-a9fa24c89cde-monitoring-plugin-cert\") pod \"monitoring-plugin-77f4f76594-67n7t\" (UID: \"c68937ea-3c3b-46d1-9646-a9fa24c89cde\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-67n7t"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.152924    5946 configmap.go:193] Couldn't get configMap openshift-console/service-ca: object "openshift-console"/"service-ca" not registered
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152927    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-node-log\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.152961    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:20.652951822 +0000 UTC m=+1.725991882 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"service-ca" not registered
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152964    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-etc-systemd\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.152986    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-kubelet\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.153018    5946 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.153039    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:20.653032206 +0000 UTC m=+1.726072304 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.153061    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-run-netns\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.153066    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-textfile\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.153087    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-host-run-multus-certs\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.153111    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8f7af1c9-c623-41f4-8923-ea931d7c08ab-etc-kubernetes\") pod \"multus-j7x85\" (UID: \"8f7af1c9-c623-41f4-8923-ea931d7c08ab\") " pod="openshift-multus/multus-j7x85"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.153136    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-cni-netd\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.153136    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.153160    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1748202-4b8b-4c5d-891e-5f68728124ea-host-run-netns\") pod \"ovnkube-node-knmm8\" (UID: \"e1748202-4b8b-4c5d-891e-5f68728124ea\") " pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.153169    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.153179    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6bd3d849-76a8-410d-8aa1-400e57cbaded-cnibin\") pod \"multus-additional-cni-plugins-dbnzk\" (UID: \"6bd3d849-76a8-410d-8aa1-400e57cbaded\") " pod="openshift-multus/multus-additional-cni-plugins-dbnzk"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.153261    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/34b2bd3f-0955-482d-bf8e-0ec7de5a226a-lib-modules\") pod \"tuned-mxsc9\" (UID: \"34b2bd3f-0955-482d-bf8e-0ec7de5a226a\") " pod="openshift-cluster-node-tuning-operator/tuned-mxsc9"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.153282    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:20.653274672 +0000 UTC m=+1.726314732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"console-config" not registered
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.153349    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.153388    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0420aed9-f163-474d-a19f-2db0bfdb32e6-hosts-file\") pod \"node-resolver-4pvl9\" (UID: \"0420aed9-f163-474d-a19f-2db0bfdb32e6\") " pod="openshift-dns/node-resolver-4pvl9"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.153442    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/45efeeda-0c9c-461c-bb19-c43de5b9566a-sys-fs\") pod \"aws-ebs-csi-driver-node-qd44t\" (UID: \"45efeeda-0c9c-461c-bb19-c43de5b9566a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-qd44t"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.153474    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4798203-046e-4ad4-842d-a211d905cd74-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.153503    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.153516    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.155876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.154609    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctxjg\" (UniqueName: \"kubernetes.io/projected/c68937ea-3c3b-46d1-9646-a9fa24c89cde-kube-api-access-ctxjg\") pod \"monitoring-plugin-77f4f76594-67n7t\" (UID: \"c68937ea-3c3b-46d1-9646-a9fa24c89cde\") " pod="openshift-monitoring/monitoring-plugin-77f4f76594-67n7t"
Oct 31 00:34:20.157056 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.156026    5946 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: object "openshift-console"/"kube-root-ca.crt" not registered
Oct 31 00:34:20.157056 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.156044    5946 projected.go:291] Couldn't get configMap openshift-console/openshift-service-ca.crt: object "openshift-console"/"openshift-service-ca.crt" not registered
Oct 31 00:34:20.157056 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.156058    5946 projected.go:196] Error preparing data for projected volume kube-api-access-8sv6t for pod openshift-console/console-7b5d6654d7-rbxn5: [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:20.157056 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.156108    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:20.656093447 +0000 UTC m=+1.729133509 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8sv6t" (UniqueName: "kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:20.157056 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.156350    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlq92\" (UniqueName: \"kubernetes.io/projected/506537b2-c447-4523-95f5-a53bdc768c84-kube-api-access-zlq92\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.157056 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.157005    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbwmm\" (UniqueName: \"kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-kube-api-access-qbwmm\") pod \"prometheus-k8s-0\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:20.157056 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.157008    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kz46w\" (UniqueName: \"kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-kube-api-access-kz46w\") pod \"alertmanager-main-0\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:20.157056 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.157017    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghc8q\" (UniqueName: \"kubernetes.io/projected/6af6f8e7-3e6c-4e48-9944-fa06042a5e57-kube-api-access-ghc8q\") pod \"kube-state-metrics-5dc8d7d89b-dtd6n\" (UID: \"6af6f8e7-3e6c-4e48-9944-fa06042a5e57\") " pod="openshift-monitoring/kube-state-metrics-5dc8d7d89b-dtd6n"
Oct 31 00:34:20.159706 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.159687    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2mh5\" (UniqueName: \"kubernetes.io/projected/82fa81b0-268b-497e-acc1-ac9eb4a97afb-kube-api-access-j2mh5\") pod \"thanos-querier-7d69c9c5bf-qglmt\" (UID: \"82fa81b0-268b-497e-acc1-ac9eb4a97afb\") " pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:20.159984 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.159966    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlwjc\" (UniqueName: \"kubernetes.io/projected/e4798203-046e-4ad4-842d-a211d905cd74-kube-api-access-wlwjc\") pod \"openshift-state-metrics-7bd7489957-fmqx8\" (UID: \"e4798203-046e-4ad4-842d-a211d905cd74\") " pod="openshift-monitoring/openshift-state-metrics-7bd7489957-fmqx8"
Oct 31 00:34:20.253902 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.253816    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/506537b2-c447-4523-95f5-a53bdc768c84-root\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.253902 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.253870    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-wtmp\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.253902 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.253890    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/506537b2-c447-4523-95f5-a53bdc768c84-sys\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.254120 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.253933    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/506537b2-c447-4523-95f5-a53bdc768c84-root\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.254120 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.253940    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/506537b2-c447-4523-95f5-a53bdc768c84-sys\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.254120 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.253985    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/506537b2-c447-4523-95f5-a53bdc768c84-node-exporter-wtmp\") pod \"node-exporter-cxblw\" (UID: \"506537b2-c447-4523-95f5-a53bdc768c84\") " pod="openshift-monitoring/node-exporter-cxblw"
Oct 31 00:34:20.556233 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.556184    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:20.556374 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.556249    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:20.556374 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.556316    5946 configmap.go:193] Couldn't get configMap openshift-console/service-ca: object "openshift-console"/"service-ca" not registered
Oct 31 00:34:20.556374 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.556330    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crwrm\" (UniqueName: \"kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:20.556496 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.556379    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:21.556366165 +0000 UTC m=+2.629406225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"service-ca" not registered
Oct 31 00:34:20.556496 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.556316    5946 configmap.go:193] Couldn't get configMap openshift-console/console-config: object "openshift-console"/"console-config" not registered
Oct 31 00:34:20.556496 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.556440    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:20.556496 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.556455    5946 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: object "openshift-console"/"kube-root-ca.crt" not registered
Oct 31 00:34:20.556496 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.556472    5946 projected.go:291] Couldn't get configMap openshift-console/openshift-service-ca.crt: object "openshift-console"/"openshift-service-ca.crt" not registered
Oct 31 00:34:20.556496 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.556474    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:20.556496 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.556485    5946 projected.go:196] Error preparing data for projected volume kube-api-access-crwrm for pod openshift-console/console-579b9db4b-hb7q9: [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:20.556496 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.556494    5946 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:20.556780 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.556513    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:21.556491254 +0000 UTC m=+2.629531314 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"console-config" not registered
Oct 31 00:34:20.556780 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.556541    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:21.556528641 +0000 UTC m=+2.629568716 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:20.556780 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.556546    5946 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:20.556780 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.556561    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:20.556780 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.556578    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:21.556568465 +0000 UTC m=+2.629608541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:20.556780 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.556584    5946 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:20.556780 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.556596    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:21.556590932 +0000 UTC m=+2.629630992 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-crwrm" (UniqueName: "kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:20.556780 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.556640    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:21.556632011 +0000 UTC m=+2.629672071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:20.657639 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.657603    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sv6t\" (UniqueName: \"kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:20.657800 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.657649    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:20.657800 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.657681    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:20.657800 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.657702    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:20.657800 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.657744    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:20.657800 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.657756    5946 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: object "openshift-console"/"kube-root-ca.crt" not registered
Oct 31 00:34:20.657800 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.657778    5946 projected.go:291] Couldn't get configMap openshift-console/openshift-service-ca.crt: object "openshift-console"/"openshift-service-ca.crt" not registered
Oct 31 00:34:20.657800 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.657788    5946 projected.go:196] Error preparing data for projected volume kube-api-access-8sv6t for pod openshift-console/console-7b5d6654d7-rbxn5: [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:20.657800 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.657799    5946 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:20.658184 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.657809    5946 configmap.go:193] Couldn't get configMap openshift-console/console-config: object "openshift-console"/"console-config" not registered
Oct 31 00:34:20.658184 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.657833    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:21.657820348 +0000 UTC m=+2.730860440 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8sv6t" (UniqueName: "kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:20.658184 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.657852    5946 configmap.go:193] Couldn't get configMap openshift-console/service-ca: object "openshift-console"/"service-ca" not registered
Oct 31 00:34:20.658184 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.657814    5946 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:20.658184 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.657883    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:20.658184 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.657908    5946 configmap.go:193] Couldn't get configMap openshift-console/trusted-ca-bundle: object "openshift-console"/"trusted-ca-bundle" not registered
Oct 31 00:34:20.658184 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.657889    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:21.657877168 +0000 UTC m=+2.730917246 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"service-ca" not registered
Oct 31 00:34:20.658184 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.657973    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:21.657955441 +0000 UTC m=+2.730995517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:20.658184 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.657996    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:21.657985451 +0000 UTC m=+2.731025517 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"console-config" not registered
Oct 31 00:34:20.658184 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.658021    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:21.658012414 +0000 UTC m=+2.731052480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:20.658184 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.658046    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:21.658033486 +0000 UTC m=+2.731073547 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"trusted-ca-bundle" not registered
Oct 31 00:34:20.658184 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:20.658092    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:20.658602 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.658205    5946 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:20.658602 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:20.658268    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:21.658258402 +0000 UTC m=+2.731298481 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:21.284497 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:21.284471    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:21.553159 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:21.553134    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ws48k"
Oct 31 00:34:21.566924 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:21.566901    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:21.567038 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:21.566974    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crwrm\" (UniqueName: \"kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:21.567038 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:21.567026    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:21.567038 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.567026    5946 configmap.go:193] Couldn't get configMap openshift-console/console-config: object "openshift-console"/"console-config" not registered
Oct 31 00:34:21.567178 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:21.567051    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:21.567178 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.567083    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:23.567069257 +0000 UTC m=+4.640109318 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"console-config" not registered
Oct 31 00:34:21.567178 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:21.567101    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:21.567178 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.567140    5946 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:21.567178 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:21.567159    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:21.567401 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.567160    5946 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: object "openshift-console"/"kube-root-ca.crt" not registered
Oct 31 00:34:21.567401 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.567198    5946 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:21.567401 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.567213    5946 projected.go:291] Couldn't get configMap openshift-console/openshift-service-ca.crt: object "openshift-console"/"openshift-service-ca.crt" not registered
Oct 31 00:34:21.567401 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.567184    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:23.567173319 +0000 UTC m=+4.640213392 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:21.567401 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.567140    5946 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:21.567401 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.567266    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:23.567250975 +0000 UTC m=+4.640291051 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:21.567401 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.567227    5946 configmap.go:193] Couldn't get configMap openshift-console/service-ca: object "openshift-console"/"service-ca" not registered
Oct 31 00:34:21.567401 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.567240    5946 projected.go:196] Error preparing data for projected volume kube-api-access-crwrm for pod openshift-console/console-579b9db4b-hb7q9: [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:21.567401 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.567286    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:23.567276443 +0000 UTC m=+4.640316504 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:21.567401 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.567322    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:23.567313715 +0000 UTC m=+4.640353777 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"service-ca" not registered
Oct 31 00:34:21.567401 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.567340    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:23.56733284 +0000 UTC m=+4.640372904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-crwrm" (UniqueName: "kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:21.667622 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:21.667592    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:21.667622 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:21.667626    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:21.667849 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:21.667656    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sv6t\" (UniqueName: \"kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:21.667849 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:21.667700    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:21.667849 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.667731    5946 configmap.go:193] Couldn't get configMap openshift-console/trusted-ca-bundle: object "openshift-console"/"trusted-ca-bundle" not registered
Oct 31 00:34:21.667849 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:21.667745    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:21.667849 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.667753    5946 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:21.667849 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:21.667778    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:21.667849 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.667799    5946 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: object "openshift-console"/"kube-root-ca.crt" not registered
Oct 31 00:34:21.667849 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.667808    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:23.667790427 +0000 UTC m=+4.740830532 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:21.667849 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.667817    5946 projected.go:291] Couldn't get configMap openshift-console/openshift-service-ca.crt: object "openshift-console"/"openshift-service-ca.crt" not registered
Oct 31 00:34:21.667849 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.667826    5946 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:21.667849 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.667831    5946 projected.go:196] Error preparing data for projected volume kube-api-access-8sv6t for pod openshift-console/console-7b5d6654d7-rbxn5: [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:21.667849 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.667845    5946 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:21.668211 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.667876    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:23.667862739 +0000 UTC m=+4.740902806 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"trusted-ca-bundle" not registered
Oct 31 00:34:21.668211 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.667895    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:23.667886808 +0000 UTC m=+4.740926873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:21.668211 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.667897    5946 configmap.go:193] Couldn't get configMap openshift-console/console-config: object "openshift-console"/"console-config" not registered
Oct 31 00:34:21.668211 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.667912    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:23.667907188 +0000 UTC m=+4.740947247 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8sv6t" (UniqueName: "kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:21.668211 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.667925    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:23.667920411 +0000 UTC m=+4.740960472 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:21.668211 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.667944    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:23.667935811 +0000 UTC m=+4.740975877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"console-config" not registered
Oct 31 00:34:21.668211 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:21.668012    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:21.668211 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.668071    5946 configmap.go:193] Couldn't get configMap openshift-console/service-ca: object "openshift-console"/"service-ca" not registered
Oct 31 00:34:21.668211 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:21.668106    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:23.668097021 +0000 UTC m=+4.741137097 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"service-ca" not registered
Oct 31 00:34:21.822621 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:21.822548    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7d69c9c5bf-qglmt"
Oct 31 00:34:23.590264 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:23.590208    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:23.590264 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:23.590271    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:23.590799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:23.590298    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:23.590799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:23.590355    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:23.590799 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.590368    5946 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:23.590799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:23.590397    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:23.590799 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.590402    5946 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:23.590799 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.590432    5946 configmap.go:193] Couldn't get configMap openshift-console/console-config: object "openshift-console"/"console-config" not registered
Oct 31 00:34:23.590799 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.590435    5946 configmap.go:193] Couldn't get configMap openshift-console/service-ca: object "openshift-console"/"service-ca" not registered
Oct 31 00:34:23.590799 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.590407    5946 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:23.590799 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.590441    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:27.590423691 +0000 UTC m=+8.663463774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:23.590799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:23.590557    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crwrm\" (UniqueName: \"kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:23.590799 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.590578    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:27.590556752 +0000 UTC m=+8.663596816 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:23.590799 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.590605    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:27.590598362 +0000 UTC m=+8.663638421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"console-config" not registered
Oct 31 00:34:23.590799 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.590618    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:27.590613318 +0000 UTC m=+8.663653378 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"service-ca" not registered
Oct 31 00:34:23.590799 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.590632    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:27.590625019 +0000 UTC m=+8.663665079 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:23.590799 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.590660    5946 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: object "openshift-console"/"kube-root-ca.crt" not registered
Oct 31 00:34:23.590799 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.590674    5946 projected.go:291] Couldn't get configMap openshift-console/openshift-service-ca.crt: object "openshift-console"/"openshift-service-ca.crt" not registered
Oct 31 00:34:23.590799 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.590686    5946 projected.go:196] Error preparing data for projected volume kube-api-access-crwrm for pod openshift-console/console-579b9db4b-hb7q9: [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:23.590799 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.590747    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:27.590732223 +0000 UTC m=+8.663772283 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-crwrm" (UniqueName: "kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:23.691239 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:23.691191    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:23.691388 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.691306    5946 configmap.go:193] Couldn't get configMap openshift-console/service-ca: object "openshift-console"/"service-ca" not registered
Oct 31 00:34:23.691388 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:23.691329    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:23.691388 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.691358    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:27.691346837 +0000 UTC m=+8.764386926 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"service-ca" not registered
Oct 31 00:34:23.691388 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.691379    5946 configmap.go:193] Couldn't get configMap openshift-console/trusted-ca-bundle: object "openshift-console"/"trusted-ca-bundle" not registered
Oct 31 00:34:23.691536 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.691419    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:27.691409406 +0000 UTC m=+8.764449466 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"trusted-ca-bundle" not registered
Oct 31 00:34:23.691536 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:23.691377    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:23.691536 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.691435    5946 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:23.691536 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:23.691457    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sv6t\" (UniqueName: \"kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:23.691536 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.691461    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:27.691451961 +0000 UTC m=+8.764492062 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:23.691536 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:23.691490    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:23.691775 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:23.691527    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:23.691775 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.691587    5946 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:23.691775 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.691600    5946 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: object "openshift-console"/"kube-root-ca.crt" not registered
Oct 31 00:34:23.691775 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.691618    5946 projected.go:291] Couldn't get configMap openshift-console/openshift-service-ca.crt: object "openshift-console"/"openshift-service-ca.crt" not registered
Oct 31 00:34:23.691775 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.691625    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:27.69161252 +0000 UTC m=+8.764652607 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:23.691775 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.691630    5946 projected.go:196] Error preparing data for projected volume kube-api-access-8sv6t for pod openshift-console/console-7b5d6654d7-rbxn5: [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:23.691775 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.691631    5946 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:23.691775 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:23.691662    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:23.691775 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.691664    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:27.691655344 +0000 UTC m=+8.764695409 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8sv6t" (UniqueName: "kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:23.691775 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.691688    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:27.691682785 +0000 UTC m=+8.764722849 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:23.691775 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.691732    5946 configmap.go:193] Couldn't get configMap openshift-console/console-config: object "openshift-console"/"console-config" not registered
Oct 31 00:34:23.691775 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:23.691772    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:27.691762997 +0000 UTC m=+8.764803057 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"console-config" not registered
Oct 31 00:34:24.894980 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:24.894952    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:25.511905 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:25.511864    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:34:27.634058 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:27.634021    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crwrm\" (UniqueName: \"kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:27.634090    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:27.634116    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:27.634135    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.634190    5946 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: object "openshift-console"/"kube-root-ca.crt" not registered
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.634197    5946 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:27.634171    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.634271    5946 configmap.go:193] Couldn't get configMap openshift-console/service-ca: object "openshift-console"/"service-ca" not registered
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:27.634285    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.634286    5946 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.634214    5946 projected.go:291] Couldn't get configMap openshift-console/openshift-service-ca.crt: object "openshift-console"/"openshift-service-ca.crt" not registered
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.634326    5946 configmap.go:193] Couldn't get configMap openshift-console/console-config: object "openshift-console"/"console-config" not registered
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.634299    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:35.634278995 +0000 UTC m=+16.707319076 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.634332    5946 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.634327    5946 projected.go:196] Error preparing data for projected volume kube-api-access-crwrm for pod openshift-console/console-579b9db4b-hb7q9: [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.634362    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:35.634344459 +0000 UTC m=+16.707384534 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"service-ca" not registered
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.634386    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:35.63437665 +0000 UTC m=+16.707416710 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.634413    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:35.634398195 +0000 UTC m=+16.707438266 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"console-config" not registered
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.634434    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:35.634424006 +0000 UTC m=+16.707464071 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-crwrm" (UniqueName: "kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:27.634639 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.634488    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:35.634479791 +0000 UTC m=+16.707519855 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:27.735845 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:27.735808    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:27.735988 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:27.735884    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:27.735988 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.735925    5946 configmap.go:193] Couldn't get configMap openshift-console/console-config: object "openshift-console"/"console-config" not registered
Oct 31 00:34:27.735988 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.735975    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:35.735962305 +0000 UTC m=+16.809002388 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"console-config" not registered
Oct 31 00:34:27.736110 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.735989    5946 configmap.go:193] Couldn't get configMap openshift-console/service-ca: object "openshift-console"/"service-ca" not registered
Oct 31 00:34:27.736110 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:27.736000    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:27.736110 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:27.736026    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:27.736110 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.736036    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:35.736020987 +0000 UTC m=+16.809061074 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"service-ca" not registered
Oct 31 00:34:27.736110 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.736069    5946 configmap.go:193] Couldn't get configMap openshift-console/trusted-ca-bundle: object "openshift-console"/"trusted-ca-bundle" not registered
Oct 31 00:34:27.736110 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.736094    5946 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:27.736110 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:27.736101    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sv6t\" (UniqueName: \"kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:27.736110 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.736108    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:35.736097188 +0000 UTC m=+16.809137269 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"trusted-ca-bundle" not registered
Oct 31 00:34:27.736411 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.736131    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:35.736120637 +0000 UTC m=+16.809160724 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:27.736411 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.736165    5946 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: object "openshift-console"/"kube-root-ca.crt" not registered
Oct 31 00:34:27.736411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:27.736168    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:27.736411 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.736177    5946 projected.go:291] Couldn't get configMap openshift-console/openshift-service-ca.crt: object "openshift-console"/"openshift-service-ca.crt" not registered
Oct 31 00:34:27.736411 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.736186    5946 projected.go:196] Error preparing data for projected volume kube-api-access-8sv6t for pod openshift-console/console-7b5d6654d7-rbxn5: [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:27.736411 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.736209    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:35.736202058 +0000 UTC m=+16.809242118 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8sv6t" (UniqueName: "kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:27.736411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:27.736257    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:27.736411 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.736280    5946 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:27.736411 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.736303    5946 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:27.736411 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.736318    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:35.736306897 +0000 UTC m=+16.809346959 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:27.736411 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:27.736334    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:35.73632555 +0000 UTC m=+16.809365614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:28.108390 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:28.108359    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:28.108638 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:28.108621    5946 prober_manager.go:356] "Failed to trigger a manual run" probe="Readiness"
Oct 31 00:34:28.310096 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:28.310067    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-77f4f76594-67n7t"
Oct 31 00:34:29.968161 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:29.968087    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-knmm8"
Oct 31 00:34:35.717651 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:35.717616    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crwrm\" (UniqueName: \"kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:35.717681    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:35.717705    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:35.717724    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:35.717761    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.717773    5946 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: object "openshift-console"/"kube-root-ca.crt" not registered
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.717801    5946 projected.go:291] Couldn't get configMap openshift-console/openshift-service-ca.crt: object "openshift-console"/"openshift-service-ca.crt" not registered
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.717816    5946 projected.go:196] Error preparing data for projected volume kube-api-access-crwrm for pod openshift-console/console-579b9db4b-hb7q9: [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.717832    5946 configmap.go:193] Couldn't get configMap openshift-console/console-config: object "openshift-console"/"console-config" not registered
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.717853    5946 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.717858    5946 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.717874    5946 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.717893    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:51.717871132 +0000 UTC m=+32.790911194 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-crwrm" (UniqueName: "kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.717865    5946 configmap.go:193] Couldn't get configMap openshift-console/service-ca: object "openshift-console"/"service-ca" not registered
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:35.717786    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config\") pod \"console-579b9db4b-hb7q9\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") " pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.717914    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:51.717905263 +0000 UTC m=+32.790945324 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"console-config" not registered
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.717958    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:51.717942836 +0000 UTC m=+32.790982911 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.717972    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:51.717966439 +0000 UTC m=+32.791006498 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.717984    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:51.717977735 +0000 UTC m=+32.791017794 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"service-ca" not registered
Oct 31 00:34:35.718100 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.717996    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert podName:610ed88a-261c-4503-b776-4a0c20b6cb07 nodeName:}" failed. No retries permitted until 2026-10-31 00:34:51.717990463 +0000 UTC m=+32.791030523 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert") pod "console-579b9db4b-hb7q9" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07") : object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:35.818650 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:35.818619    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:35.818755 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:35.818706    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:35.818755 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:35.818729    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:35.818755 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.818732    5946 configmap.go:193] Couldn't get configMap openshift-console/service-ca: object "openshift-console"/"service-ca" not registered
Oct 31 00:34:35.818856 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:35.818758    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sv6t\" (UniqueName: \"kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:35.818856 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.818792    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:51.818775663 +0000 UTC m=+32.891815769 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"service-ca" not registered
Oct 31 00:34:35.818856 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:35.818817    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:35.818989 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:35.818873    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:35.818989 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.818820    5946 configmap.go:193] Couldn't get configMap openshift-console/trusted-ca-bundle: object "openshift-console"/"trusted-ca-bundle" not registered
Oct 31 00:34:35.818989 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.818911    5946 secret.go:189] Couldn't get secret openshift-console/console-oauth-config: object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:35.818989 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:35.818909    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config\") pod \"console-7b5d6654d7-rbxn5\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") " pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:35.818989 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.818934    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:51.818920627 +0000 UTC m=+32.891960709 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"trusted-ca-bundle" not registered
Oct 31 00:34:35.818989 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.818950    5946 configmap.go:193] Couldn't get configMap openshift-console/console-config: object "openshift-console"/"console-config" not registered
Oct 31 00:34:35.818989 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.818962    5946 configmap.go:193] Couldn't get configMap openshift-console/oauth-serving-cert: object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:35.818989 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.818849    5946 secret.go:189] Couldn't get secret openshift-console/console-serving-cert: object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:35.818989 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.818980    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:51.818964664 +0000 UTC m=+32.892004744 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "console-oauth-config" (UniqueName: "kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"console-oauth-config" not registered
Oct 31 00:34:35.819350 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.819010    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:51.818997814 +0000 UTC m=+32.892037889 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "console-serving-cert" (UniqueName: "kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"console-serving-cert" not registered
Oct 31 00:34:35.819350 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.818859    5946 projected.go:291] Couldn't get configMap openshift-console/kube-root-ca.crt: object "openshift-console"/"kube-root-ca.crt" not registered
Oct 31 00:34:35.819350 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.819030    5946 projected.go:291] Couldn't get configMap openshift-console/openshift-service-ca.crt: object "openshift-console"/"openshift-service-ca.crt" not registered
Oct 31 00:34:35.819350 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.819038    5946 projected.go:196] Error preparing data for projected volume kube-api-access-8sv6t for pod openshift-console/console-7b5d6654d7-rbxn5: [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:35.819350 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.819061    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:51.819048487 +0000 UTC m=+32.892088554 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "console-config" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"console-config" not registered
Oct 31 00:34:35.819350 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.819131    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:51.819112204 +0000 UTC m=+32.892152279 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "oauth-serving-cert" (UniqueName: "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : object "openshift-console"/"oauth-serving-cert" not registered
Oct 31 00:34:35.819350 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:35.819159    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t podName:1e2c6645-71a9-4a48-883d-22c96ab5ab1b nodeName:}" failed. No retries permitted until 2026-10-31 00:34:51.819148471 +0000 UTC m=+32.892188545 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8sv6t" (UniqueName: "kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t") pod "console-7b5d6654d7-rbxn5" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b") : [object "openshift-console"/"kube-root-ca.crt" not registered, object "openshift-console"/"openshift-service-ca.crt" not registered]
Oct 31 00:34:39.041657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:39.041622    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 00:34:39.042286 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:39.041985    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="alertmanager" containerID="cri-o://7797b051f38d38064000634e02b76a74762fc30b302e5847220e748108dcb202" gracePeriod=120
Oct 31 00:34:39.042286 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:39.042207    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="kube-rbac-proxy-web" containerID="cri-o://53a3ba0a2bf0513c5434f7ce6959d62deca5275bd3ef3a9a40daa7f0e9408529" gracePeriod=120
Oct 31 00:34:39.042286 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:39.042263    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="config-reloader" containerID="cri-o://5adb67082cd8c7a6873038d1edb5bbef2cbf9b31758b02677f8637e8a2709d98" gracePeriod=120
Oct 31 00:34:39.042484 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:39.042302    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="prom-label-proxy" containerID="cri-o://331be75192e767f5448811f39db2a03bfcdb46e4cf4961cde018c0d6da6e5bd3" gracePeriod=120
Oct 31 00:34:39.042484 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:39.042358    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="kube-rbac-proxy-metric" containerID="cri-o://729817cbed6fb64229d3bb028f486c9eeb937e8490a44246f6566aabcf4edec1" gracePeriod=120
Oct 31 00:34:39.042590 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:39.042517    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="kube-rbac-proxy" containerID="cri-o://035e2f2b0b1e7053ef010e77779a63094a0c3131f185ee10cd6fc3de764c0892" gracePeriod=120
Oct 31 00:34:39.204588 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:39.204548    5946 generic.go:356] "Generic (PLEG): container finished" podID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerID="331be75192e767f5448811f39db2a03bfcdb46e4cf4961cde018c0d6da6e5bd3" exitCode=0
Oct 31 00:34:39.204588 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:39.204581    5946 generic.go:356] "Generic (PLEG): container finished" podID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerID="035e2f2b0b1e7053ef010e77779a63094a0c3131f185ee10cd6fc3de764c0892" exitCode=0
Oct 31 00:34:39.204588 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:39.204588    5946 generic.go:356] "Generic (PLEG): container finished" podID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerID="5adb67082cd8c7a6873038d1edb5bbef2cbf9b31758b02677f8637e8a2709d98" exitCode=0
Oct 31 00:34:39.204772 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:39.204595    5946 generic.go:356] "Generic (PLEG): container finished" podID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerID="7797b051f38d38064000634e02b76a74762fc30b302e5847220e748108dcb202" exitCode=0
Oct 31 00:34:39.204772 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:39.204606    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf","Type":"ContainerDied","Data":"331be75192e767f5448811f39db2a03bfcdb46e4cf4961cde018c0d6da6e5bd3"}
Oct 31 00:34:39.204772 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:39.204688    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf","Type":"ContainerDied","Data":"035e2f2b0b1e7053ef010e77779a63094a0c3131f185ee10cd6fc3de764c0892"}
Oct 31 00:34:39.204772 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:39.204715    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf","Type":"ContainerDied","Data":"5adb67082cd8c7a6873038d1edb5bbef2cbf9b31758b02677f8637e8a2709d98"}
Oct 31 00:34:39.204772 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:39.204738    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf","Type":"ContainerDied","Data":"7797b051f38d38064000634e02b76a74762fc30b302e5847220e748108dcb202"}
Oct 31 00:34:40.216500 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.216469    5946 generic.go:356] "Generic (PLEG): container finished" podID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerID="729817cbed6fb64229d3bb028f486c9eeb937e8490a44246f6566aabcf4edec1" exitCode=0
Oct 31 00:34:40.216500 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.216495    5946 generic.go:356] "Generic (PLEG): container finished" podID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerID="53a3ba0a2bf0513c5434f7ce6959d62deca5275bd3ef3a9a40daa7f0e9408529" exitCode=0
Oct 31 00:34:40.216908 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.216551    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf","Type":"ContainerDied","Data":"729817cbed6fb64229d3bb028f486c9eeb937e8490a44246f6566aabcf4edec1"}
Oct 31 00:34:40.216908 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.216661    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf","Type":"ContainerDied","Data":"53a3ba0a2bf0513c5434f7ce6959d62deca5275bd3ef3a9a40daa7f0e9408529"}
Oct 31 00:34:40.289351 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.289330    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:40.366630 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.366544    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-cluster-tls-config\") pod \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") "
Oct 31 00:34:40.366630 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.366613    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-main-tls\") pod \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") "
Oct 31 00:34:40.366830 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.366653    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-out\" (UniqueName: \"kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-out\") pod \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") "
Oct 31 00:34:40.366830 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.366740    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-kube-api-access-kz46w\" (UniqueName: \"kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-kube-api-access-kz46w\") pod \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") "
Oct 31 00:34:40.366830 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.366800    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-web\") pod \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") "
Oct 31 00:34:40.366983 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.366875    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-web-config\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-web-config\") pod \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") "
Oct 31 00:34:40.366983 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.366912    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-tls-assets\" (UniqueName: \"kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-tls-assets\") pod \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") "
Oct 31 00:34:40.366983 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.366946    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-metric\") pod \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") "
Oct 31 00:34:40.367144 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.366990    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-trusted-ca-bundle\") pod \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") "
Oct 31 00:34:40.367144 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.367020    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy\") pod \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") "
Oct 31 00:34:40.367144 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.367072    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-main-db\") pod \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") "
Oct 31 00:34:40.367144 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.367121    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-metrics-client-ca\") pod \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") "
Oct 31 00:34:40.367383 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.367162    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-volume\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-volume\") pod \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\" (UID: \"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf\") "
Oct 31 00:34:40.367964 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.367491    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-main-db" pod "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" (UID: "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:34:40.367964 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.367582    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-trusted-ca-bundle" pod "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" (UID: "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:34:40.367964 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.367643    5946 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-main-db\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:40.370047 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.370018    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-metrics-client-ca" pod "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" (UID: "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:34:40.370714 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.370690    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy" pod "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" (UID: "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:40.371333 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.371301    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-tls-assets" pod "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" (UID: "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:34:40.371451 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.371423    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-volume" pod "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" (UID: "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:40.371516 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.371451    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-out" pod "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" (UID: "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:34:40.371751 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.371719    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-main-tls" pod "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" (UID: "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:40.372476 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.372452    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-kube-api-access-kz46w" pod "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" (UID: "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf"). InnerVolumeSpecName "kube-api-access-kz46w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:34:40.372625 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.372599    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-web" pod "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" (UID: "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:40.373727 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.373704    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-metric" pod "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" (UID: "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:40.376746 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.376689    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-cluster-tls-config" pod "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" (UID: "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:40.382659 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.382634    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-web-config" pod "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" (UID: "61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:40.468403 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.468358    5946 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-metrics-client-ca\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:40.468403 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.468399    5946 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-volume\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:40.468403 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.468409    5946 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-cluster-tls-config\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:40.468403 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.468419    5946 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-main-tls\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:40.468655 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.468429    5946 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-config-out\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:40.468655 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.468437    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kz46w\" (UniqueName: \"kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-kube-api-access-kz46w\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:40.468655 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.468447    5946 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:40.468655 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.468457    5946 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-web-config\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:40.468655 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.468465    5946 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-tls-assets\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:40.468655 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.468474    5946 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:40.468655 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.468483    5946 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:40.468655 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:40.468493    5946 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:41.223560 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.223524    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf","Type":"ContainerDied","Data":"c54eb23e869163f2d6c2849805e4f4f97ac0bd3ca3408f20c729e1bea6c1d1f8"}
Oct 31 00:34:41.223560 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.223545    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.224095 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.223608    5946 scope.go:122] "RemoveContainer" containerID="331be75192e767f5448811f39db2a03bfcdb46e4cf4961cde018c0d6da6e5bd3"
Oct 31 00:34:41.231439 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.231420    5946 scope.go:122] "RemoveContainer" containerID="729817cbed6fb64229d3bb028f486c9eeb937e8490a44246f6566aabcf4edec1"
Oct 31 00:34:41.238159 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.238142    5946 scope.go:122] "RemoveContainer" containerID="035e2f2b0b1e7053ef010e77779a63094a0c3131f185ee10cd6fc3de764c0892"
Oct 31 00:34:41.244638 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.244616    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 00:34:41.245517 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.245498    5946 scope.go:122] "RemoveContainer" containerID="53a3ba0a2bf0513c5434f7ce6959d62deca5275bd3ef3a9a40daa7f0e9408529"
Oct 31 00:34:41.249981 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.249963    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 00:34:41.255238 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.255199    5946 scope.go:122] "RemoveContainer" containerID="5adb67082cd8c7a6873038d1edb5bbef2cbf9b31758b02677f8637e8a2709d98"
Oct 31 00:34:41.262100 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.262073    5946 scope.go:122] "RemoveContainer" containerID="7797b051f38d38064000634e02b76a74762fc30b302e5847220e748108dcb202"
Oct 31 00:34:41.269533 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.269503    5946 scope.go:122] "RemoveContainer" containerID="0428f2cde44cbd021e0aa208861892848797adfc8e218141361b09a55688adb5"
Oct 31 00:34:41.278557 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.278526    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 00:34:41.279014 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.278990    5946 cpu_manager.go:414] "containerMap: removing container" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="kube-rbac-proxy-web"
Oct 31 00:34:41.279014 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279008    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="kube-rbac-proxy-web"
Oct 31 00:34:41.279127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279028    5946 cpu_manager.go:414] "containerMap: removing container" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="config-reloader"
Oct 31 00:34:41.279127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279036    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="config-reloader"
Oct 31 00:34:41.279127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279070    5946 cpu_manager.go:414] "containerMap: removing container" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="kube-rbac-proxy"
Oct 31 00:34:41.279127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279077    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="kube-rbac-proxy"
Oct 31 00:34:41.279127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279093    5946 cpu_manager.go:414] "containerMap: removing container" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="kube-rbac-proxy-metric"
Oct 31 00:34:41.279127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279100    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="kube-rbac-proxy-metric"
Oct 31 00:34:41.279127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279110    5946 cpu_manager.go:414] "containerMap: removing container" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="init-config-reloader"
Oct 31 00:34:41.279127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279117    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="init-config-reloader"
Oct 31 00:34:41.279369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279137    5946 cpu_manager.go:414] "containerMap: removing container" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="alertmanager"
Oct 31 00:34:41.279369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279146    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="alertmanager"
Oct 31 00:34:41.279369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279161    5946 cpu_manager.go:414] "containerMap: removing container" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="prom-label-proxy"
Oct 31 00:34:41.279369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279169    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="prom-label-proxy"
Oct 31 00:34:41.279369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279268    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="kube-rbac-proxy"
Oct 31 00:34:41.279369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279281    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="kube-rbac-proxy-metric"
Oct 31 00:34:41.279369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279290    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="init-config-reloader"
Oct 31 00:34:41.279369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279301    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="alertmanager"
Oct 31 00:34:41.279369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279309    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="prom-label-proxy"
Oct 31 00:34:41.279369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279316    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="kube-rbac-proxy-web"
Oct 31 00:34:41.279369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.279326    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" containerName="config-reloader"
Oct 31 00:34:41.283615 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.283593    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.287615 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.287574    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Oct 31 00:34:41.287718 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.287620    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Oct 31 00:34:41.287718 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.287635    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Oct 31 00:34:41.287718 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.287627    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Oct 31 00:34:41.287718 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.287622    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Oct 31 00:34:41.287718 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.287670    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Oct 31 00:34:41.287942 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.287757    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Oct 31 00:34:41.287942 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.287789    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Oct 31 00:34:41.287942 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.287833    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tztrh\""
Oct 31 00:34:41.289122 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.289101    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Oct 31 00:34:41.293755 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.293727    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 00:34:41.379049 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:41.378969    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:34:41.379248 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.379214    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fb00c00-f1b2-4c6e-abc3-30ee49786633-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.379323 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.379310    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-web-config\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.379362 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.379344    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.379404 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.379395    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9fb00c00-f1b2-4c6e-abc3-30ee49786633-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.379499 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.379483    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fb00c00-f1b2-4c6e-abc3-30ee49786633-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.379546 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.379514    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fb00c00-f1b2-4c6e-abc3-30ee49786633-config-out\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.379546 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.379532    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.379616 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.379604    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fb00c00-f1b2-4c6e-abc3-30ee49786633-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.379704 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.379690    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.379738 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.379730    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.379777 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.379757    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-config-volume\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.379821 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.379808    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.379884 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.379872    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxpmq\" (UniqueName: \"kubernetes.io/projected/9fb00c00-f1b2-4c6e-abc3-30ee49786633-kube-api-access-mxpmq\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.480579 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.480540    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.480736 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.480613    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9fb00c00-f1b2-4c6e-abc3-30ee49786633-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.480736 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.480650    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fb00c00-f1b2-4c6e-abc3-30ee49786633-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.480736 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.480675    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fb00c00-f1b2-4c6e-abc3-30ee49786633-config-out\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.480736 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.480693    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.480736 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.480714    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fb00c00-f1b2-4c6e-abc3-30ee49786633-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.480992 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.480751    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.480992 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.480784    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.480992 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.480814    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-config-volume\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.480992 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.480849    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.480992 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.480889    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxpmq\" (UniqueName: \"kubernetes.io/projected/9fb00c00-f1b2-4c6e-abc3-30ee49786633-kube-api-access-mxpmq\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.480992 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.480960    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fb00c00-f1b2-4c6e-abc3-30ee49786633-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.481321 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.481055    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9fb00c00-f1b2-4c6e-abc3-30ee49786633-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.481321 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.481053    5946 swap_util.go:78] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Oct 31 00:34:41.481321 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.481257    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-web-config\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.481852 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.481800    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fb00c00-f1b2-4c6e-abc3-30ee49786633-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.482308 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.482243    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fb00c00-f1b2-4c6e-abc3-30ee49786633-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.483659 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.483613    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fb00c00-f1b2-4c6e-abc3-30ee49786633-config-out\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.483921 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.483892    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.484121 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.484099    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fb00c00-f1b2-4c6e-abc3-30ee49786633-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.484188 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.484162    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.484306 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.484284    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-web-config\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.484753 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.484733    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.484843 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.484823    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-config-volume\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.485154 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.485140    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.485442 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.485428    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9fb00c00-f1b2-4c6e-abc3-30ee49786633-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.490645 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.490627    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxpmq\" (UniqueName: \"kubernetes.io/projected/9fb00c00-f1b2-4c6e-abc3-30ee49786633-kube-api-access-mxpmq\") pod \"alertmanager-main-0\" (UID: \"9fb00c00-f1b2-4c6e-abc3-30ee49786633\") " pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.604506 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.604476    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Oct 31 00:34:41.882929 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:41.882844    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Oct 31 00:34:41.885933 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:41.885907    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fb00c00_f1b2_4c6e_abc3_30ee49786633.slice/crio-66f5e30d862088bd0fc3d7943c6984b3646eabd1d6374b196cf924d412ffaa79 WatchSource:0}: Error finding container 66f5e30d862088bd0fc3d7943c6984b3646eabd1d6374b196cf924d412ffaa79: Status 404 returned error can't find the container with id 66f5e30d862088bd0fc3d7943c6984b3646eabd1d6374b196cf924d412ffaa79
Oct 31 00:34:42.229732 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:42.229639    5946 generic.go:356] "Generic (PLEG): container finished" podID="9fb00c00-f1b2-4c6e-abc3-30ee49786633" containerID="fca6ee3bc983503ec9f5a826e460292fa3311c570cde2e6b10ca232bdf2a54f3" exitCode=0
Oct 31 00:34:42.229732 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:42.229679    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fb00c00-f1b2-4c6e-abc3-30ee49786633","Type":"ContainerDied","Data":"fca6ee3bc983503ec9f5a826e460292fa3311c570cde2e6b10ca232bdf2a54f3"}
Oct 31 00:34:42.230264 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:42.229742    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fb00c00-f1b2-4c6e-abc3-30ee49786633","Type":"ContainerStarted","Data":"66f5e30d862088bd0fc3d7943c6984b3646eabd1d6374b196cf924d412ffaa79"}
Oct 31 00:34:43.059148 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.055865    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf" path="/var/lib/kubelet/pods/61be19ab-d9e4-49ad-9a50-4e7ff89d7bcf/volumes"
Oct 31 00:34:43.060906 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.060874    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"]
Oct 31 00:34:43.064612 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.064589    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.067703 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.067678    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Oct 31 00:34:43.072632 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.072442    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-28r105lbnph2c\""
Oct 31 00:34:43.078153 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.076124    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"]
Oct 31 00:34:43.098158 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.098124    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/454d11be-7d7f-483d-bc9d-b067e981a01a-telemeter-client-tls\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.098321 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.098298    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/454d11be-7d7f-483d-bc9d-b067e981a01a-serving-certs-ca-bundle\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.100168 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.098399    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/454d11be-7d7f-483d-bc9d-b067e981a01a-federate-client-tls\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.100168 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.098498    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/454d11be-7d7f-483d-bc9d-b067e981a01a-metrics-client-ca\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.100168 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.098542    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/454d11be-7d7f-483d-bc9d-b067e981a01a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.100168 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.098573    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qg96s\" (UniqueName: \"kubernetes.io/projected/454d11be-7d7f-483d-bc9d-b067e981a01a-kube-api-access-qg96s\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.100168 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.098616    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/454d11be-7d7f-483d-bc9d-b067e981a01a-secret-telemeter-client\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.100168 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.098643    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/454d11be-7d7f-483d-bc9d-b067e981a01a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.157657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.157626    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Oct 31 00:34:43.157771 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.157726    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Oct 31 00:34:43.157771 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.157745    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Oct 31 00:34:43.157771 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.157751    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Oct 31 00:34:43.157899 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.157804    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6kdgr\""
Oct 31 00:34:43.199236 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.199192    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/454d11be-7d7f-483d-bc9d-b067e981a01a-federate-client-tls\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.199386 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.199370    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/454d11be-7d7f-483d-bc9d-b067e981a01a-metrics-client-ca\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.199439 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.199422    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/454d11be-7d7f-483d-bc9d-b067e981a01a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.199471 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.199454    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qg96s\" (UniqueName: \"kubernetes.io/projected/454d11be-7d7f-483d-bc9d-b067e981a01a-kube-api-access-qg96s\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.199531 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.199516    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/454d11be-7d7f-483d-bc9d-b067e981a01a-secret-telemeter-client\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.199582 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.199548    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/454d11be-7d7f-483d-bc9d-b067e981a01a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.199717 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.199686    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/454d11be-7d7f-483d-bc9d-b067e981a01a-telemeter-client-tls\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.199827 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.199805    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/454d11be-7d7f-483d-bc9d-b067e981a01a-serving-certs-ca-bundle\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.200173 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.200144    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/454d11be-7d7f-483d-bc9d-b067e981a01a-metrics-client-ca\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.200390 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.200356    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/454d11be-7d7f-483d-bc9d-b067e981a01a-telemeter-trusted-ca-bundle\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.200533 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.200494    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/454d11be-7d7f-483d-bc9d-b067e981a01a-serving-certs-ca-bundle\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.201948 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.201928    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/454d11be-7d7f-483d-bc9d-b067e981a01a-federate-client-tls\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.202105 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.202086    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/454d11be-7d7f-483d-bc9d-b067e981a01a-secret-telemeter-client\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.202247 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.202208    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/454d11be-7d7f-483d-bc9d-b067e981a01a-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.202317 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.202301    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/454d11be-7d7f-483d-bc9d-b067e981a01a-telemeter-client-tls\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.207424 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.207402    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qg96s\" (UniqueName: \"kubernetes.io/projected/454d11be-7d7f-483d-bc9d-b067e981a01a-kube-api-access-qg96s\") pod \"telemeter-client-7bbf6745c4-jmx5v\" (UID: \"454d11be-7d7f-483d-bc9d-b067e981a01a\") " pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.239537 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.239512    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fb00c00-f1b2-4c6e-abc3-30ee49786633","Type":"ContainerStarted","Data":"e97b3b1e12def6459f99c34b22334e36f202a92174e97c4d99f8c766015b617d"}
Oct 31 00:34:43.239876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.239573    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fb00c00-f1b2-4c6e-abc3-30ee49786633","Type":"ContainerStarted","Data":"2171342f530bc08cbe1a295522741f379e143f989480458e0d26b0686ca0ce06"}
Oct 31 00:34:43.239876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.239598    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fb00c00-f1b2-4c6e-abc3-30ee49786633","Type":"ContainerStarted","Data":"30a9f78eb68c1d17b73785fccb7e898949dd478d73522572c69d0751e987287b"}
Oct 31 00:34:43.239876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.239625    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fb00c00-f1b2-4c6e-abc3-30ee49786633","Type":"ContainerStarted","Data":"5b671d7f7dfd0512b4b793c57782d7c8e76dba3e1bb1a41427e7b82561c64b09"}
Oct 31 00:34:43.239876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.239653    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fb00c00-f1b2-4c6e-abc3-30ee49786633","Type":"ContainerStarted","Data":"79bfd35edc9f67590f95ff71298e2337e998019c316fa1abafb89ebe530d7fdc"}
Oct 31 00:34:43.239876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.239677    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fb00c00-f1b2-4c6e-abc3-30ee49786633","Type":"ContainerStarted","Data":"317b897e5362aeffa9a52b74eb7cbadfef6121d6dbb4afef213b050b553d3e57"}
Oct 31 00:34:43.266467 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.266414    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.256202136 podStartE2EDuration="2.266399355s" totalImagesPullingTime="0s" totalInitContainerRuntime="10.197219ms" isStatefulPod=false podCreationTimestamp="2026-10-31 00:34:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:34:43.265325419 +0000 UTC m=+24.338365590" watchObservedRunningTime="2026-10-31 00:34:43.266399355 +0000 UTC m=+24.339439434"
Oct 31 00:34:43.387686 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.387609    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"
Oct 31 00:34:43.458044 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.455459    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 31 00:34:43.458044 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.455883    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="prometheus" containerID="cri-o://3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85" gracePeriod=600
Oct 31 00:34:43.458044 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.455992    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="thanos-sidecar" containerID="cri-o://45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25" gracePeriod=600
Oct 31 00:34:43.458044 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.456073    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="config-reloader" containerID="cri-o://004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612" gracePeriod=600
Oct 31 00:34:43.458044 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.455930    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="kube-rbac-proxy" containerID="cri-o://a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca" gracePeriod=600
Oct 31 00:34:43.458044 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.456497    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="kube-rbac-proxy-thanos" containerID="cri-o://cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d" gracePeriod=600
Oct 31 00:34:43.458044 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.456537    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="kube-rbac-proxy-web" containerID="cri-o://3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7" gracePeriod=600
Oct 31 00:34:43.667527 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.667443    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v"]
Oct 31 00:34:43.675767 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.675579    5946 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:34:43.709275 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.709209    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:43.806202 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806173    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-serving-certs-ca-bundle\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.806373 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806262    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.806500 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806366    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-trusted-ca-bundle\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.806500 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806414    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-kubelet-serving-ca-bundle\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.806500 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806459    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-kube-rbac-proxy\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.806657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806504    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-metrics-client-ca\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.806657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806554    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-metrics-client-certs\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.806657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806594    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.806657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806650    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-2\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.807039 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806677    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.807039 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806708    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-thanos-prometheus-http-client-file\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.807039 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806712    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-serving-certs-ca-bundle" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:34:43.807039 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806746    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-db\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.807039 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806802    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-1\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.807039 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806832    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-trusted-ca-bundle" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:34:43.807039 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806835    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-tls\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.807039 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806896    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-web-config\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-web-config\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.807039 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806933    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config-out\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.807039 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806977    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-0\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.807039 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.806976    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-kubelet-serving-ca-bundle" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:34:43.807039 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.807019    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-grpc-tls\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.807660 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.807052    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-kube-api-access-qbwmm\" (UniqueName: \"kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-kube-api-access-qbwmm\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.807660 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.807086    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-tls-assets\" (UniqueName: \"kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-tls-assets\") pod \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\" (UID: \"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1\") "
Oct 31 00:34:43.807660 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.807417    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-metrics-client-ca" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:34:43.807833 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.807811    5946 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.807888 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.807839    5946 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.807888 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.807857    5946 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.807888 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.807873    5946 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-configmap-metrics-client-ca\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.808844 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.808808    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-kube-rbac-proxy-web" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:43.809516 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.809488    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-0" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:34:43.809950 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.809923    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-1" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:34:43.810318 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.810283    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-tls-assets" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:34:43.810801 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.810774    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-metrics-client-certs" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:43.811426 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.811151    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-db" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:34:43.811426 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.811314    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-2" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:34:43.811647 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.811505    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-grpc-tls" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:43.811773 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.811696    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-kube-rbac-proxy" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:43.811773 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.811726    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-kube-api-access-qbwmm" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "kube-api-access-qbwmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:34:43.811992 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.811960    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-thanos-sidecar-tls" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:43.812080 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.812063    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config-out" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:34:43.812144 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.812121    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:43.812916 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.812896    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-tls" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:43.813078 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.813062    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-thanos-prometheus-http-client-file" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:43.821908 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.821887    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-web-config" pod "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" (UID: "1ff7973a-3f8a-4da8-a4c1-6d76b11515d1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:43.908600 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.908571    5946 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.908600 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.908598    5946 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.908799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.908609    5946 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.908799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.908620    5946 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-db\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.908799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.908630    5946 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.908799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.908639    5946 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.908799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.908647    5946 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-web-config\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.908799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.908656    5946 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-config-out\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.908799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.908664    5946 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.908799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.908673    5946 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-grpc-tls\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.908799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.908682    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbwmm\" (UniqueName: \"kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-kube-api-access-qbwmm\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.908799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.908690    5946 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-tls-assets\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.908799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.908698    5946 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.908799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.908708    5946 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-kube-rbac-proxy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.908799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.908716    5946 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-metrics-client-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:43.908799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:43.908724    5946 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:44.247795 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.247757    5946 generic.go:356] "Generic (PLEG): container finished" podID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerID="cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d" exitCode=0
Oct 31 00:34:44.247795 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.247792    5946 generic.go:356] "Generic (PLEG): container finished" podID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerID="a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca" exitCode=0
Oct 31 00:34:44.247795 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.247802    5946 generic.go:356] "Generic (PLEG): container finished" podID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerID="3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7" exitCode=0
Oct 31 00:34:44.248398 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.247811    5946 generic.go:356] "Generic (PLEG): container finished" podID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerID="45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25" exitCode=0
Oct 31 00:34:44.248398 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.247819    5946 generic.go:356] "Generic (PLEG): container finished" podID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerID="004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612" exitCode=0
Oct 31 00:34:44.248398 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.247827    5946 generic.go:356] "Generic (PLEG): container finished" podID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerID="3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85" exitCode=0
Oct 31 00:34:44.248398 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.247838    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1","Type":"ContainerDied","Data":"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d"}
Oct 31 00:34:44.248398 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.247863    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.248398 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.247925    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1","Type":"ContainerDied","Data":"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca"}
Oct 31 00:34:44.248398 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.247960    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1","Type":"ContainerDied","Data":"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7"}
Oct 31 00:34:44.248398 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.247984    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1","Type":"ContainerDied","Data":"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25"}
Oct 31 00:34:44.248398 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.248011    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1","Type":"ContainerDied","Data":"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612"}
Oct 31 00:34:44.248398 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.248042    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1","Type":"ContainerDied","Data":"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85"}
Oct 31 00:34:44.248398 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.248066    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1ff7973a-3f8a-4da8-a4c1-6d76b11515d1","Type":"ContainerDied","Data":"c8f693e8fea1e5d57d49dbb75d40f50d1bd08291aab6528c24cb4b7efd042a8c"}
Oct 31 00:34:44.248398 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.248012    5946 scope.go:122] "RemoveContainer" containerID="cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d"
Oct 31 00:34:44.249366 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.249346    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v" event={"ID":"454d11be-7d7f-483d-bc9d-b067e981a01a","Type":"ContainerStarted","Data":"dc99c1fce301fedc7b0f687a5774da6bf0c6acf15197fb197127a326f9327742"}
Oct 31 00:34:44.257315 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.257279    5946 scope.go:122] "RemoveContainer" containerID="a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca"
Oct 31 00:34:44.267325 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.265364    5946 scope.go:122] "RemoveContainer" containerID="3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7"
Oct 31 00:34:44.274264 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.274242    5946 scope.go:122] "RemoveContainer" containerID="45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25"
Oct 31 00:34:44.275620 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.275598    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 31 00:34:44.283618 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.283589    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 31 00:34:44.285608 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.285583    5946 scope.go:122] "RemoveContainer" containerID="004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612"
Oct 31 00:34:44.294677 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.294657    5946 scope.go:122] "RemoveContainer" containerID="3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85"
Oct 31 00:34:44.302610 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.302579    5946 scope.go:122] "RemoveContainer" containerID="af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d"
Oct 31 00:34:44.310328 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.309988    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 31 00:34:44.310448 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310396    5946 cpu_manager.go:414] "containerMap: removing container" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="config-reloader"
Oct 31 00:34:44.310448 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310409    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="config-reloader"
Oct 31 00:34:44.310448 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310434    5946 cpu_manager.go:414] "containerMap: removing container" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="prometheus"
Oct 31 00:34:44.310448 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310440    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="prometheus"
Oct 31 00:34:44.310448 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310448    5946 cpu_manager.go:414] "containerMap: removing container" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="kube-rbac-proxy-thanos"
Oct 31 00:34:44.310448 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310453    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="kube-rbac-proxy-thanos"
Oct 31 00:34:44.310749 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310463    5946 cpu_manager.go:414] "containerMap: removing container" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="kube-rbac-proxy-web"
Oct 31 00:34:44.310749 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310469    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="kube-rbac-proxy-web"
Oct 31 00:34:44.310749 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310483    5946 cpu_manager.go:414] "containerMap: removing container" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="init-config-reloader"
Oct 31 00:34:44.310749 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310487    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="init-config-reloader"
Oct 31 00:34:44.310749 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310493    5946 cpu_manager.go:414] "containerMap: removing container" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="kube-rbac-proxy"
Oct 31 00:34:44.310749 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310497    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="kube-rbac-proxy"
Oct 31 00:34:44.310749 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310503    5946 cpu_manager.go:414] "containerMap: removing container" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="thanos-sidecar"
Oct 31 00:34:44.310749 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310507    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="thanos-sidecar"
Oct 31 00:34:44.310749 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310558    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="config-reloader"
Oct 31 00:34:44.310749 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310570    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="prometheus"
Oct 31 00:34:44.310749 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310579    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="kube-rbac-proxy-thanos"
Oct 31 00:34:44.310749 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310585    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="kube-rbac-proxy-web"
Oct 31 00:34:44.310749 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310592    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="init-config-reloader"
Oct 31 00:34:44.310749 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310597    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="kube-rbac-proxy"
Oct 31 00:34:44.310749 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.310601    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" containerName="thanos-sidecar"
Oct 31 00:34:44.312483 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.312454    5946 scope.go:122] "RemoveContainer" containerID="cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d"
Oct 31 00:34:44.312833 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:44.312810    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d\": container with ID starting with cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d not found: ID does not exist" containerID="cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d"
Oct 31 00:34:44.312908 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.312841    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d"} err="failed to get container status \"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d\": rpc error: code = NotFound desc = could not find container \"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d\": container with ID starting with cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d not found: ID does not exist"
Oct 31 00:34:44.312908 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.312872    5946 scope.go:122] "RemoveContainer" containerID="a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca"
Oct 31 00:34:44.313199 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:44.313174    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca\": container with ID starting with a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca not found: ID does not exist" containerID="a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca"
Oct 31 00:34:44.313309 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.313208    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca"} err="failed to get container status \"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca\": rpc error: code = NotFound desc = could not find container \"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca\": container with ID starting with a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca not found: ID does not exist"
Oct 31 00:34:44.313309 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.313253    5946 scope.go:122] "RemoveContainer" containerID="3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7"
Oct 31 00:34:44.313539 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:44.313514    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7\": container with ID starting with 3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7 not found: ID does not exist" containerID="3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7"
Oct 31 00:34:44.313605 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.313548    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7"} err="failed to get container status \"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7\": rpc error: code = NotFound desc = could not find container \"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7\": container with ID starting with 3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7 not found: ID does not exist"
Oct 31 00:34:44.313605 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.313569    5946 scope.go:122] "RemoveContainer" containerID="45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25"
Oct 31 00:34:44.313880 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:44.313855    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25\": container with ID starting with 45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25 not found: ID does not exist" containerID="45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25"
Oct 31 00:34:44.313970 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.313886    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25"} err="failed to get container status \"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25\": rpc error: code = NotFound desc = could not find container \"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25\": container with ID starting with 45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25 not found: ID does not exist"
Oct 31 00:34:44.313970 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.313909    5946 scope.go:122] "RemoveContainer" containerID="004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612"
Oct 31 00:34:44.314194 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:44.314171    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612\": container with ID starting with 004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612 not found: ID does not exist" containerID="004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612"
Oct 31 00:34:44.314299 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.314202    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612"} err="failed to get container status \"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612\": rpc error: code = NotFound desc = could not find container \"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612\": container with ID starting with 004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612 not found: ID does not exist"
Oct 31 00:34:44.314299 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.314244    5946 scope.go:122] "RemoveContainer" containerID="3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85"
Oct 31 00:34:44.314480 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:44.314459    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85\": container with ID starting with 3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85 not found: ID does not exist" containerID="3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85"
Oct 31 00:34:44.314517 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.314489    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85"} err="failed to get container status \"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85\": rpc error: code = NotFound desc = could not find container \"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85\": container with ID starting with 3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85 not found: ID does not exist"
Oct 31 00:34:44.314517 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.314504    5946 scope.go:122] "RemoveContainer" containerID="af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d"
Oct 31 00:34:44.314758 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:34:44.314740    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d\": container with ID starting with af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d not found: ID does not exist" containerID="af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d"
Oct 31 00:34:44.314843 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.314765    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d"} err="failed to get container status \"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d\": rpc error: code = NotFound desc = could not find container \"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d\": container with ID starting with af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d not found: ID does not exist"
Oct 31 00:34:44.314843 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.314784    5946 scope.go:122] "RemoveContainer" containerID="cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d"
Oct 31 00:34:44.315078 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.315055    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d"} err="failed to get container status \"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d\": rpc error: code = NotFound desc = could not find container \"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d\": container with ID starting with cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d not found: ID does not exist"
Oct 31 00:34:44.315146 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.315080    5946 scope.go:122] "RemoveContainer" containerID="a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca"
Oct 31 00:34:44.315357 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.315336    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca"} err="failed to get container status \"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca\": rpc error: code = NotFound desc = could not find container \"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca\": container with ID starting with a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca not found: ID does not exist"
Oct 31 00:34:44.315416 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.315358    5946 scope.go:122] "RemoveContainer" containerID="3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7"
Oct 31 00:34:44.315598 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.315575    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7"} err="failed to get container status \"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7\": rpc error: code = NotFound desc = could not find container \"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7\": container with ID starting with 3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7 not found: ID does not exist"
Oct 31 00:34:44.315598 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.315596    5946 scope.go:122] "RemoveContainer" containerID="45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25"
Oct 31 00:34:44.315842 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.315820    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25"} err="failed to get container status \"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25\": rpc error: code = NotFound desc = could not find container \"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25\": container with ID starting with 45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25 not found: ID does not exist"
Oct 31 00:34:44.315902 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.315843    5946 scope.go:122] "RemoveContainer" containerID="004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612"
Oct 31 00:34:44.316094 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.316069    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612"} err="failed to get container status \"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612\": rpc error: code = NotFound desc = could not find container \"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612\": container with ID starting with 004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612 not found: ID does not exist"
Oct 31 00:34:44.316094 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.316093    5946 scope.go:122] "RemoveContainer" containerID="3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85"
Oct 31 00:34:44.316380 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.316354    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85"} err="failed to get container status \"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85\": rpc error: code = NotFound desc = could not find container \"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85\": container with ID starting with 3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85 not found: ID does not exist"
Oct 31 00:34:44.316489 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.316384    5946 scope.go:122] "RemoveContainer" containerID="af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d"
Oct 31 00:34:44.317167 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.317141    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d"} err="failed to get container status \"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d\": rpc error: code = NotFound desc = could not find container \"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d\": container with ID starting with af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d not found: ID does not exist"
Oct 31 00:34:44.317167 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.317166    5946 scope.go:122] "RemoveContainer" containerID="cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d"
Oct 31 00:34:44.317511 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.317488    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d"} err="failed to get container status \"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d\": rpc error: code = NotFound desc = could not find container \"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d\": container with ID starting with cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d not found: ID does not exist"
Oct 31 00:34:44.317608 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.317585    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.317608 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.317593    5946 scope.go:122] "RemoveContainer" containerID="a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca"
Oct 31 00:34:44.317866 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.317843    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca"} err="failed to get container status \"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca\": rpc error: code = NotFound desc = could not find container \"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca\": container with ID starting with a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca not found: ID does not exist"
Oct 31 00:34:44.317928 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.317867    5946 scope.go:122] "RemoveContainer" containerID="3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7"
Oct 31 00:34:44.318190 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.318165    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7"} err="failed to get container status \"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7\": rpc error: code = NotFound desc = could not find container \"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7\": container with ID starting with 3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7 not found: ID does not exist"
Oct 31 00:34:44.318301 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.318191    5946 scope.go:122] "RemoveContainer" containerID="45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25"
Oct 31 00:34:44.318526 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.318496    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25"} err="failed to get container status \"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25\": rpc error: code = NotFound desc = could not find container \"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25\": container with ID starting with 45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25 not found: ID does not exist"
Oct 31 00:34:44.318609 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.318528    5946 scope.go:122] "RemoveContainer" containerID="004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612"
Oct 31 00:34:44.318775 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.318749    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612"} err="failed to get container status \"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612\": rpc error: code = NotFound desc = could not find container \"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612\": container with ID starting with 004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612 not found: ID does not exist"
Oct 31 00:34:44.318775 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.318774    5946 scope.go:122] "RemoveContainer" containerID="3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85"
Oct 31 00:34:44.319023 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.319002    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85"} err="failed to get container status \"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85\": rpc error: code = NotFound desc = could not find container \"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85\": container with ID starting with 3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85 not found: ID does not exist"
Oct 31 00:34:44.319085 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.319025    5946 scope.go:122] "RemoveContainer" containerID="af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d"
Oct 31 00:34:44.319294 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.319274    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d"} err="failed to get container status \"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d\": rpc error: code = NotFound desc = could not find container \"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d\": container with ID starting with af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d not found: ID does not exist"
Oct 31 00:34:44.319369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.319294    5946 scope.go:122] "RemoveContainer" containerID="cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d"
Oct 31 00:34:44.319605 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.319577    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d"} err="failed to get container status \"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d\": rpc error: code = NotFound desc = could not find container \"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d\": container with ID starting with cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d not found: ID does not exist"
Oct 31 00:34:44.319704 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.319605    5946 scope.go:122] "RemoveContainer" containerID="a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca"
Oct 31 00:34:44.319911 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.319891    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca"} err="failed to get container status \"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca\": rpc error: code = NotFound desc = could not find container \"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca\": container with ID starting with a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca not found: ID does not exist"
Oct 31 00:34:44.319980 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.319912    5946 scope.go:122] "RemoveContainer" containerID="3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7"
Oct 31 00:34:44.320152 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.320132    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7"} err="failed to get container status \"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7\": rpc error: code = NotFound desc = could not find container \"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7\": container with ID starting with 3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7 not found: ID does not exist"
Oct 31 00:34:44.320241 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.320154    5946 scope.go:122] "RemoveContainer" containerID="45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25"
Oct 31 00:34:44.320427 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.320402    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25"} err="failed to get container status \"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25\": rpc error: code = NotFound desc = could not find container \"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25\": container with ID starting with 45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25 not found: ID does not exist"
Oct 31 00:34:44.320427 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.320427    5946 scope.go:122] "RemoveContainer" containerID="004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612"
Oct 31 00:34:44.320694 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.320672    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612"} err="failed to get container status \"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612\": rpc error: code = NotFound desc = could not find container \"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612\": container with ID starting with 004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612 not found: ID does not exist"
Oct 31 00:34:44.320774 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.320695    5946 scope.go:122] "RemoveContainer" containerID="3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85"
Oct 31 00:34:44.320961 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.320940    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85"} err="failed to get container status \"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85\": rpc error: code = NotFound desc = could not find container \"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85\": container with ID starting with 3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85 not found: ID does not exist"
Oct 31 00:34:44.320961 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.320960    5946 scope.go:122] "RemoveContainer" containerID="af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d"
Oct 31 00:34:44.321213 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.321195    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d"} err="failed to get container status \"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d\": rpc error: code = NotFound desc = could not find container \"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d\": container with ID starting with af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d not found: ID does not exist"
Oct 31 00:34:44.321300 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.321214    5946 scope.go:122] "RemoveContainer" containerID="cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d"
Oct 31 00:34:44.321507 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.321487    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d"} err="failed to get container status \"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d\": rpc error: code = NotFound desc = could not find container \"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d\": container with ID starting with cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d not found: ID does not exist"
Oct 31 00:34:44.321507 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.321506    5946 scope.go:122] "RemoveContainer" containerID="a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca"
Oct 31 00:34:44.321806 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.321780    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca"} err="failed to get container status \"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca\": rpc error: code = NotFound desc = could not find container \"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca\": container with ID starting with a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca not found: ID does not exist"
Oct 31 00:34:44.321806 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.321806    5946 scope.go:122] "RemoveContainer" containerID="3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7"
Oct 31 00:34:44.322154 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.322126    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7"} err="failed to get container status \"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7\": rpc error: code = NotFound desc = could not find container \"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7\": container with ID starting with 3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7 not found: ID does not exist"
Oct 31 00:34:44.322272 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.322155    5946 scope.go:122] "RemoveContainer" containerID="45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25"
Oct 31 00:34:44.322755 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.322730    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25"} err="failed to get container status \"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25\": rpc error: code = NotFound desc = could not find container \"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25\": container with ID starting with 45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25 not found: ID does not exist"
Oct 31 00:34:44.322937 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.322756    5946 scope.go:122] "RemoveContainer" containerID="004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612"
Oct 31 00:34:44.323975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.323065    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Oct 31 00:34:44.323975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.323090    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Oct 31 00:34:44.323975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.323153    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Oct 31 00:34:44.323975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.323196    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Oct 31 00:34:44.323975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.323286    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Oct 31 00:34:44.323975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.323295    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-vfg6j\""
Oct 31 00:34:44.323975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.323391    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Oct 31 00:34:44.323975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.323430    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Oct 31 00:34:44.323975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.323436    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Oct 31 00:34:44.323975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.323481    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Oct 31 00:34:44.323975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.323555    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612"} err="failed to get container status \"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612\": rpc error: code = NotFound desc = could not find container \"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612\": container with ID starting with 004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612 not found: ID does not exist"
Oct 31 00:34:44.323975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.323583    5946 scope.go:122] "RemoveContainer" containerID="3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85"
Oct 31 00:34:44.323975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.323673    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Oct 31 00:34:44.323975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.323734    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8dk9u6m88n9h1\""
Oct 31 00:34:44.323975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.323832    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Oct 31 00:34:44.323975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.323902    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Oct 31 00:34:44.323975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.323935    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85"} err="failed to get container status \"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85\": rpc error: code = NotFound desc = could not find container \"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85\": container with ID starting with 3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85 not found: ID does not exist"
Oct 31 00:34:44.323975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.323952    5946 scope.go:122] "RemoveContainer" containerID="af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d"
Oct 31 00:34:44.324872 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.324072    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Oct 31 00:34:44.324872 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.324265    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d"} err="failed to get container status \"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d\": rpc error: code = NotFound desc = could not find container \"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d\": container with ID starting with af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d not found: ID does not exist"
Oct 31 00:34:44.324872 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.324292    5946 scope.go:122] "RemoveContainer" containerID="cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d"
Oct 31 00:34:44.324872 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.324608    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d"} err="failed to get container status \"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d\": rpc error: code = NotFound desc = could not find container \"cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d\": container with ID starting with cb4e9541149fc1f37cc30cd581fd2f5f9c286651a57b32273112b7f374b8ea2d not found: ID does not exist"
Oct 31 00:34:44.324872 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.324631    5946 scope.go:122] "RemoveContainer" containerID="a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca"
Oct 31 00:34:44.325086 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.324884    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca"} err="failed to get container status \"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca\": rpc error: code = NotFound desc = could not find container \"a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca\": container with ID starting with a1f5deb81cdf5ecc56f79fa856c5abf863dc7056d0817104cf330220e2608eca not found: ID does not exist"
Oct 31 00:34:44.325086 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.324898    5946 scope.go:122] "RemoveContainer" containerID="3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7"
Oct 31 00:34:44.325183 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.325131    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7"} err="failed to get container status \"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7\": rpc error: code = NotFound desc = could not find container \"3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7\": container with ID starting with 3f89fe782705e0f92286e411ce8f56005793376f79cd90313248cd16f4bee9f7 not found: ID does not exist"
Oct 31 00:34:44.325183 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.325154    5946 scope.go:122] "RemoveContainer" containerID="45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25"
Oct 31 00:34:44.325550 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.325465    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Oct 31 00:34:44.325550 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.325471    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Oct 31 00:34:44.325550 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.325470    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25"} err="failed to get container status \"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25\": rpc error: code = NotFound desc = could not find container \"45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25\": container with ID starting with 45edd0d61a9e603909b5b0b035bc62553fcd4af323d283e2f35e64083cd4ab25 not found: ID does not exist"
Oct 31 00:34:44.325550 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.325498    5946 scope.go:122] "RemoveContainer" containerID="004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612"
Oct 31 00:34:44.326624 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.326602    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612"} err="failed to get container status \"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612\": rpc error: code = NotFound desc = could not find container \"004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612\": container with ID starting with 004ef75b0c02a7fba288e9501bb3b8deca01d597d0f45a5b85c7447b502af612 not found: ID does not exist"
Oct 31 00:34:44.326624 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.326623    5946 scope.go:122] "RemoveContainer" containerID="3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85"
Oct 31 00:34:44.327065 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.327037    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85"} err="failed to get container status \"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85\": rpc error: code = NotFound desc = could not find container \"3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85\": container with ID starting with 3aacee2ae3c52baf12f181601f585fe45bab903c5e6e0fd483ad04ffdb441c85 not found: ID does not exist"
Oct 31 00:34:44.327065 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.327064    5946 scope.go:122] "RemoveContainer" containerID="af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d"
Oct 31 00:34:44.327363 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.327335    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d"} err="failed to get container status \"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d\": rpc error: code = NotFound desc = could not find container \"af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d\": container with ID starting with af9d3ef689bee80bfc1606e1621302d98b40a43c92e370e426b43c8d4ea4238d not found: ID does not exist"
Oct 31 00:34:44.334163 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.334139    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 31 00:34:44.414844 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.414767    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.414844 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.414809    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.414844 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.414839    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.415107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.414955    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.415107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.415031    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.415107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.415055    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.415107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.415075    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47r2h\" (UniqueName: \"kubernetes.io/projected/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-kube-api-access-47r2h\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.415107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.415105    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.415314 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.415200    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.415314 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.415243    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.415386 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.415309    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.415386 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.415376    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.415523 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.415401    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-web-config\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.415523 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.415446    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.415594 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.415567    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-config\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.415650 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.415633    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-config-out\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.415693 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.415659    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.415742 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.415713    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.415781 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.415744    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.415832 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.415817    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.516689 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.516658    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.516860 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.516703    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.516860 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.516725    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.516860 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.516783    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.516860 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.516800    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.516860 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.516823    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.516860 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.516858    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.517177 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.516898    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.517177 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.516919    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.517177 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.516939    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47r2h\" (UniqueName: \"kubernetes.io/projected/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-kube-api-access-47r2h\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.517177 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.516982    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.517177 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.517026    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.517177 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.517051    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.517177 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.517093    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.517177 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.517136    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.517177 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.517159    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-web-config\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.517629 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.517206    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.517629 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.517279    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-config\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.517629 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.517309    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.517629 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.517332    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-config-out\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.517629 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.517370    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.517629 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.517507    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.520019 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.518715    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.520019 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.519197    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.520019 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.519900    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.520262 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.520076    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.521612 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.520533    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.521612 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.520543    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.521612 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.520740    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-config-out\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.521612 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.520864    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.521612 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.520919    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.521612 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.521548    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.522364 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.522330    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-web-config\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.522746 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.522717    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.522864 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.522839    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-config\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.523028 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.523000    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.523382 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.523361    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.523876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.523856    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.525261 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.525242    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.529859 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.529835    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47r2h\" (UniqueName: \"kubernetes.io/projected/f721a015-70c1-4fb5-9bc8-c88e081a9ff5-kube-api-access-47r2h\") pod \"prometheus-k8s-0\" (UID: \"f721a015-70c1-4fb5-9bc8-c88e081a9ff5\") " pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.651540 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.651509    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:44.934369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:44.934336    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Oct 31 00:34:44.939007 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:34:44.938982    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf721a015_70c1_4fb5_9bc8_c88e081a9ff5.slice/crio-e384f7dcec17b4a7ed432c1fa29394b1267021b95be203aa90ff55135479101d WatchSource:0}: Error finding container e384f7dcec17b4a7ed432c1fa29394b1267021b95be203aa90ff55135479101d: Status 404 returned error can't find the container with id e384f7dcec17b4a7ed432c1fa29394b1267021b95be203aa90ff55135479101d
Oct 31 00:34:45.042692 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.042662    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-579b9db4b-hb7q9" podUID="610ed88a-261c-4503-b776-4a0c20b6cb07" containerName="console" containerID="cri-o://cad667997ceff2742d8cfeb5de234289f6f68d9dd94654fb8cf92a1085f1ce35" gracePeriod=15
Oct 31 00:34:45.044068 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.044041    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-console/console-7b5d6654d7-rbxn5" podUID="1e2c6645-71a9-4a48-883d-22c96ab5ab1b" containerName="console" containerID="cri-o://548c1fed8a98133e123a50f5eb121873215832c4634ac4281589e94170435d6d" gracePeriod=15
Oct 31 00:34:45.054817 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.054791    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1ff7973a-3f8a-4da8-a4c1-6d76b11515d1" path="/var/lib/kubelet/pods/1ff7973a-3f8a-4da8-a4c1-6d76b11515d1/volumes"
Oct 31 00:34:45.259196 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.259082    5946 generic.go:356] "Generic (PLEG): container finished" podID="1e2c6645-71a9-4a48-883d-22c96ab5ab1b" containerID="548c1fed8a98133e123a50f5eb121873215832c4634ac4281589e94170435d6d" exitCode=0
Oct 31 00:34:45.259196 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.259171    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5d6654d7-rbxn5" event={"ID":"1e2c6645-71a9-4a48-883d-22c96ab5ab1b","Type":"ContainerDied","Data":"548c1fed8a98133e123a50f5eb121873215832c4634ac4281589e94170435d6d"}
Oct 31 00:34:45.261359 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.261336    5946 generic.go:356] "Generic (PLEG): container finished" podID="610ed88a-261c-4503-b776-4a0c20b6cb07" containerID="cad667997ceff2742d8cfeb5de234289f6f68d9dd94654fb8cf92a1085f1ce35" exitCode=0
Oct 31 00:34:45.261483 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.261411    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-579b9db4b-hb7q9" event={"ID":"610ed88a-261c-4503-b776-4a0c20b6cb07","Type":"ContainerDied","Data":"cad667997ceff2742d8cfeb5de234289f6f68d9dd94654fb8cf92a1085f1ce35"}
Oct 31 00:34:45.263135 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.263113    5946 generic.go:356] "Generic (PLEG): container finished" podID="f721a015-70c1-4fb5-9bc8-c88e081a9ff5" containerID="d6970d862dfe4b9e595f5a73d99a29cea59c223eeafb18ebf1ddc82dec1e9446" exitCode=0
Oct 31 00:34:45.263262 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.263148    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f721a015-70c1-4fb5-9bc8-c88e081a9ff5","Type":"ContainerDied","Data":"d6970d862dfe4b9e595f5a73d99a29cea59c223eeafb18ebf1ddc82dec1e9446"}
Oct 31 00:34:45.263262 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.263213    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f721a015-70c1-4fb5-9bc8-c88e081a9ff5","Type":"ContainerStarted","Data":"e384f7dcec17b4a7ed432c1fa29394b1267021b95be203aa90ff55135479101d"}
Oct 31 00:34:45.324106 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.324083    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:45.339266 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.339212    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:45.427083 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427060    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle\") pod \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") "
Oct 31 00:34:45.427231 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427100    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert\") pod \"610ed88a-261c-4503-b776-4a0c20b6cb07\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") "
Oct 31 00:34:45.427231 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427121    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/610ed88a-261c-4503-b776-4a0c20b6cb07-tmp\" (UniqueName: \"kubernetes.io/empty-dir/610ed88a-261c-4503-b776-4a0c20b6cb07-tmp\") pod \"610ed88a-261c-4503-b776-4a0c20b6cb07\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") "
Oct 31 00:34:45.427365 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427265    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert\") pod \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") "
Oct 31 00:34:45.427365 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427330    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config\") pod \"610ed88a-261c-4503-b776-4a0c20b6cb07\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") "
Oct 31 00:34:45.427463 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427399    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert\") pod \"610ed88a-261c-4503-b776-4a0c20b6cb07\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") "
Oct 31 00:34:45.427463 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427417    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/610ed88a-261c-4503-b776-4a0c20b6cb07-tmp" pod "610ed88a-261c-4503-b776-4a0c20b6cb07" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:34:45.427463 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427430    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca\") pod \"610ed88a-261c-4503-b776-4a0c20b6cb07\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") "
Oct 31 00:34:45.427622 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427494    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca\") pod \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") "
Oct 31 00:34:45.427622 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427532    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config\") pod \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") "
Oct 31 00:34:45.427622 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427560    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-tmp\") pod \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") "
Oct 31 00:34:45.427622 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427580    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config\") pod \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") "
Oct 31 00:34:45.427622 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427601    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t\" (UniqueName: \"kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t\") pod \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") "
Oct 31 00:34:45.427622 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427604    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert" pod "610ed88a-261c-4503-b776-4a0c20b6cb07" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:34:45.427900 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427632    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle" pod "1e2c6645-71a9-4a48-883d-22c96ab5ab1b" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:34:45.427900 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427654    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert\") pod \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\" (UID: \"1e2c6645-71a9-4a48-883d-22c96ab5ab1b\") "
Oct 31 00:34:45.427900 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427677    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config\") pod \"610ed88a-261c-4503-b776-4a0c20b6cb07\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") "
Oct 31 00:34:45.427900 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427717    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm\" (UniqueName: \"kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm\") pod \"610ed88a-261c-4503-b776-4a0c20b6cb07\" (UID: \"610ed88a-261c-4503-b776-4a0c20b6cb07\") "
Oct 31 00:34:45.428092 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427967    5946 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-trusted-ca-bundle\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:45.428092 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.427986    5946 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-oauth-serving-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:45.428092 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.428000    5946 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/610ed88a-261c-4503-b776-4a0c20b6cb07-tmp\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:45.428092 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.428015    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-tmp" pod "1e2c6645-71a9-4a48-883d-22c96ab5ab1b" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b"). InnerVolumeSpecName "tmp". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:34:45.428092 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.428044    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config" pod "1e2c6645-71a9-4a48-883d-22c96ab5ab1b" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:34:45.428432 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.428399    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config" pod "610ed88a-261c-4503-b776-4a0c20b6cb07" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:34:45.428602 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.428582    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca" pod "610ed88a-261c-4503-b776-4a0c20b6cb07" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:34:45.428720 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.428609    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert" pod "1e2c6645-71a9-4a48-883d-22c96ab5ab1b" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:34:45.428777 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.428761    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca" pod "1e2c6645-71a9-4a48-883d-22c96ab5ab1b" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:34:45.431760 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.431607    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config" pod "1e2c6645-71a9-4a48-883d-22c96ab5ab1b" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:45.431760 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.431677    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config" pod "610ed88a-261c-4503-b776-4a0c20b6cb07" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:45.431760 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.431706    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm" pod "610ed88a-261c-4503-b776-4a0c20b6cb07" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07"). InnerVolumeSpecName "kube-api-access-crwrm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:34:45.431975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.431936    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t" pod "1e2c6645-71a9-4a48-883d-22c96ab5ab1b" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b"). InnerVolumeSpecName "kube-api-access-8sv6t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:34:45.432937 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.432902    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert" pod "610ed88a-261c-4503-b776-4a0c20b6cb07" (UID: "610ed88a-261c-4503-b776-4a0c20b6cb07"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:45.433109 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.433085    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert" pod "1e2c6645-71a9-4a48-883d-22c96ab5ab1b" (UID: "1e2c6645-71a9-4a48-883d-22c96ab5ab1b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:34:45.529107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.528539    5946 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-serving-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:45.529107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.528577    5946 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-console-config\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:45.529107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.528593    5946 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-serving-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:45.529107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.528606    5946 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/610ed88a-261c-4503-b776-4a0c20b6cb07-service-ca\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:45.529107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.528620    5946 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-service-ca\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:45.529107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.528633    5946 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-oauth-config\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:45.529107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.528645    5946 reconciler_common.go:299] "Volume detached for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-tmp\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:45.529107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.528659    5946 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-console-config\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:45.529107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.528672    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8sv6t\" (UniqueName: \"kubernetes.io/projected/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-kube-api-access-8sv6t\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:45.529107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.528685    5946 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1e2c6645-71a9-4a48-883d-22c96ab5ab1b-oauth-serving-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:45.529107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.528699    5946 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/610ed88a-261c-4503-b776-4a0c20b6cb07-console-oauth-config\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:45.529107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.528711    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crwrm\" (UniqueName: \"kubernetes.io/projected/610ed88a-261c-4503-b776-4a0c20b6cb07-kube-api-access-crwrm\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:34:45.597443 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:45.596002    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p2ntf"
Oct 31 00:34:46.269780 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.269744    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v" event={"ID":"454d11be-7d7f-483d-bc9d-b067e981a01a","Type":"ContainerStarted","Data":"ffbec8571697c0b992caa38d040fb6ebbbaeb4780fb5354f83486024a68629fe"}
Oct 31 00:34:46.270286 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.269823    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v" event={"ID":"454d11be-7d7f-483d-bc9d-b067e981a01a","Type":"ContainerStarted","Data":"382ea0be141ebdadd046e82abf7e5a0248f94a27efb51757ce29fdff31ee1185"}
Oct 31 00:34:46.270286 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.269848    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v" event={"ID":"454d11be-7d7f-483d-bc9d-b067e981a01a","Type":"ContainerStarted","Data":"87a8506723e3673f9d39e48f411a601a5608fbac27d18794e4b30f920000f263"}
Oct 31 00:34:46.271100 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.271072    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7b5d6654d7-rbxn5" event={"ID":"1e2c6645-71a9-4a48-883d-22c96ab5ab1b","Type":"ContainerDied","Data":"f910692db9b6381b02717abc4eff2dfc740a1e9be1b1489b3bd3aa8f1645b9a6"}
Oct 31 00:34:46.271100 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.271106    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7b5d6654d7-rbxn5"
Oct 31 00:34:46.271320 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.271128    5946 scope.go:122] "RemoveContainer" containerID="548c1fed8a98133e123a50f5eb121873215832c4634ac4281589e94170435d6d"
Oct 31 00:34:46.272450 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.272426    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-579b9db4b-hb7q9" event={"ID":"610ed88a-261c-4503-b776-4a0c20b6cb07","Type":"ContainerDied","Data":"adf334f33e47c7fcc6dbacf70ec1250e8f01a728479f699821d8ffaf197845ea"}
Oct 31 00:34:46.272450 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.272443    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-579b9db4b-hb7q9"
Oct 31 00:34:46.276302 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.276280    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f721a015-70c1-4fb5-9bc8-c88e081a9ff5","Type":"ContainerStarted","Data":"5cce5c253067e9c073eeef8b269efdf4105bd73a83a9ae19bb9041e5050e1fa8"}
Oct 31 00:34:46.276419 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.276330    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f721a015-70c1-4fb5-9bc8-c88e081a9ff5","Type":"ContainerStarted","Data":"a17fed233f9095ef1edef0db79972da15d6d79cb9217c122b6c7a34ed48d964a"}
Oct 31 00:34:46.276419 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.276356    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f721a015-70c1-4fb5-9bc8-c88e081a9ff5","Type":"ContainerStarted","Data":"a21a5b190ffb1b4ae027bbe22448acd02a612592536edd2fc527ea0190b0dc1a"}
Oct 31 00:34:46.276522 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.276423    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f721a015-70c1-4fb5-9bc8-c88e081a9ff5","Type":"ContainerStarted","Data":"63ee68d87d595b4584b8c9f58b7ded974b826061a68de6058c143a16344f5dd9"}
Oct 31 00:34:46.276522 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.276461    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f721a015-70c1-4fb5-9bc8-c88e081a9ff5","Type":"ContainerStarted","Data":"032fd6999c001e53551ab33a5ffb41800b34f0a7ebd8015dacd90459cc141311"}
Oct 31 00:34:46.276522 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.276505    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"f721a015-70c1-4fb5-9bc8-c88e081a9ff5","Type":"ContainerStarted","Data":"035833195a9844783037d2b97c942e2ef236b02599d733f64c699575833a0d3b"}
Oct 31 00:34:46.280388 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.280372    5946 scope.go:122] "RemoveContainer" containerID="cad667997ceff2742d8cfeb5de234289f6f68d9dd94654fb8cf92a1085f1ce35"
Oct 31 00:34:46.309206 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.309169    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-7bbf6745c4-jmx5v" podStartSLOduration=1.166845456 podStartE2EDuration="3.309156749s" totalImagesPullingTime="2.142311293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:34:46.307649276 +0000 UTC m=+27.380689359" watchObservedRunningTime="2026-10-31 00:34:46.309156749 +0000 UTC m=+27.382196827"
Oct 31 00:34:46.333868 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.333843    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-579b9db4b-hb7q9"]
Oct 31 00:34:46.338809 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.338767    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-579b9db4b-hb7q9"]
Oct 31 00:34:46.352614 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.352593    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7b5d6654d7-rbxn5"]
Oct 31 00:34:46.357051 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.357032    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7b5d6654d7-rbxn5"]
Oct 31 00:34:46.387737 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:46.387656    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.363648629 podStartE2EDuration="2.387641035s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.992406ms" isStatefulPod=false podCreationTimestamp="2026-10-31 00:34:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:34:46.386198119 +0000 UTC m=+27.459238224" watchObservedRunningTime="2026-10-31 00:34:46.387641035 +0000 UTC m=+27.460681118"
Oct 31 00:34:47.061387 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:47.061351    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1e2c6645-71a9-4a48-883d-22c96ab5ab1b" path="/var/lib/kubelet/pods/1e2c6645-71a9-4a48-883d-22c96ab5ab1b/volumes"
Oct 31 00:34:47.062196 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:47.062166    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="610ed88a-261c-4503-b776-4a0c20b6cb07" path="/var/lib/kubelet/pods/610ed88a-261c-4503-b776-4a0c20b6cb07/volumes"
Oct 31 00:34:49.652450 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:49.652420    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:34:55.514599 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:34:55.514571    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wf75m"
Oct 31 00:35:11.378904 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:35:11.378865    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:35:27.298439 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:35:27.298400    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:35:27.313778 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:35:27.313752    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:35:27.458177 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:35:27.458153    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Oct 31 00:35:41.379603 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:35:41.379569    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:36:11.379950 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:36:11.379861    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:36:41.379972 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:36:41.379940    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:37:11.379293 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:37:11.379256    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:37:41.379507 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:37:41.379465    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:38:11.380527 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:38:11.380480    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:38:13.573125 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.573094    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"]
Oct 31 00:38:13.573643 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.573419    5946 cpu_manager.go:414] "containerMap: removing container" podUID="610ed88a-261c-4503-b776-4a0c20b6cb07" containerName="console"
Oct 31 00:38:13.573643 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.573430    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="610ed88a-261c-4503-b776-4a0c20b6cb07" containerName="console"
Oct 31 00:38:13.573643 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.573466    5946 cpu_manager.go:414] "containerMap: removing container" podUID="1e2c6645-71a9-4a48-883d-22c96ab5ab1b" containerName="console"
Oct 31 00:38:13.573643 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.573472    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1e2c6645-71a9-4a48-883d-22c96ab5ab1b" containerName="console"
Oct 31 00:38:13.573643 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.573516    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="1e2c6645-71a9-4a48-883d-22c96ab5ab1b" containerName="console"
Oct 31 00:38:13.573643 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.573524    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="610ed88a-261c-4503-b776-4a0c20b6cb07" containerName="console"
Oct 31 00:38:13.576558 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.576538    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.612209 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.612175    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"]
Oct 31 00:38:13.648048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.648016    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/920e3b17-fdda-4148-87ff-7b3651044974-metrics-cert\") pod \"opendatahub-operator-controller-manager-54459f848c-m5949\" (UID: \"920e3b17-fdda-4148-87ff-7b3651044974\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.648198 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.648057    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/920e3b17-fdda-4148-87ff-7b3651044974-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54459f848c-m5949\" (UID: \"920e3b17-fdda-4148-87ff-7b3651044974\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.648198 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.648096    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/920e3b17-fdda-4148-87ff-7b3651044974-tmp\") pod \"opendatahub-operator-controller-manager-54459f848c-m5949\" (UID: \"920e3b17-fdda-4148-87ff-7b3651044974\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.648198 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.648159    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/920e3b17-fdda-4148-87ff-7b3651044974-manifests\") pod \"opendatahub-operator-controller-manager-54459f848c-m5949\" (UID: \"920e3b17-fdda-4148-87ff-7b3651044974\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.648198 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.648191    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/920e3b17-fdda-4148-87ff-7b3651044974-webhook-cert\") pod \"opendatahub-operator-controller-manager-54459f848c-m5949\" (UID: \"920e3b17-fdda-4148-87ff-7b3651044974\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.648419 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.648243    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xm52k\" (UniqueName: \"kubernetes.io/projected/920e3b17-fdda-4148-87ff-7b3651044974-kube-api-access-xm52k\") pod \"opendatahub-operator-controller-manager-54459f848c-m5949\" (UID: \"920e3b17-fdda-4148-87ff-7b3651044974\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.662767 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.662742    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-webhook-cert\""
Oct 31 00:38:13.663743 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.663720    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-service-cert\""
Oct 31 00:38:13.663861 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.663768    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-controller-manager-dockercfg-j6mcx\""
Oct 31 00:38:13.663989 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.663976    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub-operator-system\"/\"opendatahub-operator-metrics-tls\""
Oct 31 00:38:13.664652 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.664639    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"kube-root-ca.crt\""
Oct 31 00:38:13.664722 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.664645    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub-operator-system\"/\"openshift-service-ca.crt\""
Oct 31 00:38:13.749450 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.749420    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/920e3b17-fdda-4148-87ff-7b3651044974-manifests\") pod \"opendatahub-operator-controller-manager-54459f848c-m5949\" (UID: \"920e3b17-fdda-4148-87ff-7b3651044974\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.749582 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.749461    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/920e3b17-fdda-4148-87ff-7b3651044974-webhook-cert\") pod \"opendatahub-operator-controller-manager-54459f848c-m5949\" (UID: \"920e3b17-fdda-4148-87ff-7b3651044974\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.749582 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.749483    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xm52k\" (UniqueName: \"kubernetes.io/projected/920e3b17-fdda-4148-87ff-7b3651044974-kube-api-access-xm52k\") pod \"opendatahub-operator-controller-manager-54459f848c-m5949\" (UID: \"920e3b17-fdda-4148-87ff-7b3651044974\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.749582 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.749528    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/920e3b17-fdda-4148-87ff-7b3651044974-metrics-cert\") pod \"opendatahub-operator-controller-manager-54459f848c-m5949\" (UID: \"920e3b17-fdda-4148-87ff-7b3651044974\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.749582 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.749551    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/920e3b17-fdda-4148-87ff-7b3651044974-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54459f848c-m5949\" (UID: \"920e3b17-fdda-4148-87ff-7b3651044974\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.749769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.749590    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/920e3b17-fdda-4148-87ff-7b3651044974-tmp\") pod \"opendatahub-operator-controller-manager-54459f848c-m5949\" (UID: \"920e3b17-fdda-4148-87ff-7b3651044974\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.749914 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.749890    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/920e3b17-fdda-4148-87ff-7b3651044974-manifests\") pod \"opendatahub-operator-controller-manager-54459f848c-m5949\" (UID: \"920e3b17-fdda-4148-87ff-7b3651044974\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.751737 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.751715    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/920e3b17-fdda-4148-87ff-7b3651044974-tmp\") pod \"opendatahub-operator-controller-manager-54459f848c-m5949\" (UID: \"920e3b17-fdda-4148-87ff-7b3651044974\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.752014 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.751993    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/920e3b17-fdda-4148-87ff-7b3651044974-apiservice-cert\") pod \"opendatahub-operator-controller-manager-54459f848c-m5949\" (UID: \"920e3b17-fdda-4148-87ff-7b3651044974\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.752264 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.752249    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/920e3b17-fdda-4148-87ff-7b3651044974-webhook-cert\") pod \"opendatahub-operator-controller-manager-54459f848c-m5949\" (UID: \"920e3b17-fdda-4148-87ff-7b3651044974\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.752315 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.752299    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/920e3b17-fdda-4148-87ff-7b3651044974-metrics-cert\") pod \"opendatahub-operator-controller-manager-54459f848c-m5949\" (UID: \"920e3b17-fdda-4148-87ff-7b3651044974\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.767445 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.767423    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xm52k\" (UniqueName: \"kubernetes.io/projected/920e3b17-fdda-4148-87ff-7b3651044974-kube-api-access-xm52k\") pod \"opendatahub-operator-controller-manager-54459f848c-m5949\" (UID: \"920e3b17-fdda-4148-87ff-7b3651044974\") " pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:13.891024 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:13.890946    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:14.211701 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:14.211622    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"]
Oct 31 00:38:14.216800 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:38:14.216773    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod920e3b17_fdda_4148_87ff_7b3651044974.slice/crio-5e0a5865bacc0d744216d124a497f1e59956df4b149bc3e78f131c51b46589f3 WatchSource:0}: Error finding container 5e0a5865bacc0d744216d124a497f1e59956df4b149bc3e78f131c51b46589f3: Status 404 returned error can't find the container with id 5e0a5865bacc0d744216d124a497f1e59956df4b149bc3e78f131c51b46589f3
Oct 31 00:38:15.043335 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:15.043252    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949" event={"ID":"920e3b17-fdda-4148-87ff-7b3651044974","Type":"ContainerStarted","Data":"5e0a5865bacc0d744216d124a497f1e59956df4b149bc3e78f131c51b46589f3"}
Oct 31 00:38:18.056751 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:18.056719    5946 generic.go:356] "Generic (PLEG): container finished" podID="920e3b17-fdda-4148-87ff-7b3651044974" containerID="1e28784740c168796353f54fd52ebd8dbb3cd4a75cd396385e9bcc4ee513fe9c" exitCode=0
Oct 31 00:38:18.057134 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:18.056803    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949" event={"ID":"920e3b17-fdda-4148-87ff-7b3651044974","Type":"ContainerDied","Data":"1e28784740c168796353f54fd52ebd8dbb3cd4a75cd396385e9bcc4ee513fe9c"}
Oct 31 00:38:19.062446 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:19.062414    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949" event={"ID":"920e3b17-fdda-4148-87ff-7b3651044974","Type":"ContainerStarted","Data":"de81e0628bbd26f89f57057112f6ae240efdc14f97186bd046fc541532464771"}
Oct 31 00:38:19.062813 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:19.062638    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:19.094474 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:19.094430    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949" podStartSLOduration=2.341060073 podStartE2EDuration="6.094418131s" totalImagesPullingTime="3.316660519s" totalInitContainerRuntime="436.697539ms" isStatefulPod=false podCreationTimestamp="2026-10-31 00:38:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:38:19.09289884 +0000 UTC m=+240.165938951" watchObservedRunningTime="2026-10-31 00:38:19.094418131 +0000 UTC m=+240.167458210"
Oct 31 00:38:24.310163 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.310130    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-vkhpd"]
Oct 31 00:38:24.316716 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.316697    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vkhpd"
Oct 31 00:38:24.321387 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.321357    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-vkhpd"]
Oct 31 00:38:24.324194 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.324168    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Oct 31 00:38:24.324505 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.324483    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Oct 31 00:38:24.324601 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.324554    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Oct 31 00:38:24.324693 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.324680    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Oct 31 00:38:24.324787 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.324773    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sg7x8\""
Oct 31 00:38:24.449009 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.448978    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f58965a7-39ae-47d5-bf97-9ba80c44fe39-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-vkhpd\" (UID: \"f58965a7-39ae-47d5-bf97-9ba80c44fe39\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vkhpd"
Oct 31 00:38:24.449189 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.449026    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f58965a7-39ae-47d5-bf97-9ba80c44fe39-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-vkhpd\" (UID: \"f58965a7-39ae-47d5-bf97-9ba80c44fe39\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vkhpd"
Oct 31 00:38:24.449189 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.449050    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c54fr\" (UniqueName: \"kubernetes.io/projected/f58965a7-39ae-47d5-bf97-9ba80c44fe39-kube-api-access-c54fr\") pod \"kuadrant-console-plugin-66c4fb575d-vkhpd\" (UID: \"f58965a7-39ae-47d5-bf97-9ba80c44fe39\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vkhpd"
Oct 31 00:38:24.551147 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.551110    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f58965a7-39ae-47d5-bf97-9ba80c44fe39-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-vkhpd\" (UID: \"f58965a7-39ae-47d5-bf97-9ba80c44fe39\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vkhpd"
Oct 31 00:38:24.551921 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.551897    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f58965a7-39ae-47d5-bf97-9ba80c44fe39-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-vkhpd\" (UID: \"f58965a7-39ae-47d5-bf97-9ba80c44fe39\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vkhpd"
Oct 31 00:38:24.552786 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.552768    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c54fr\" (UniqueName: \"kubernetes.io/projected/f58965a7-39ae-47d5-bf97-9ba80c44fe39-kube-api-access-c54fr\") pod \"kuadrant-console-plugin-66c4fb575d-vkhpd\" (UID: \"f58965a7-39ae-47d5-bf97-9ba80c44fe39\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vkhpd"
Oct 31 00:38:24.553538 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.552713    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f58965a7-39ae-47d5-bf97-9ba80c44fe39-nginx-conf\") pod \"kuadrant-console-plugin-66c4fb575d-vkhpd\" (UID: \"f58965a7-39ae-47d5-bf97-9ba80c44fe39\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vkhpd"
Oct 31 00:38:24.556125 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.556101    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/f58965a7-39ae-47d5-bf97-9ba80c44fe39-plugin-serving-cert\") pod \"kuadrant-console-plugin-66c4fb575d-vkhpd\" (UID: \"f58965a7-39ae-47d5-bf97-9ba80c44fe39\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vkhpd"
Oct 31 00:38:24.564607 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.564562    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c54fr\" (UniqueName: \"kubernetes.io/projected/f58965a7-39ae-47d5-bf97-9ba80c44fe39-kube-api-access-c54fr\") pod \"kuadrant-console-plugin-66c4fb575d-vkhpd\" (UID: \"f58965a7-39ae-47d5-bf97-9ba80c44fe39\") " pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vkhpd"
Oct 31 00:38:24.639551 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.639517    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vkhpd"
Oct 31 00:38:24.918098 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:24.918028    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66c4fb575d-vkhpd"]
Oct 31 00:38:24.921100 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:38:24.921069    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf58965a7_39ae_47d5_bf97_9ba80c44fe39.slice/crio-ee4ebf4e54b97a643c462aa4375b3567417c61fb62446b457f49c9c600d1c815 WatchSource:0}: Error finding container ee4ebf4e54b97a643c462aa4375b3567417c61fb62446b457f49c9c600d1c815: Status 404 returned error can't find the container with id ee4ebf4e54b97a643c462aa4375b3567417c61fb62446b457f49c9c600d1c815
Oct 31 00:38:25.083345 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:25.083313    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vkhpd" event={"ID":"f58965a7-39ae-47d5-bf97-9ba80c44fe39","Type":"ContainerStarted","Data":"ee4ebf4e54b97a643c462aa4375b3567417c61fb62446b457f49c9c600d1c815"}
Oct 31 00:38:25.728192 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:25.728162    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs"]
Oct 31 00:38:25.733509 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:25.733493    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs"
Oct 31 00:38:25.736756 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:25.736737    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-cscnb\""
Oct 31 00:38:25.737661 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:25.737640    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:38:25.737661 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:25.737646    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Oct 31 00:38:25.747020 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:25.746997    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs"]
Oct 31 00:38:25.864814 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:25.864777    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgcw2\" (UniqueName: \"kubernetes.io/projected/02618bf9-ffb8-44a2-93f5-0951093ce4e8-kube-api-access-jgcw2\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs\" (UID: \"02618bf9-ffb8-44a2-93f5-0951093ce4e8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs"
Oct 31 00:38:25.864987 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:25.864927    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02618bf9-ffb8-44a2-93f5-0951093ce4e8-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs\" (UID: \"02618bf9-ffb8-44a2-93f5-0951093ce4e8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs"
Oct 31 00:38:25.965541 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:25.965504    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02618bf9-ffb8-44a2-93f5-0951093ce4e8-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs\" (UID: \"02618bf9-ffb8-44a2-93f5-0951093ce4e8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs"
Oct 31 00:38:25.965700 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:25.965551    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgcw2\" (UniqueName: \"kubernetes.io/projected/02618bf9-ffb8-44a2-93f5-0951093ce4e8-kube-api-access-jgcw2\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs\" (UID: \"02618bf9-ffb8-44a2-93f5-0951093ce4e8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs"
Oct 31 00:38:25.965921 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:25.965898    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02618bf9-ffb8-44a2-93f5-0951093ce4e8-tmp\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs\" (UID: \"02618bf9-ffb8-44a2-93f5-0951093ce4e8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs"
Oct 31 00:38:25.975813 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:25.975788    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgcw2\" (UniqueName: \"kubernetes.io/projected/02618bf9-ffb8-44a2-93f5-0951093ce4e8-kube-api-access-jgcw2\") pod \"cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs\" (UID: \"02618bf9-ffb8-44a2-93f5-0951093ce4e8\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs"
Oct 31 00:38:26.045656 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:26.045579    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs"
Oct 31 00:38:26.341011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:26.340978    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs"]
Oct 31 00:38:26.355656 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:38:26.355622    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02618bf9_ffb8_44a2_93f5_0951093ce4e8.slice/crio-459c8d548afdd0d3221885e1fda44d18c58f4d87287d5f3424b10a3ef1c71733 WatchSource:0}: Error finding container 459c8d548afdd0d3221885e1fda44d18c58f4d87287d5f3424b10a3ef1c71733: Status 404 returned error can't find the container with id 459c8d548afdd0d3221885e1fda44d18c58f4d87287d5f3424b10a3ef1c71733
Oct 31 00:38:27.094271 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:27.094232    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs" event={"ID":"02618bf9-ffb8-44a2-93f5-0951093ce4e8","Type":"ContainerStarted","Data":"459c8d548afdd0d3221885e1fda44d18c58f4d87287d5f3424b10a3ef1c71733"}
Oct 31 00:38:28.536007 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:28.534567    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-gkhpl"]
Oct 31 00:38:28.545069 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:28.545046    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-gkhpl"
Oct 31 00:38:28.547562 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:28.547514    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-gkhpl"]
Oct 31 00:38:28.549374 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:28.549354    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-nskbc\""
Oct 31 00:38:28.549495 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:28.549431    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\""
Oct 31 00:38:28.549555 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:28.549501    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\""
Oct 31 00:38:28.693358 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:28.693273    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q98h2\" (UniqueName: \"kubernetes.io/projected/7757dc7e-a800-46fc-99a9-1a4d46231066-kube-api-access-q98h2\") pod \"jobset-operator-674cd59dc5-gkhpl\" (UID: \"7757dc7e-a800-46fc-99a9-1a4d46231066\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-gkhpl"
Oct 31 00:38:28.693638 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:28.693466    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7757dc7e-a800-46fc-99a9-1a4d46231066-tmp\") pod \"jobset-operator-674cd59dc5-gkhpl\" (UID: \"7757dc7e-a800-46fc-99a9-1a4d46231066\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-gkhpl"
Oct 31 00:38:28.794408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:28.794333    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7757dc7e-a800-46fc-99a9-1a4d46231066-tmp\") pod \"jobset-operator-674cd59dc5-gkhpl\" (UID: \"7757dc7e-a800-46fc-99a9-1a4d46231066\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-gkhpl"
Oct 31 00:38:28.794582 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:28.794516    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q98h2\" (UniqueName: \"kubernetes.io/projected/7757dc7e-a800-46fc-99a9-1a4d46231066-kube-api-access-q98h2\") pod \"jobset-operator-674cd59dc5-gkhpl\" (UID: \"7757dc7e-a800-46fc-99a9-1a4d46231066\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-gkhpl"
Oct 31 00:38:28.794763 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:28.794740    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7757dc7e-a800-46fc-99a9-1a4d46231066-tmp\") pod \"jobset-operator-674cd59dc5-gkhpl\" (UID: \"7757dc7e-a800-46fc-99a9-1a4d46231066\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-gkhpl"
Oct 31 00:38:28.802735 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:28.802705    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q98h2\" (UniqueName: \"kubernetes.io/projected/7757dc7e-a800-46fc-99a9-1a4d46231066-kube-api-access-q98h2\") pod \"jobset-operator-674cd59dc5-gkhpl\" (UID: \"7757dc7e-a800-46fc-99a9-1a4d46231066\") " pod="openshift-jobset-operator/jobset-operator-674cd59dc5-gkhpl"
Oct 31 00:38:28.861591 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:28.861545    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-gkhpl"
Oct 31 00:38:29.155279 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:29.155248    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-674cd59dc5-gkhpl"]
Oct 31 00:38:29.158665 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:38:29.158636    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7757dc7e_a800_46fc_99a9_1a4d46231066.slice/crio-4291750873e8b8bad89e1604db896db4dbd3872459f1bcb40d7b6c81dd5dbc27 WatchSource:0}: Error finding container 4291750873e8b8bad89e1604db896db4dbd3872459f1bcb40d7b6c81dd5dbc27: Status 404 returned error can't find the container with id 4291750873e8b8bad89e1604db896db4dbd3872459f1bcb40d7b6c81dd5dbc27
Oct 31 00:38:30.068492 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:30.068461    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub-operator-system/opendatahub-operator-controller-manager-54459f848c-m5949"
Oct 31 00:38:30.111711 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:30.111668    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs" event={"ID":"02618bf9-ffb8-44a2-93f5-0951093ce4e8","Type":"ContainerStarted","Data":"1e38998343037c1a0adf1efa6eb9b3b6800205d9a5c1ca6e08219a1029ed7cb6"}
Oct 31 00:38:30.113237 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:30.113192    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-gkhpl" event={"ID":"7757dc7e-a800-46fc-99a9-1a4d46231066","Type":"ContainerStarted","Data":"4291750873e8b8bad89e1604db896db4dbd3872459f1bcb40d7b6c81dd5dbc27"}
Oct 31 00:38:30.143125 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:30.143063    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-7d87bcd5fd-zhnjs" podStartSLOduration=1.9328076809999999 podStartE2EDuration="5.143042733s" totalImagesPullingTime="3.210235052s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:38:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:38:30.142154044 +0000 UTC m=+251.215194138" watchObservedRunningTime="2026-10-31 00:38:30.143042733 +0000 UTC m=+251.216082816"
Oct 31 00:38:31.121066 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:31.121030    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vkhpd" event={"ID":"f58965a7-39ae-47d5-bf97-9ba80c44fe39","Type":"ContainerStarted","Data":"3e34548a6febec49809a71ed63bc97a89cc949c696608a4e365126fa14ffa9cb"}
Oct 31 00:38:31.142063 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:31.142019    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66c4fb575d-vkhpd" podStartSLOduration=1.314921995 podStartE2EDuration="7.142005035s" totalImagesPullingTime="5.82708304s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:38:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:38:31.141344544 +0000 UTC m=+252.214384627" watchObservedRunningTime="2026-10-31 00:38:31.142005035 +0000 UTC m=+252.215045116"
Oct 31 00:38:31.665434 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:31.665400    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-zmrfp"]
Oct 31 00:38:31.675105 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:31.675079    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-zmrfp"
Oct 31 00:38:31.682802 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:31.682773    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-zmrfp"]
Oct 31 00:38:31.685526 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:31.685502    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Oct 31 00:38:31.685631 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:31.685565    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Oct 31 00:38:31.685695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:31.685687    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jrlgz\""
Oct 31 00:38:31.828246 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:31.828186    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbnk9\" (UniqueName: \"kubernetes.io/projected/94a8f262-6522-4322-8e27-b3be3a9f79a8-kube-api-access-gbnk9\") pod \"cert-manager-webhook-5dbbbf75cc-zmrfp\" (UID: \"94a8f262-6522-4322-8e27-b3be3a9f79a8\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-zmrfp"
Oct 31 00:38:31.828438 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:31.828339    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94a8f262-6522-4322-8e27-b3be3a9f79a8-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-zmrfp\" (UID: \"94a8f262-6522-4322-8e27-b3be3a9f79a8\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-zmrfp"
Oct 31 00:38:31.929723 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:31.929649    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94a8f262-6522-4322-8e27-b3be3a9f79a8-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-zmrfp\" (UID: \"94a8f262-6522-4322-8e27-b3be3a9f79a8\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-zmrfp"
Oct 31 00:38:31.929878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:31.929735    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbnk9\" (UniqueName: \"kubernetes.io/projected/94a8f262-6522-4322-8e27-b3be3a9f79a8-kube-api-access-gbnk9\") pod \"cert-manager-webhook-5dbbbf75cc-zmrfp\" (UID: \"94a8f262-6522-4322-8e27-b3be3a9f79a8\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-zmrfp"
Oct 31 00:38:31.937661 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:31.937636    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/94a8f262-6522-4322-8e27-b3be3a9f79a8-bound-sa-token\") pod \"cert-manager-webhook-5dbbbf75cc-zmrfp\" (UID: \"94a8f262-6522-4322-8e27-b3be3a9f79a8\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-zmrfp"
Oct 31 00:38:31.937661 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:31.937653    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbnk9\" (UniqueName: \"kubernetes.io/projected/94a8f262-6522-4322-8e27-b3be3a9f79a8-kube-api-access-gbnk9\") pod \"cert-manager-webhook-5dbbbf75cc-zmrfp\" (UID: \"94a8f262-6522-4322-8e27-b3be3a9f79a8\") " pod="cert-manager/cert-manager-webhook-5dbbbf75cc-zmrfp"
Oct 31 00:38:31.990355 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:31.990325    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-zmrfp"
Oct 31 00:38:32.268755 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:32.268726    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-5dbbbf75cc-zmrfp"]
Oct 31 00:38:32.271488 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:38:32.271460    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94a8f262_6522_4322_8e27_b3be3a9f79a8.slice/crio-0e9aa36878671b470a5f2c7992544ac46cdd3e16d06fd944d001fcaf44d0df01 WatchSource:0}: Error finding container 0e9aa36878671b470a5f2c7992544ac46cdd3e16d06fd944d001fcaf44d0df01: Status 404 returned error can't find the container with id 0e9aa36878671b470a5f2c7992544ac46cdd3e16d06fd944d001fcaf44d0df01
Oct 31 00:38:33.132287 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:33.132246    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-zmrfp" event={"ID":"94a8f262-6522-4322-8e27-b3be3a9f79a8","Type":"ContainerStarted","Data":"0e9aa36878671b470a5f2c7992544ac46cdd3e16d06fd944d001fcaf44d0df01"}
Oct 31 00:38:33.134465 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:33.134437    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-gkhpl" event={"ID":"7757dc7e-a800-46fc-99a9-1a4d46231066","Type":"ContainerStarted","Data":"ab1bc6172282cec9e7b17f0fec82a3e6485f7b135eaa6134bb3cb55d13f486c2"}
Oct 31 00:38:33.152271 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:33.152207    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-674cd59dc5-gkhpl" podStartSLOduration=1.859868213 podStartE2EDuration="5.152194417s" totalImagesPullingTime="3.292326204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:38:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:38:33.152172919 +0000 UTC m=+254.225213002" watchObservedRunningTime="2026-10-31 00:38:33.152194417 +0000 UTC m=+254.225234493"
Oct 31 00:38:36.149515 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:36.149476    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-zmrfp" event={"ID":"94a8f262-6522-4322-8e27-b3be3a9f79a8","Type":"ContainerStarted","Data":"1450bfa09070a69d5159a8f6ef831cef4d78b3996e124417f9cc131b6fbfa860"}
Oct 31 00:38:36.149901 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:36.149593    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-zmrfp"
Oct 31 00:38:36.166611 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:36.166563    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-zmrfp" podStartSLOduration=2.310813832 podStartE2EDuration="5.166549748s" totalImagesPullingTime="2.855735916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:38:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:38:36.16576735 +0000 UTC m=+257.238807432" watchObservedRunningTime="2026-10-31 00:38:36.166549748 +0000 UTC m=+257.239589829"
Oct 31 00:38:38.621825 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:38.621789    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-66q22"]
Oct 31 00:38:38.625500 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:38.625478    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-66q22"
Oct 31 00:38:38.632898 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:38.632876    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-ft9sf\""
Oct 31 00:38:38.633724 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:38.633705    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-66q22"]
Oct 31 00:38:38.706949 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:38.706911    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5fnx\" (UniqueName: \"kubernetes.io/projected/3745eece-3037-48fd-af45-b9ccd3d2af7c-kube-api-access-x5fnx\") pod \"cert-manager-cainjector-5c57bbd4fc-66q22\" (UID: \"3745eece-3037-48fd-af45-b9ccd3d2af7c\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-66q22"
Oct 31 00:38:38.707111 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:38.706951    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3745eece-3037-48fd-af45-b9ccd3d2af7c-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-66q22\" (UID: \"3745eece-3037-48fd-af45-b9ccd3d2af7c\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-66q22"
Oct 31 00:38:38.807584 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:38.807547    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5fnx\" (UniqueName: \"kubernetes.io/projected/3745eece-3037-48fd-af45-b9ccd3d2af7c-kube-api-access-x5fnx\") pod \"cert-manager-cainjector-5c57bbd4fc-66q22\" (UID: \"3745eece-3037-48fd-af45-b9ccd3d2af7c\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-66q22"
Oct 31 00:38:38.807584 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:38.807583    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3745eece-3037-48fd-af45-b9ccd3d2af7c-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-66q22\" (UID: \"3745eece-3037-48fd-af45-b9ccd3d2af7c\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-66q22"
Oct 31 00:38:38.818134 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:38.818107    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/3745eece-3037-48fd-af45-b9ccd3d2af7c-bound-sa-token\") pod \"cert-manager-cainjector-5c57bbd4fc-66q22\" (UID: \"3745eece-3037-48fd-af45-b9ccd3d2af7c\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-66q22"
Oct 31 00:38:38.818506 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:38.818483    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5fnx\" (UniqueName: \"kubernetes.io/projected/3745eece-3037-48fd-af45-b9ccd3d2af7c-kube-api-access-x5fnx\") pod \"cert-manager-cainjector-5c57bbd4fc-66q22\" (UID: \"3745eece-3037-48fd-af45-b9ccd3d2af7c\") " pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-66q22"
Oct 31 00:38:38.937191 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:38.937116    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-66q22"
Oct 31 00:38:39.208994 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:39.208970    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-5c57bbd4fc-66q22"]
Oct 31 00:38:39.211561 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:38:39.211532    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3745eece_3037_48fd_af45_b9ccd3d2af7c.slice/crio-3dd904432c0ce219500e2cc9cc8bc11746fe896f5fc34cd4c8b81ca1e797a72b WatchSource:0}: Error finding container 3dd904432c0ce219500e2cc9cc8bc11746fe896f5fc34cd4c8b81ca1e797a72b: Status 404 returned error can't find the container with id 3dd904432c0ce219500e2cc9cc8bc11746fe896f5fc34cd4c8b81ca1e797a72b
Oct 31 00:38:40.168244 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:40.168191    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-66q22" event={"ID":"3745eece-3037-48fd-af45-b9ccd3d2af7c","Type":"ContainerStarted","Data":"56b3714bff04f44d4222e82ccd0d9a078b70afe5ba0420ef0dad9945bee60977"}
Oct 31 00:38:40.168244 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:40.168253    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-66q22" event={"ID":"3745eece-3037-48fd-af45-b9ccd3d2af7c","Type":"ContainerStarted","Data":"3dd904432c0ce219500e2cc9cc8bc11746fe896f5fc34cd4c8b81ca1e797a72b"}
Oct 31 00:38:40.183436 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:40.183389    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-5c57bbd4fc-66q22" podStartSLOduration=2.183373776 podStartE2EDuration="2.183373776s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:38:40.182424244 +0000 UTC m=+261.255464326" watchObservedRunningTime="2026-10-31 00:38:40.183373776 +0000 UTC m=+261.256413855"
Oct 31 00:38:41.379961 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:38:41.379926    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:38:42.155685 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:42.155657    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-5dbbbf75cc-zmrfp"
Oct 31 00:38:43.965131 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:43.965100    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-b544748f5-62f46"]
Oct 31 00:38:43.969888 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:43.969864    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b544748f5-62f46"
Oct 31 00:38:43.979460 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:43.979433    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b544748f5-62f46"]
Oct 31 00:38:43.981191 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:43.981159    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Oct 31 00:38:43.981301 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:43.981244    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Oct 31 00:38:44.001101 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.001075    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-gddhf\""
Oct 31 00:38:44.001101 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.001086    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Oct 31 00:38:44.001304 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.001129    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Oct 31 00:38:44.043934 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.043898    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd37a6d5-9adf-425b-aa93-77574694247e-tmp\") pod \"kube-auth-proxy-b544748f5-62f46\" (UID: \"bd37a6d5-9adf-425b-aa93-77574694247e\") " pod="openshift-ingress/kube-auth-proxy-b544748f5-62f46"
Oct 31 00:38:44.044084 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.044037    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7lm6\" (UniqueName: \"kubernetes.io/projected/bd37a6d5-9adf-425b-aa93-77574694247e-kube-api-access-v7lm6\") pod \"kube-auth-proxy-b544748f5-62f46\" (UID: \"bd37a6d5-9adf-425b-aa93-77574694247e\") " pod="openshift-ingress/kube-auth-proxy-b544748f5-62f46"
Oct 31 00:38:44.044132 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.044113    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd37a6d5-9adf-425b-aa93-77574694247e-tls-certs\") pod \"kube-auth-proxy-b544748f5-62f46\" (UID: \"bd37a6d5-9adf-425b-aa93-77574694247e\") " pod="openshift-ingress/kube-auth-proxy-b544748f5-62f46"
Oct 31 00:38:44.144671 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.144631    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd37a6d5-9adf-425b-aa93-77574694247e-tls-certs\") pod \"kube-auth-proxy-b544748f5-62f46\" (UID: \"bd37a6d5-9adf-425b-aa93-77574694247e\") " pod="openshift-ingress/kube-auth-proxy-b544748f5-62f46"
Oct 31 00:38:44.144857 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.144678    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd37a6d5-9adf-425b-aa93-77574694247e-tmp\") pod \"kube-auth-proxy-b544748f5-62f46\" (UID: \"bd37a6d5-9adf-425b-aa93-77574694247e\") " pod="openshift-ingress/kube-auth-proxy-b544748f5-62f46"
Oct 31 00:38:44.144857 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.144753    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7lm6\" (UniqueName: \"kubernetes.io/projected/bd37a6d5-9adf-425b-aa93-77574694247e-kube-api-access-v7lm6\") pod \"kube-auth-proxy-b544748f5-62f46\" (UID: \"bd37a6d5-9adf-425b-aa93-77574694247e\") " pod="openshift-ingress/kube-auth-proxy-b544748f5-62f46"
Oct 31 00:38:44.146918 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.146890    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd37a6d5-9adf-425b-aa93-77574694247e-tmp\") pod \"kube-auth-proxy-b544748f5-62f46\" (UID: \"bd37a6d5-9adf-425b-aa93-77574694247e\") " pod="openshift-ingress/kube-auth-proxy-b544748f5-62f46"
Oct 31 00:38:44.147293 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.147269    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd37a6d5-9adf-425b-aa93-77574694247e-tls-certs\") pod \"kube-auth-proxy-b544748f5-62f46\" (UID: \"bd37a6d5-9adf-425b-aa93-77574694247e\") " pod="openshift-ingress/kube-auth-proxy-b544748f5-62f46"
Oct 31 00:38:44.153042 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.153015    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7lm6\" (UniqueName: \"kubernetes.io/projected/bd37a6d5-9adf-425b-aa93-77574694247e-kube-api-access-v7lm6\") pod \"kube-auth-proxy-b544748f5-62f46\" (UID: \"bd37a6d5-9adf-425b-aa93-77574694247e\") " pod="openshift-ingress/kube-auth-proxy-b544748f5-62f46"
Oct 31 00:38:44.285469 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.285397    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-b544748f5-62f46"
Oct 31 00:38:44.568459 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.568429    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-b544748f5-62f46"]
Oct 31 00:38:44.571809 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:38:44.571784    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd37a6d5_9adf_425b_aa93_77574694247e.slice/crio-8d6f36903ff57aff38010d1648882f3c8e5474a9f7860bbbdc5cc41bda76859c WatchSource:0}: Error finding container 8d6f36903ff57aff38010d1648882f3c8e5474a9f7860bbbdc5cc41bda76859c: Status 404 returned error can't find the container with id 8d6f36903ff57aff38010d1648882f3c8e5474a9f7860bbbdc5cc41bda76859c
Oct 31 00:38:44.631362 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.631329    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-597b95cb84-tn4gb"]
Oct 31 00:38:44.636092 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.636067    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-tn4gb"
Oct 31 00:38:44.649942 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.649763    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkljv\" (UniqueName: \"kubernetes.io/projected/4a74024f-8716-4b7e-8497-e26506bbb72c-kube-api-access-lkljv\") pod \"cert-manager-597b95cb84-tn4gb\" (UID: \"4a74024f-8716-4b7e-8497-e26506bbb72c\") " pod="cert-manager/cert-manager-597b95cb84-tn4gb"
Oct 31 00:38:44.649942 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.649835    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a74024f-8716-4b7e-8497-e26506bbb72c-bound-sa-token\") pod \"cert-manager-597b95cb84-tn4gb\" (UID: \"4a74024f-8716-4b7e-8497-e26506bbb72c\") " pod="cert-manager/cert-manager-597b95cb84-tn4gb"
Oct 31 00:38:44.660543 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.660516    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-tn4gb"]
Oct 31 00:38:44.695459 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.695431    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-r2z5k\""
Oct 31 00:38:44.717535 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.717288    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"]
Oct 31 00:38:44.720955 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.720932    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"
Oct 31 00:38:44.731436 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.729393    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Oct 31 00:38:44.731436 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.730834    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"]
Oct 31 00:38:44.750815 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.750787    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkljv\" (UniqueName: \"kubernetes.io/projected/4a74024f-8716-4b7e-8497-e26506bbb72c-kube-api-access-lkljv\") pod \"cert-manager-597b95cb84-tn4gb\" (UID: \"4a74024f-8716-4b7e-8497-e26506bbb72c\") " pod="cert-manager/cert-manager-597b95cb84-tn4gb"
Oct 31 00:38:44.750979 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.750839    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c542b7c3-2acf-45d5-8af9-80c4f09c50bf-config-file\") pod \"limitador-limitador-74dfcfb894-cl5ms\" (UID: \"c542b7c3-2acf-45d5-8af9-80c4f09c50bf\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"
Oct 31 00:38:44.750979 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.750915    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a74024f-8716-4b7e-8497-e26506bbb72c-bound-sa-token\") pod \"cert-manager-597b95cb84-tn4gb\" (UID: \"4a74024f-8716-4b7e-8497-e26506bbb72c\") " pod="cert-manager/cert-manager-597b95cb84-tn4gb"
Oct 31 00:38:44.750979 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.750947    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfkxd\" (UniqueName: \"kubernetes.io/projected/c542b7c3-2acf-45d5-8af9-80c4f09c50bf-kube-api-access-cfkxd\") pod \"limitador-limitador-74dfcfb894-cl5ms\" (UID: \"c542b7c3-2acf-45d5-8af9-80c4f09c50bf\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"
Oct 31 00:38:44.759570 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.759543    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkljv\" (UniqueName: \"kubernetes.io/projected/4a74024f-8716-4b7e-8497-e26506bbb72c-kube-api-access-lkljv\") pod \"cert-manager-597b95cb84-tn4gb\" (UID: \"4a74024f-8716-4b7e-8497-e26506bbb72c\") " pod="cert-manager/cert-manager-597b95cb84-tn4gb"
Oct 31 00:38:44.759818 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.759802    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4a74024f-8716-4b7e-8497-e26506bbb72c-bound-sa-token\") pod \"cert-manager-597b95cb84-tn4gb\" (UID: \"4a74024f-8716-4b7e-8497-e26506bbb72c\") " pod="cert-manager/cert-manager-597b95cb84-tn4gb"
Oct 31 00:38:44.811087 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.811055    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"]
Oct 31 00:38:44.852503 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.852438    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c542b7c3-2acf-45d5-8af9-80c4f09c50bf-config-file\") pod \"limitador-limitador-74dfcfb894-cl5ms\" (UID: \"c542b7c3-2acf-45d5-8af9-80c4f09c50bf\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"
Oct 31 00:38:44.852503 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.852496    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cfkxd\" (UniqueName: \"kubernetes.io/projected/c542b7c3-2acf-45d5-8af9-80c4f09c50bf-kube-api-access-cfkxd\") pod \"limitador-limitador-74dfcfb894-cl5ms\" (UID: \"c542b7c3-2acf-45d5-8af9-80c4f09c50bf\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"
Oct 31 00:38:44.853244 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.853213    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c542b7c3-2acf-45d5-8af9-80c4f09c50bf-config-file\") pod \"limitador-limitador-74dfcfb894-cl5ms\" (UID: \"c542b7c3-2acf-45d5-8af9-80c4f09c50bf\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"
Oct 31 00:38:44.860148 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.860120    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfkxd\" (UniqueName: \"kubernetes.io/projected/c542b7c3-2acf-45d5-8af9-80c4f09c50bf-kube-api-access-cfkxd\") pod \"limitador-limitador-74dfcfb894-cl5ms\" (UID: \"c542b7c3-2acf-45d5-8af9-80c4f09c50bf\") " pod="kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"
Oct 31 00:38:44.950121 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:44.950082    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-597b95cb84-tn4gb"
Oct 31 00:38:45.036098 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:45.036070    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"
Oct 31 00:38:45.176273 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:45.176183    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:38:45.181498 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:45.181474    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-2lttl"
Oct 31 00:38:45.188312 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:45.188238    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:38:45.199028 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:45.198971    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b544748f5-62f46" event={"ID":"bd37a6d5-9adf-425b-aa93-77574694247e","Type":"ContainerStarted","Data":"8d6f36903ff57aff38010d1648882f3c8e5474a9f7860bbbdc5cc41bda76859c"}
Oct 31 00:38:45.207643 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:45.207246    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:38:45.229718 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:45.229687    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-597b95cb84-tn4gb"]
Oct 31 00:38:45.230584 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:38:45.230558    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4a74024f_8716_4b7e_8497_e26506bbb72c.slice/crio-edf2fbeeff0e94f7a08136590294bddab4f655ef3c5ed1f8c462a81b9dfcf40b WatchSource:0}: Error finding container edf2fbeeff0e94f7a08136590294bddab4f655ef3c5ed1f8c462a81b9dfcf40b: Status 404 returned error can't find the container with id edf2fbeeff0e94f7a08136590294bddab4f655ef3c5ed1f8c462a81b9dfcf40b
Oct 31 00:38:45.256259 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:45.256179    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh4j6\" (UniqueName: \"kubernetes.io/projected/6e123d48-5cf0-4805-9563-9f2d0a85d61a-kube-api-access-wh4j6\") pod \"limitador-limitador-7c9b87d574-2lttl\" (UID: \"6e123d48-5cf0-4805-9563-9f2d0a85d61a\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-2lttl"
Oct 31 00:38:45.256648 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:45.256606    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6e123d48-5cf0-4805-9563-9f2d0a85d61a-config-file\") pod \"limitador-limitador-7c9b87d574-2lttl\" (UID: \"6e123d48-5cf0-4805-9563-9f2d0a85d61a\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-2lttl"
Oct 31 00:38:45.341382 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:45.341306    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"]
Oct 31 00:38:45.347490 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:38:45.347457    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc542b7c3_2acf_45d5_8af9_80c4f09c50bf.slice/crio-e05d11587536160a6db3ee6aca397a5406c2b311be5e53464db9afd65f295aa9 WatchSource:0}: Error finding container e05d11587536160a6db3ee6aca397a5406c2b311be5e53464db9afd65f295aa9: Status 404 returned error can't find the container with id e05d11587536160a6db3ee6aca397a5406c2b311be5e53464db9afd65f295aa9
Oct 31 00:38:45.359066 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:45.357970    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh4j6\" (UniqueName: \"kubernetes.io/projected/6e123d48-5cf0-4805-9563-9f2d0a85d61a-kube-api-access-wh4j6\") pod \"limitador-limitador-7c9b87d574-2lttl\" (UID: \"6e123d48-5cf0-4805-9563-9f2d0a85d61a\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-2lttl"
Oct 31 00:38:45.359066 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:45.358060    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6e123d48-5cf0-4805-9563-9f2d0a85d61a-config-file\") pod \"limitador-limitador-7c9b87d574-2lttl\" (UID: \"6e123d48-5cf0-4805-9563-9f2d0a85d61a\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-2lttl"
Oct 31 00:38:45.359066 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:45.358798    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6e123d48-5cf0-4805-9563-9f2d0a85d61a-config-file\") pod \"limitador-limitador-7c9b87d574-2lttl\" (UID: \"6e123d48-5cf0-4805-9563-9f2d0a85d61a\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-2lttl"
Oct 31 00:38:45.381094 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:45.381034    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh4j6\" (UniqueName: \"kubernetes.io/projected/6e123d48-5cf0-4805-9563-9f2d0a85d61a-kube-api-access-wh4j6\") pod \"limitador-limitador-7c9b87d574-2lttl\" (UID: \"6e123d48-5cf0-4805-9563-9f2d0a85d61a\") " pod="kuadrant-system/limitador-limitador-7c9b87d574-2lttl"
Oct 31 00:38:45.499441 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:45.497633    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-7c9b87d574-2lttl"
Oct 31 00:38:45.801467 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:45.801428    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:38:45.806375 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:38:45.806349    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e123d48_5cf0_4805_9563_9f2d0a85d61a.slice/crio-75e6d976d033de0f4361c10cd7f1fbc26e68a2aecffc1261f1643f62625727db WatchSource:0}: Error finding container 75e6d976d033de0f4361c10cd7f1fbc26e68a2aecffc1261f1643f62625727db: Status 404 returned error can't find the container with id 75e6d976d033de0f4361c10cd7f1fbc26e68a2aecffc1261f1643f62625727db
Oct 31 00:38:46.206580 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:46.206495    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-cl5ms" event={"ID":"c542b7c3-2acf-45d5-8af9-80c4f09c50bf","Type":"ContainerStarted","Data":"e05d11587536160a6db3ee6aca397a5406c2b311be5e53464db9afd65f295aa9"}
Oct 31 00:38:46.208458 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:46.208427    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-tn4gb" event={"ID":"4a74024f-8716-4b7e-8497-e26506bbb72c","Type":"ContainerStarted","Data":"5d0b6721b8d636d838974e3e66edf7e5240ce5bbaefd2247e8512ae53f95b2e3"}
Oct 31 00:38:46.208708 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:46.208468    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-597b95cb84-tn4gb" event={"ID":"4a74024f-8716-4b7e-8497-e26506bbb72c","Type":"ContainerStarted","Data":"edf2fbeeff0e94f7a08136590294bddab4f655ef3c5ed1f8c462a81b9dfcf40b"}
Oct 31 00:38:46.210086 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:46.210063    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-2lttl" event={"ID":"6e123d48-5cf0-4805-9563-9f2d0a85d61a","Type":"ContainerStarted","Data":"75e6d976d033de0f4361c10cd7f1fbc26e68a2aecffc1261f1643f62625727db"}
Oct 31 00:38:48.222815 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:48.222781    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-b544748f5-62f46" event={"ID":"bd37a6d5-9adf-425b-aa93-77574694247e","Type":"ContainerStarted","Data":"dbf5f423b55964ab307010ccfcb3ea20995d8f55ad4b34c5fb93b6773ae19e77"}
Oct 31 00:38:48.239672 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:48.239624    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="cert-manager/cert-manager-597b95cb84-tn4gb" podStartSLOduration=4.239610291 podStartE2EDuration="4.239610291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:38:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:38:46.224656151 +0000 UTC m=+267.297696233" watchObservedRunningTime="2026-10-31 00:38:48.239610291 +0000 UTC m=+269.312650373"
Oct 31 00:38:48.240129 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:48.240089    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-b544748f5-62f46" podStartSLOduration=2.586491269 podStartE2EDuration="5.240082813s" totalImagesPullingTime="2.653591544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:38:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:38:48.238696271 +0000 UTC m=+269.311736354" watchObservedRunningTime="2026-10-31 00:38:48.240082813 +0000 UTC m=+269.313122892"
Oct 31 00:38:52.243040 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:52.243003    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-7c9b87d574-2lttl" event={"ID":"6e123d48-5cf0-4805-9563-9f2d0a85d61a","Type":"ContainerStarted","Data":"e1cb12518d0c19bde4fd6eb80b41dd5339324b5b289215dc1a32df41d09e7f72"}
Oct 31 00:38:52.243505 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:52.243103    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-2lttl"
Oct 31 00:38:52.244613 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:52.244594    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-cl5ms" event={"ID":"c542b7c3-2acf-45d5-8af9-80c4f09c50bf","Type":"ContainerStarted","Data":"30f34c55abdc63a1de32b46559b99a0ccc7741edd9cfb42e0ca3a24d76884eb7"}
Oct 31 00:38:52.244693 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:52.244641    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"
Oct 31 00:38:52.259859 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:52.259788    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-7c9b87d574-2lttl" podStartSLOduration=1.64595118 podStartE2EDuration="7.25977727s" totalImagesPullingTime="5.61382609s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:38:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:38:52.259656828 +0000 UTC m=+273.332696910" watchObservedRunningTime="2026-10-31 00:38:52.25977727 +0000 UTC m=+273.332817346"
Oct 31 00:38:52.275583 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:38:52.275544    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-74dfcfb894-cl5ms" podStartSLOduration=2.336480352 podStartE2EDuration="8.275532826s" totalImagesPullingTime="5.939052474s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:38:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:38:52.275085573 +0000 UTC m=+273.348125654" watchObservedRunningTime="2026-10-31 00:38:52.275532826 +0000 UTC m=+273.348572907"
Oct 31 00:39:03.251563 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:03.251486    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"
Oct 31 00:39:03.251563 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:03.251557    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-7c9b87d574-2lttl"
Oct 31 00:39:03.313670 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:03.313635    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"]
Oct 31 00:39:03.313855 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:03.313831    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-74dfcfb894-cl5ms" podUID="c542b7c3-2acf-45d5-8af9-80c4f09c50bf" containerName="limitador" containerID="cri-o://30f34c55abdc63a1de32b46559b99a0ccc7741edd9cfb42e0ca3a24d76884eb7" gracePeriod=30
Oct 31 00:39:04.083670 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:04.083636    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"
Oct 31 00:39:04.230831 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:04.230746    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c542b7c3-2acf-45d5-8af9-80c4f09c50bf-config-file\" (UniqueName: \"kubernetes.io/configmap/c542b7c3-2acf-45d5-8af9-80c4f09c50bf-config-file\") pod \"c542b7c3-2acf-45d5-8af9-80c4f09c50bf\" (UID: \"c542b7c3-2acf-45d5-8af9-80c4f09c50bf\") "
Oct 31 00:39:04.230979 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:04.230868    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c542b7c3-2acf-45d5-8af9-80c4f09c50bf-kube-api-access-cfkxd\" (UniqueName: \"kubernetes.io/projected/c542b7c3-2acf-45d5-8af9-80c4f09c50bf-kube-api-access-cfkxd\") pod \"c542b7c3-2acf-45d5-8af9-80c4f09c50bf\" (UID: \"c542b7c3-2acf-45d5-8af9-80c4f09c50bf\") "
Oct 31 00:39:04.231115 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:04.231092    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c542b7c3-2acf-45d5-8af9-80c4f09c50bf-config-file" pod "c542b7c3-2acf-45d5-8af9-80c4f09c50bf" (UID: "c542b7c3-2acf-45d5-8af9-80c4f09c50bf"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:39:04.231255 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:04.231201    5946 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c542b7c3-2acf-45d5-8af9-80c4f09c50bf-config-file\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:39:04.233038 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:04.233020    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c542b7c3-2acf-45d5-8af9-80c4f09c50bf-kube-api-access-cfkxd" pod "c542b7c3-2acf-45d5-8af9-80c4f09c50bf" (UID: "c542b7c3-2acf-45d5-8af9-80c4f09c50bf"). InnerVolumeSpecName "kube-api-access-cfkxd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:39:04.297151 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:04.297116    5946 generic.go:356] "Generic (PLEG): container finished" podID="c542b7c3-2acf-45d5-8af9-80c4f09c50bf" containerID="30f34c55abdc63a1de32b46559b99a0ccc7741edd9cfb42e0ca3a24d76884eb7" exitCode=0
Oct 31 00:39:04.297556 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:04.297161    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"
Oct 31 00:39:04.297556 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:04.297204    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-cl5ms" event={"ID":"c542b7c3-2acf-45d5-8af9-80c4f09c50bf","Type":"ContainerDied","Data":"30f34c55abdc63a1de32b46559b99a0ccc7741edd9cfb42e0ca3a24d76884eb7"}
Oct 31 00:39:04.297556 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:04.297281    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-74dfcfb894-cl5ms" event={"ID":"c542b7c3-2acf-45d5-8af9-80c4f09c50bf","Type":"ContainerDied","Data":"e05d11587536160a6db3ee6aca397a5406c2b311be5e53464db9afd65f295aa9"}
Oct 31 00:39:04.297556 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:04.297309    5946 scope.go:122] "RemoveContainer" containerID="30f34c55abdc63a1de32b46559b99a0ccc7741edd9cfb42e0ca3a24d76884eb7"
Oct 31 00:39:04.306403 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:04.306382    5946 scope.go:122] "RemoveContainer" containerID="30f34c55abdc63a1de32b46559b99a0ccc7741edd9cfb42e0ca3a24d76884eb7"
Oct 31 00:39:04.306662 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:39:04.306643    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30f34c55abdc63a1de32b46559b99a0ccc7741edd9cfb42e0ca3a24d76884eb7\": container with ID starting with 30f34c55abdc63a1de32b46559b99a0ccc7741edd9cfb42e0ca3a24d76884eb7 not found: ID does not exist" containerID="30f34c55abdc63a1de32b46559b99a0ccc7741edd9cfb42e0ca3a24d76884eb7"
Oct 31 00:39:04.306707 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:04.306671    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30f34c55abdc63a1de32b46559b99a0ccc7741edd9cfb42e0ca3a24d76884eb7"} err="failed to get container status \"30f34c55abdc63a1de32b46559b99a0ccc7741edd9cfb42e0ca3a24d76884eb7\": rpc error: code = NotFound desc = could not find container \"30f34c55abdc63a1de32b46559b99a0ccc7741edd9cfb42e0ca3a24d76884eb7\": container with ID starting with 30f34c55abdc63a1de32b46559b99a0ccc7741edd9cfb42e0ca3a24d76884eb7 not found: ID does not exist"
Oct 31 00:39:04.317687 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:04.317663    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"]
Oct 31 00:39:04.321209 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:04.321189    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-74dfcfb894-cl5ms"]
Oct 31 00:39:04.332599 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:04.332580    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cfkxd\" (UniqueName: \"kubernetes.io/projected/c542b7c3-2acf-45d5-8af9-80c4f09c50bf-kube-api-access-cfkxd\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:39:05.060522 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:05.060488    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c542b7c3-2acf-45d5-8af9-80c4f09c50bf" path="/var/lib/kubelet/pods/c542b7c3-2acf-45d5-8af9-80c4f09c50bf/volumes"
Oct 31 00:39:11.380545 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:39:11.380511    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:39:38.355830 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.355796    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-579cf7c6d-28vzm"]
Oct 31 00:39:38.356471 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.356452    5946 cpu_manager.go:414] "containerMap: removing container" podUID="c542b7c3-2acf-45d5-8af9-80c4f09c50bf" containerName="limitador"
Oct 31 00:39:38.356561 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.356475    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c542b7c3-2acf-45d5-8af9-80c4f09c50bf" containerName="limitador"
Oct 31 00:39:38.356602 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.356579    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="c542b7c3-2acf-45d5-8af9-80c4f09c50bf" containerName="limitador"
Oct 31 00:39:38.360510 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.360489    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-28vzm"
Oct 31 00:39:38.372501 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.372457    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 31 00:39:38.372501 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.372495    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 31 00:39:38.372669 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.372488    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-k4bz4\""
Oct 31 00:39:38.373125 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.373106    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Oct 31 00:39:38.373212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.373141    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Oct 31 00:39:38.373456 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.373442    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 31 00:39:38.374779 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.374760    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-28vzm"]
Oct 31 00:39:38.439412 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.439378    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ll5hr\" (UniqueName: \"kubernetes.io/projected/5a814921-c27b-4321-ad9e-6b05143f1bde-kube-api-access-ll5hr\") pod \"maas-controller-579cf7c6d-28vzm\" (UID: \"5a814921-c27b-4321-ad9e-6b05143f1bde\") " pod="opendatahub/maas-controller-579cf7c6d-28vzm"
Oct 31 00:39:38.439599 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.439486    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a814921-c27b-4321-ad9e-6b05143f1bde-metrics-certs\") pod \"maas-controller-579cf7c6d-28vzm\" (UID: \"5a814921-c27b-4321-ad9e-6b05143f1bde\") " pod="opendatahub/maas-controller-579cf7c6d-28vzm"
Oct 31 00:39:38.439599 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.439545    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a814921-c27b-4321-ad9e-6b05143f1bde-webhook-cert\") pod \"maas-controller-579cf7c6d-28vzm\" (UID: \"5a814921-c27b-4321-ad9e-6b05143f1bde\") " pod="opendatahub/maas-controller-579cf7c6d-28vzm"
Oct 31 00:39:38.541086 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.541053    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ll5hr\" (UniqueName: \"kubernetes.io/projected/5a814921-c27b-4321-ad9e-6b05143f1bde-kube-api-access-ll5hr\") pod \"maas-controller-579cf7c6d-28vzm\" (UID: \"5a814921-c27b-4321-ad9e-6b05143f1bde\") " pod="opendatahub/maas-controller-579cf7c6d-28vzm"
Oct 31 00:39:38.541291 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.541112    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a814921-c27b-4321-ad9e-6b05143f1bde-metrics-certs\") pod \"maas-controller-579cf7c6d-28vzm\" (UID: \"5a814921-c27b-4321-ad9e-6b05143f1bde\") " pod="opendatahub/maas-controller-579cf7c6d-28vzm"
Oct 31 00:39:38.541291 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.541170    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a814921-c27b-4321-ad9e-6b05143f1bde-webhook-cert\") pod \"maas-controller-579cf7c6d-28vzm\" (UID: \"5a814921-c27b-4321-ad9e-6b05143f1bde\") " pod="opendatahub/maas-controller-579cf7c6d-28vzm"
Oct 31 00:39:38.543672 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.543645    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a814921-c27b-4321-ad9e-6b05143f1bde-metrics-certs\") pod \"maas-controller-579cf7c6d-28vzm\" (UID: \"5a814921-c27b-4321-ad9e-6b05143f1bde\") " pod="opendatahub/maas-controller-579cf7c6d-28vzm"
Oct 31 00:39:38.543790 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.543671    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a814921-c27b-4321-ad9e-6b05143f1bde-webhook-cert\") pod \"maas-controller-579cf7c6d-28vzm\" (UID: \"5a814921-c27b-4321-ad9e-6b05143f1bde\") " pod="opendatahub/maas-controller-579cf7c6d-28vzm"
Oct 31 00:39:38.552228 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.552193    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ll5hr\" (UniqueName: \"kubernetes.io/projected/5a814921-c27b-4321-ad9e-6b05143f1bde-kube-api-access-ll5hr\") pod \"maas-controller-579cf7c6d-28vzm\" (UID: \"5a814921-c27b-4321-ad9e-6b05143f1bde\") " pod="opendatahub/maas-controller-579cf7c6d-28vzm"
Oct 31 00:39:38.562864 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.562841    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-wvk8t"]
Oct 31 00:39:38.566535 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.566521    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-wvk8t"
Oct 31 00:39:38.576143 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.576066    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-p2g7g\""
Oct 31 00:39:38.576143 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.576095    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Oct 31 00:39:38.577916 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.577887    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-wvk8t"]
Oct 31 00:39:38.601984 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.601953    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-xznzv"]
Oct 31 00:39:38.606070 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.606020    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-xznzv"
Oct 31 00:39:38.616655 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.616615    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-xznzv"]
Oct 31 00:39:38.620662 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.620553    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-b7mfd\""
Oct 31 00:39:38.620662 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.620662    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Oct 31 00:39:38.638013 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.637987    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-769875db56-k8s5d"]
Oct 31 00:39:38.641426 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.641411    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-k8s5d"
Oct 31 00:39:38.641847 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.641822    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc2b3624-0ae1-4df1-89b6-bb3cc89456dc-cert\") pod \"kserve-controller-manager-776cc66d47-wvk8t\" (UID: \"cc2b3624-0ae1-4df1-89b6-bb3cc89456dc\") " pod="opendatahub/kserve-controller-manager-776cc66d47-wvk8t"
Oct 31 00:39:38.641926 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.641865    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mdqvz\" (UniqueName: \"kubernetes.io/projected/cc2b3624-0ae1-4df1-89b6-bb3cc89456dc-kube-api-access-mdqvz\") pod \"kserve-controller-manager-776cc66d47-wvk8t\" (UID: \"cc2b3624-0ae1-4df1-89b6-bb3cc89456dc\") " pod="opendatahub/kserve-controller-manager-776cc66d47-wvk8t"
Oct 31 00:39:38.651657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.651633    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-k8s5d"]
Oct 31 00:39:38.667911 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.667891    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Oct 31 00:39:38.668009 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.667992    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-metrics-tls\""
Oct 31 00:39:38.668072 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.668040    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-xpxzt\""
Oct 31 00:39:38.674922 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.674901    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-28vzm"
Oct 31 00:39:38.743255 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.743203    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4trrg\" (UniqueName: \"kubernetes.io/projected/eaa04487-3728-4fec-8172-db47ecdabb6a-kube-api-access-4trrg\") pod \"model-serving-api-75bd89fdfc-xznzv\" (UID: \"eaa04487-3728-4fec-8172-db47ecdabb6a\") " pod="opendatahub/model-serving-api-75bd89fdfc-xznzv"
Oct 31 00:39:38.743357 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.743320    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaa04487-3728-4fec-8172-db47ecdabb6a-tls-certs\") pod \"model-serving-api-75bd89fdfc-xznzv\" (UID: \"eaa04487-3728-4fec-8172-db47ecdabb6a\") " pod="opendatahub/model-serving-api-75bd89fdfc-xznzv"
Oct 31 00:39:38.743357 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.743346    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee494b65-1e45-4bcc-9a65-6ae58977f697-metrics-certs\") pod \"odh-model-controller-769875db56-k8s5d\" (UID: \"ee494b65-1e45-4bcc-9a65-6ae58977f697\") " pod="opendatahub/odh-model-controller-769875db56-k8s5d"
Oct 31 00:39:38.743503 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.743481    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc2b3624-0ae1-4df1-89b6-bb3cc89456dc-cert\") pod \"kserve-controller-manager-776cc66d47-wvk8t\" (UID: \"cc2b3624-0ae1-4df1-89b6-bb3cc89456dc\") " pod="opendatahub/kserve-controller-manager-776cc66d47-wvk8t"
Oct 31 00:39:38.743574 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.743538    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee494b65-1e45-4bcc-9a65-6ae58977f697-cert\") pod \"odh-model-controller-769875db56-k8s5d\" (UID: \"ee494b65-1e45-4bcc-9a65-6ae58977f697\") " pod="opendatahub/odh-model-controller-769875db56-k8s5d"
Oct 31 00:39:38.743630 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.743586    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mdqvz\" (UniqueName: \"kubernetes.io/projected/cc2b3624-0ae1-4df1-89b6-bb3cc89456dc-kube-api-access-mdqvz\") pod \"kserve-controller-manager-776cc66d47-wvk8t\" (UID: \"cc2b3624-0ae1-4df1-89b6-bb3cc89456dc\") " pod="opendatahub/kserve-controller-manager-776cc66d47-wvk8t"
Oct 31 00:39:38.743683 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.743643    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqf89\" (UniqueName: \"kubernetes.io/projected/ee494b65-1e45-4bcc-9a65-6ae58977f697-kube-api-access-bqf89\") pod \"odh-model-controller-769875db56-k8s5d\" (UID: \"ee494b65-1e45-4bcc-9a65-6ae58977f697\") " pod="opendatahub/odh-model-controller-769875db56-k8s5d"
Oct 31 00:39:38.746106 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.746063    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc2b3624-0ae1-4df1-89b6-bb3cc89456dc-cert\") pod \"kserve-controller-manager-776cc66d47-wvk8t\" (UID: \"cc2b3624-0ae1-4df1-89b6-bb3cc89456dc\") " pod="opendatahub/kserve-controller-manager-776cc66d47-wvk8t"
Oct 31 00:39:38.747065 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.747045    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bdb48889c-shvsr"]
Oct 31 00:39:38.751651 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.751638    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bdb48889c-shvsr"
Oct 31 00:39:38.757628 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.757600    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mdqvz\" (UniqueName: \"kubernetes.io/projected/cc2b3624-0ae1-4df1-89b6-bb3cc89456dc-kube-api-access-mdqvz\") pod \"kserve-controller-manager-776cc66d47-wvk8t\" (UID: \"cc2b3624-0ae1-4df1-89b6-bb3cc89456dc\") " pod="opendatahub/kserve-controller-manager-776cc66d47-wvk8t"
Oct 31 00:39:38.760125 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.760104    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bdb48889c-shvsr"]
Oct 31 00:39:38.844953 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.844921    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4trrg\" (UniqueName: \"kubernetes.io/projected/eaa04487-3728-4fec-8172-db47ecdabb6a-kube-api-access-4trrg\") pod \"model-serving-api-75bd89fdfc-xznzv\" (UID: \"eaa04487-3728-4fec-8172-db47ecdabb6a\") " pod="opendatahub/model-serving-api-75bd89fdfc-xznzv"
Oct 31 00:39:38.845118 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.844965    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaa04487-3728-4fec-8172-db47ecdabb6a-tls-certs\") pod \"model-serving-api-75bd89fdfc-xznzv\" (UID: \"eaa04487-3728-4fec-8172-db47ecdabb6a\") " pod="opendatahub/model-serving-api-75bd89fdfc-xznzv"
Oct 31 00:39:38.845118 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.844986    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee494b65-1e45-4bcc-9a65-6ae58977f697-metrics-certs\") pod \"odh-model-controller-769875db56-k8s5d\" (UID: \"ee494b65-1e45-4bcc-9a65-6ae58977f697\") " pod="opendatahub/odh-model-controller-769875db56-k8s5d"
Oct 31 00:39:38.845118 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.845017    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/239cad73-43bb-4cb2-8d24-c0867308a622-webhook-cert\") pod \"maas-controller-7bdb48889c-shvsr\" (UID: \"239cad73-43bb-4cb2-8d24-c0867308a622\") " pod="opendatahub/maas-controller-7bdb48889c-shvsr"
Oct 31 00:39:38.845118 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.845053    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee494b65-1e45-4bcc-9a65-6ae58977f697-cert\") pod \"odh-model-controller-769875db56-k8s5d\" (UID: \"ee494b65-1e45-4bcc-9a65-6ae58977f697\") " pod="opendatahub/odh-model-controller-769875db56-k8s5d"
Oct 31 00:39:38.845118 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.845085    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5clvs\" (UniqueName: \"kubernetes.io/projected/239cad73-43bb-4cb2-8d24-c0867308a622-kube-api-access-5clvs\") pod \"maas-controller-7bdb48889c-shvsr\" (UID: \"239cad73-43bb-4cb2-8d24-c0867308a622\") " pod="opendatahub/maas-controller-7bdb48889c-shvsr"
Oct 31 00:39:38.845444 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.845190    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/239cad73-43bb-4cb2-8d24-c0867308a622-metrics-certs\") pod \"maas-controller-7bdb48889c-shvsr\" (UID: \"239cad73-43bb-4cb2-8d24-c0867308a622\") " pod="opendatahub/maas-controller-7bdb48889c-shvsr"
Oct 31 00:39:38.845444 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:39:38.845205    5946 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Oct 31 00:39:38.845444 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:39:38.845302    5946 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee494b65-1e45-4bcc-9a65-6ae58977f697-cert podName:ee494b65-1e45-4bcc-9a65-6ae58977f697 nodeName:}" failed. No retries permitted until 2026-10-31 00:39:39.345280591 +0000 UTC m=+320.418320653 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ee494b65-1e45-4bcc-9a65-6ae58977f697-cert") pod "odh-model-controller-769875db56-k8s5d" (UID: "ee494b65-1e45-4bcc-9a65-6ae58977f697") : secret "odh-model-controller-webhook-cert" not found
Oct 31 00:39:38.845444 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.845318    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqf89\" (UniqueName: \"kubernetes.io/projected/ee494b65-1e45-4bcc-9a65-6ae58977f697-kube-api-access-bqf89\") pod \"odh-model-controller-769875db56-k8s5d\" (UID: \"ee494b65-1e45-4bcc-9a65-6ae58977f697\") " pod="opendatahub/odh-model-controller-769875db56-k8s5d"
Oct 31 00:39:38.847433 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.847411    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eaa04487-3728-4fec-8172-db47ecdabb6a-tls-certs\") pod \"model-serving-api-75bd89fdfc-xznzv\" (UID: \"eaa04487-3728-4fec-8172-db47ecdabb6a\") " pod="opendatahub/model-serving-api-75bd89fdfc-xznzv"
Oct 31 00:39:38.847523 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.847465    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ee494b65-1e45-4bcc-9a65-6ae58977f697-metrics-certs\") pod \"odh-model-controller-769875db56-k8s5d\" (UID: \"ee494b65-1e45-4bcc-9a65-6ae58977f697\") " pod="opendatahub/odh-model-controller-769875db56-k8s5d"
Oct 31 00:39:38.852885 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.852865    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4trrg\" (UniqueName: \"kubernetes.io/projected/eaa04487-3728-4fec-8172-db47ecdabb6a-kube-api-access-4trrg\") pod \"model-serving-api-75bd89fdfc-xznzv\" (UID: \"eaa04487-3728-4fec-8172-db47ecdabb6a\") " pod="opendatahub/model-serving-api-75bd89fdfc-xznzv"
Oct 31 00:39:38.856205 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.856160    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqf89\" (UniqueName: \"kubernetes.io/projected/ee494b65-1e45-4bcc-9a65-6ae58977f697-kube-api-access-bqf89\") pod \"odh-model-controller-769875db56-k8s5d\" (UID: \"ee494b65-1e45-4bcc-9a65-6ae58977f697\") " pod="opendatahub/odh-model-controller-769875db56-k8s5d"
Oct 31 00:39:38.884091 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.884063    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-776cc66d47-wvk8t"
Oct 31 00:39:38.921067 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.921042    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-75bd89fdfc-xznzv"
Oct 31 00:39:38.947585 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.946779    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/239cad73-43bb-4cb2-8d24-c0867308a622-metrics-certs\") pod \"maas-controller-7bdb48889c-shvsr\" (UID: \"239cad73-43bb-4cb2-8d24-c0867308a622\") " pod="opendatahub/maas-controller-7bdb48889c-shvsr"
Oct 31 00:39:38.947585 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.946891    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/239cad73-43bb-4cb2-8d24-c0867308a622-webhook-cert\") pod \"maas-controller-7bdb48889c-shvsr\" (UID: \"239cad73-43bb-4cb2-8d24-c0867308a622\") " pod="opendatahub/maas-controller-7bdb48889c-shvsr"
Oct 31 00:39:38.947585 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.946947    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5clvs\" (UniqueName: \"kubernetes.io/projected/239cad73-43bb-4cb2-8d24-c0867308a622-kube-api-access-5clvs\") pod \"maas-controller-7bdb48889c-shvsr\" (UID: \"239cad73-43bb-4cb2-8d24-c0867308a622\") " pod="opendatahub/maas-controller-7bdb48889c-shvsr"
Oct 31 00:39:38.951435 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.951406    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-28vzm"]
Oct 31 00:39:38.954196 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.953801    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/239cad73-43bb-4cb2-8d24-c0867308a622-metrics-certs\") pod \"maas-controller-7bdb48889c-shvsr\" (UID: \"239cad73-43bb-4cb2-8d24-c0867308a622\") " pod="opendatahub/maas-controller-7bdb48889c-shvsr"
Oct 31 00:39:38.955022 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.954912    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/239cad73-43bb-4cb2-8d24-c0867308a622-webhook-cert\") pod \"maas-controller-7bdb48889c-shvsr\" (UID: \"239cad73-43bb-4cb2-8d24-c0867308a622\") " pod="opendatahub/maas-controller-7bdb48889c-shvsr"
Oct 31 00:39:38.957254 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:39:38.957188    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a814921_c27b_4321_ad9e_6b05143f1bde.slice/crio-b5ca5f79cfd9d0a3c35853c619b797a7eb5c758def5fcc380b3f3014d878fa3a WatchSource:0}: Error finding container b5ca5f79cfd9d0a3c35853c619b797a7eb5c758def5fcc380b3f3014d878fa3a: Status 404 returned error can't find the container with id b5ca5f79cfd9d0a3c35853c619b797a7eb5c758def5fcc380b3f3014d878fa3a
Oct 31 00:39:38.962244 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:38.962197    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5clvs\" (UniqueName: \"kubernetes.io/projected/239cad73-43bb-4cb2-8d24-c0867308a622-kube-api-access-5clvs\") pod \"maas-controller-7bdb48889c-shvsr\" (UID: \"239cad73-43bb-4cb2-8d24-c0867308a622\") " pod="opendatahub/maas-controller-7bdb48889c-shvsr"
Oct 31 00:39:39.071435 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:39.071408    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bdb48889c-shvsr"
Oct 31 00:39:39.175830 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:39.175646    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-776cc66d47-wvk8t"]
Oct 31 00:39:39.178406 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:39:39.178377    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc2b3624_0ae1_4df1_89b6_bb3cc89456dc.slice/crio-27cad89bfedd36356b11c85487ac902f763853185b2e6e19226ef9a7302281ca WatchSource:0}: Error finding container 27cad89bfedd36356b11c85487ac902f763853185b2e6e19226ef9a7302281ca: Status 404 returned error can't find the container with id 27cad89bfedd36356b11c85487ac902f763853185b2e6e19226ef9a7302281ca
Oct 31 00:39:39.206200 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:39.206178    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-75bd89fdfc-xznzv"]
Oct 31 00:39:39.208794 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:39:39.208774    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa04487_3728_4fec_8172_db47ecdabb6a.slice/crio-b3ddfe575c0f4168802878d16f48f44b22e615fdfd8322299138e3aff1925d85 WatchSource:0}: Error finding container b3ddfe575c0f4168802878d16f48f44b22e615fdfd8322299138e3aff1925d85: Status 404 returned error can't find the container with id b3ddfe575c0f4168802878d16f48f44b22e615fdfd8322299138e3aff1925d85
Oct 31 00:39:39.344638 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:39.344609    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bdb48889c-shvsr"]
Oct 31 00:39:39.347565 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:39:39.347540    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod239cad73_43bb_4cb2_8d24_c0867308a622.slice/crio-2862c827f936656797fd06aa3b778a5dfb98e6a80afa82c3ae364029fc314a9e WatchSource:0}: Error finding container 2862c827f936656797fd06aa3b778a5dfb98e6a80afa82c3ae364029fc314a9e: Status 404 returned error can't find the container with id 2862c827f936656797fd06aa3b778a5dfb98e6a80afa82c3ae364029fc314a9e
Oct 31 00:39:39.351149 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:39.351129    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee494b65-1e45-4bcc-9a65-6ae58977f697-cert\") pod \"odh-model-controller-769875db56-k8s5d\" (UID: \"ee494b65-1e45-4bcc-9a65-6ae58977f697\") " pod="opendatahub/odh-model-controller-769875db56-k8s5d"
Oct 31 00:39:39.353340 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:39.353320    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee494b65-1e45-4bcc-9a65-6ae58977f697-cert\") pod \"odh-model-controller-769875db56-k8s5d\" (UID: \"ee494b65-1e45-4bcc-9a65-6ae58977f697\") " pod="opendatahub/odh-model-controller-769875db56-k8s5d"
Oct 31 00:39:39.457038 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:39.456957    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-28vzm" event={"ID":"5a814921-c27b-4321-ad9e-6b05143f1bde","Type":"ContainerStarted","Data":"b5ca5f79cfd9d0a3c35853c619b797a7eb5c758def5fcc380b3f3014d878fa3a"}
Oct 31 00:39:39.458633 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:39.458608    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bdb48889c-shvsr" event={"ID":"239cad73-43bb-4cb2-8d24-c0867308a622","Type":"ContainerStarted","Data":"2862c827f936656797fd06aa3b778a5dfb98e6a80afa82c3ae364029fc314a9e"}
Oct 31 00:39:39.460577 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:39.460554    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-xznzv" event={"ID":"eaa04487-3728-4fec-8172-db47ecdabb6a","Type":"ContainerStarted","Data":"b3ddfe575c0f4168802878d16f48f44b22e615fdfd8322299138e3aff1925d85"}
Oct 31 00:39:39.462027 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:39.461975    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-wvk8t" event={"ID":"cc2b3624-0ae1-4df1-89b6-bb3cc89456dc","Type":"ContainerStarted","Data":"27cad89bfedd36356b11c85487ac902f763853185b2e6e19226ef9a7302281ca"}
Oct 31 00:39:39.558751 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:39.558503    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-769875db56-k8s5d"
Oct 31 00:39:39.858729 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:39.858699    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-769875db56-k8s5d"]
Oct 31 00:39:39.866476 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:39:39.866448    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee494b65_1e45_4bcc_9a65_6ae58977f697.slice/crio-0b8900bf6dfb7bcdb0e83d15025f964ebffe9a668840e26fe09e2dd9dfd932ee WatchSource:0}: Error finding container 0b8900bf6dfb7bcdb0e83d15025f964ebffe9a668840e26fe09e2dd9dfd932ee: Status 404 returned error can't find the container with id 0b8900bf6dfb7bcdb0e83d15025f964ebffe9a668840e26fe09e2dd9dfd932ee
Oct 31 00:39:40.496532 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:40.496488    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-k8s5d" event={"ID":"ee494b65-1e45-4bcc-9a65-6ae58977f697","Type":"ContainerStarted","Data":"0b8900bf6dfb7bcdb0e83d15025f964ebffe9a668840e26fe09e2dd9dfd932ee"}
Oct 31 00:39:41.424068 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:39:41.423871    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:39:43.524514 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:43.523710    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-75bd89fdfc-xznzv" event={"ID":"eaa04487-3728-4fec-8172-db47ecdabb6a","Type":"ContainerStarted","Data":"aaa73c1e2e411d249d512d7091ee6daff52b2fc9f76f9f11016fc875cae3ce2f"}
Oct 31 00:39:43.524514 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:43.524421    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-75bd89fdfc-xznzv"
Oct 31 00:39:43.526922 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:43.526349    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-776cc66d47-wvk8t" event={"ID":"cc2b3624-0ae1-4df1-89b6-bb3cc89456dc","Type":"ContainerStarted","Data":"f87b327ff7faaad20a75e15c0229bcf6f2d1deeb5aaec06900a582ea7f5c5e7e"}
Oct 31 00:39:43.526922 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:43.526867    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-776cc66d47-wvk8t"
Oct 31 00:39:43.544203 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:43.544143    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/model-serving-api-75bd89fdfc-xznzv" podStartSLOduration=1.599436768 podStartE2EDuration="5.544128849s" totalImagesPullingTime="3.944692081s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:39:43.544048331 +0000 UTC m=+324.617088413" watchObservedRunningTime="2026-10-31 00:39:43.544128849 +0000 UTC m=+324.617168931"
Oct 31 00:39:43.563585 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:43.563478    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-776cc66d47-wvk8t" podStartSLOduration=1.5861301129999998 podStartE2EDuration="5.56343029s" totalImagesPullingTime="3.977300177s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:39:43.562030454 +0000 UTC m=+324.635070740" watchObservedRunningTime="2026-10-31 00:39:43.56343029 +0000 UTC m=+324.636470374"
Oct 31 00:39:44.533128 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:44.533036    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-769875db56-k8s5d" event={"ID":"ee494b65-1e45-4bcc-9a65-6ae58977f697","Type":"ContainerStarted","Data":"ff9aba3d6f0ae25ecc1fdf2a90f13563f1787b36d8d21469cfc4033df0aaf0ae"}
Oct 31 00:39:44.533128 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:44.533108    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-769875db56-k8s5d"
Oct 31 00:39:44.534717 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:44.534691    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-28vzm" event={"ID":"5a814921-c27b-4321-ad9e-6b05143f1bde","Type":"ContainerStarted","Data":"344cd77876984a6febd68e1a7b6c1130352929e93742f3665b277a727f59f254"}
Oct 31 00:39:44.535071 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:44.534754    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-579cf7c6d-28vzm"
Oct 31 00:39:44.536385 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:44.536358    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bdb48889c-shvsr" event={"ID":"239cad73-43bb-4cb2-8d24-c0867308a622","Type":"ContainerStarted","Data":"3fa18814bc78b1db3239462c4eb7ff9ef9937f5699120dd42b8e15fd78591f65"}
Oct 31 00:39:44.552546 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:44.552488    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/odh-model-controller-769875db56-k8s5d" podStartSLOduration=2.272884775 podStartE2EDuration="6.552470771s" totalImagesPullingTime="4.279585996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:39:44.550875646 +0000 UTC m=+325.623915755" watchObservedRunningTime="2026-10-31 00:39:44.552470771 +0000 UTC m=+325.625510855"
Oct 31 00:39:44.569947 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:44.569906    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-7bdb48889c-shvsr" podStartSLOduration=1.99414692 podStartE2EDuration="6.569893003s" totalImagesPullingTime="4.575746083s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:39:44.568790106 +0000 UTC m=+325.641830190" watchObservedRunningTime="2026-10-31 00:39:44.569893003 +0000 UTC m=+325.642933084"
Oct 31 00:39:44.586859 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:44.586815    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-579cf7c6d-28vzm" podStartSLOduration=1.8845201249999999 podStartE2EDuration="6.586801392s" totalImagesPullingTime="4.702281267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:39:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:39:44.585617378 +0000 UTC m=+325.658657461" watchObservedRunningTime="2026-10-31 00:39:44.586801392 +0000 UTC m=+325.659841474"
Oct 31 00:39:45.541168 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:45.541089    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bdb48889c-shvsr"
Oct 31 00:39:55.542458 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:55.542424    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-769875db56-k8s5d"
Oct 31 00:39:55.542877 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:55.542513    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-579cf7c6d-28vzm"
Oct 31 00:39:55.544513 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:55.544492    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-75bd89fdfc-xznzv"
Oct 31 00:39:56.548800 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:56.548773    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bdb48889c-shvsr"
Oct 31 00:39:56.593164 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:56.593129    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-28vzm"]
Oct 31 00:39:56.593393 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:56.593369    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-579cf7c6d-28vzm" podUID="5a814921-c27b-4321-ad9e-6b05143f1bde" containerName="manager" containerID="cri-o://344cd77876984a6febd68e1a7b6c1130352929e93742f3665b277a727f59f254" gracePeriod=30
Oct 31 00:39:56.836325 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:56.836302    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-28vzm"
Oct 31 00:39:56.917902 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:56.917867    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5a814921-c27b-4321-ad9e-6b05143f1bde-kube-api-access-ll5hr\" (UniqueName: \"kubernetes.io/projected/5a814921-c27b-4321-ad9e-6b05143f1bde-kube-api-access-ll5hr\") pod \"5a814921-c27b-4321-ad9e-6b05143f1bde\" (UID: \"5a814921-c27b-4321-ad9e-6b05143f1bde\") "
Oct 31 00:39:56.918087 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:56.917970    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5a814921-c27b-4321-ad9e-6b05143f1bde-webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a814921-c27b-4321-ad9e-6b05143f1bde-webhook-cert\") pod \"5a814921-c27b-4321-ad9e-6b05143f1bde\" (UID: \"5a814921-c27b-4321-ad9e-6b05143f1bde\") "
Oct 31 00:39:56.918087 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:56.918077    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5a814921-c27b-4321-ad9e-6b05143f1bde-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a814921-c27b-4321-ad9e-6b05143f1bde-metrics-certs\") pod \"5a814921-c27b-4321-ad9e-6b05143f1bde\" (UID: \"5a814921-c27b-4321-ad9e-6b05143f1bde\") "
Oct 31 00:39:56.920040 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:56.920001    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a814921-c27b-4321-ad9e-6b05143f1bde-metrics-certs" pod "5a814921-c27b-4321-ad9e-6b05143f1bde" (UID: "5a814921-c27b-4321-ad9e-6b05143f1bde"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:39:56.920153 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:56.920040    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a814921-c27b-4321-ad9e-6b05143f1bde-webhook-cert" pod "5a814921-c27b-4321-ad9e-6b05143f1bde" (UID: "5a814921-c27b-4321-ad9e-6b05143f1bde"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:39:56.920153 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:56.920052    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a814921-c27b-4321-ad9e-6b05143f1bde-kube-api-access-ll5hr" pod "5a814921-c27b-4321-ad9e-6b05143f1bde" (UID: "5a814921-c27b-4321-ad9e-6b05143f1bde"). InnerVolumeSpecName "kube-api-access-ll5hr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:39:57.018864 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:57.018829    5946 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5a814921-c27b-4321-ad9e-6b05143f1bde-webhook-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:39:57.018864 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:57.018861    5946 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5a814921-c27b-4321-ad9e-6b05143f1bde-metrics-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:39:57.018864 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:57.018871    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ll5hr\" (UniqueName: \"kubernetes.io/projected/5a814921-c27b-4321-ad9e-6b05143f1bde-kube-api-access-ll5hr\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:39:57.603976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:57.603945    5946 generic.go:356] "Generic (PLEG): container finished" podID="5a814921-c27b-4321-ad9e-6b05143f1bde" containerID="344cd77876984a6febd68e1a7b6c1130352929e93742f3665b277a727f59f254" exitCode=0
Oct 31 00:39:57.604404 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:57.603993    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-579cf7c6d-28vzm"
Oct 31 00:39:57.604404 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:57.604027    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-28vzm" event={"ID":"5a814921-c27b-4321-ad9e-6b05143f1bde","Type":"ContainerDied","Data":"344cd77876984a6febd68e1a7b6c1130352929e93742f3665b277a727f59f254"}
Oct 31 00:39:57.604404 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:57.604078    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-579cf7c6d-28vzm" event={"ID":"5a814921-c27b-4321-ad9e-6b05143f1bde","Type":"ContainerDied","Data":"b5ca5f79cfd9d0a3c35853c619b797a7eb5c758def5fcc380b3f3014d878fa3a"}
Oct 31 00:39:57.604404 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:57.604099    5946 scope.go:122] "RemoveContainer" containerID="344cd77876984a6febd68e1a7b6c1130352929e93742f3665b277a727f59f254"
Oct 31 00:39:57.612455 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:57.612436    5946 scope.go:122] "RemoveContainer" containerID="344cd77876984a6febd68e1a7b6c1130352929e93742f3665b277a727f59f254"
Oct 31 00:39:57.612688 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:39:57.612670    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"344cd77876984a6febd68e1a7b6c1130352929e93742f3665b277a727f59f254\": container with ID starting with 344cd77876984a6febd68e1a7b6c1130352929e93742f3665b277a727f59f254 not found: ID does not exist" containerID="344cd77876984a6febd68e1a7b6c1130352929e93742f3665b277a727f59f254"
Oct 31 00:39:57.612739 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:57.612699    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"344cd77876984a6febd68e1a7b6c1130352929e93742f3665b277a727f59f254"} err="failed to get container status \"344cd77876984a6febd68e1a7b6c1130352929e93742f3665b277a727f59f254\": rpc error: code = NotFound desc = could not find container \"344cd77876984a6febd68e1a7b6c1130352929e93742f3665b277a727f59f254\": container with ID starting with 344cd77876984a6febd68e1a7b6c1130352929e93742f3665b277a727f59f254 not found: ID does not exist"
Oct 31 00:39:57.619442 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:57.619424    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-28vzm"]
Oct 31 00:39:57.623298 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:57.623280    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-579cf7c6d-28vzm"]
Oct 31 00:39:59.053914 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:39:59.053883    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5a814921-c27b-4321-ad9e-6b05143f1bde" path="/var/lib/kubelet/pods/5a814921-c27b-4321-ad9e-6b05143f1bde/volumes"
Oct 31 00:40:11.380718 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:40:11.380681    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:40:15.546463 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:15.546430    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-776cc66d47-wvk8t"
Oct 31 00:40:16.179229 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.179196    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"]
Oct 31 00:40:16.179626 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.179613    5946 cpu_manager.go:414] "containerMap: removing container" podUID="5a814921-c27b-4321-ad9e-6b05143f1bde" containerName="manager"
Oct 31 00:40:16.179672 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.179627    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5a814921-c27b-4321-ad9e-6b05143f1bde" containerName="manager"
Oct 31 00:40:16.179706 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.179702    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="5a814921-c27b-4321-ad9e-6b05143f1bde" containerName="manager"
Oct 31 00:40:16.187038 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.187009    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"
Oct 31 00:40:16.192285 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.192182    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Oct 31 00:40:16.193320 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.193289    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Oct 31 00:40:16.193320 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.193317    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Oct 31 00:40:16.193566 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.193378    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-xds7h\""
Oct 31 00:40:16.193566 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.193443    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Oct 31 00:40:16.195156 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.195131    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"]
Oct 31 00:40:16.299619 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.299589    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-metrics-certs\") pod \"maas-api-6d669c7fcd-g264j\" (UID: \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"
Oct 31 00:40:16.299619 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.299624    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-maas-api-tls\") pod \"maas-api-6d669c7fcd-g264j\" (UID: \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"
Oct 31 00:40:16.299842 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.299755    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn5q5\" (UniqueName: \"kubernetes.io/projected/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-kube-api-access-vn5q5\") pod \"maas-api-6d669c7fcd-g264j\" (UID: \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"
Oct 31 00:40:16.299842 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.299785    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-openshift-service-ca\") pod \"maas-api-6d669c7fcd-g264j\" (UID: \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"
Oct 31 00:40:16.400977 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.400944    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-metrics-certs\") pod \"maas-api-6d669c7fcd-g264j\" (UID: \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"
Oct 31 00:40:16.401169 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.400986    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-maas-api-tls\") pod \"maas-api-6d669c7fcd-g264j\" (UID: \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"
Oct 31 00:40:16.401169 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.401032    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn5q5\" (UniqueName: \"kubernetes.io/projected/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-kube-api-access-vn5q5\") pod \"maas-api-6d669c7fcd-g264j\" (UID: \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"
Oct 31 00:40:16.401169 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.401052    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-openshift-service-ca\") pod \"maas-api-6d669c7fcd-g264j\" (UID: \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"
Oct 31 00:40:16.401768 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.401745    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-openshift-service-ca\") pod \"maas-api-6d669c7fcd-g264j\" (UID: \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"
Oct 31 00:40:16.403481 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.403462    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-metrics-certs\") pod \"maas-api-6d669c7fcd-g264j\" (UID: \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"
Oct 31 00:40:16.403570 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.403515    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-maas-api-tls\") pod \"maas-api-6d669c7fcd-g264j\" (UID: \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"
Oct 31 00:40:16.409003 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.408982    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn5q5\" (UniqueName: \"kubernetes.io/projected/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-kube-api-access-vn5q5\") pod \"maas-api-6d669c7fcd-g264j\" (UID: \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\") " pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"
Oct 31 00:40:16.504636 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.504551    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"
Oct 31 00:40:16.607878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.607848    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:40:16.808735 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.808550    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"]
Oct 31 00:40:16.812019 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:40:16.811985    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae8063a_ac86_41ad_91d0_187c90b4e4c4.slice/crio-fd23ebf02feec6cac91d23d790442357194ed8d00b366d420867cfe031066e7b WatchSource:0}: Error finding container fd23ebf02feec6cac91d23d790442357194ed8d00b366d420867cfe031066e7b: Status 404 returned error can't find the container with id fd23ebf02feec6cac91d23d790442357194ed8d00b366d420867cfe031066e7b
Oct 31 00:40:16.813606 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:16.813591    5946 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:40:17.694492 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:17.694458    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j" event={"ID":"3ae8063a-ac86-41ad-91d0-187c90b4e4c4","Type":"ContainerStarted","Data":"fd23ebf02feec6cac91d23d790442357194ed8d00b366d420867cfe031066e7b"}
Oct 31 00:40:19.704655 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:19.704577    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j" event={"ID":"3ae8063a-ac86-41ad-91d0-187c90b4e4c4","Type":"ContainerStarted","Data":"202d0105eb73f70082474004af2fe8e18f8ff84bf467c2bb2e9693acd90d5e20"}
Oct 31 00:40:19.705020 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:19.704715    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"
Oct 31 00:40:19.721357 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:19.721308    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j" podStartSLOduration=1.280267148 podStartE2EDuration="3.721293258s" totalImagesPullingTime="2.44102611s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:40:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:40:19.721021158 +0000 UTC m=+360.794061241" watchObservedRunningTime="2026-10-31 00:40:19.721293258 +0000 UTC m=+360.794333341"
Oct 31 00:40:25.714347 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:25.714316    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"
Oct 31 00:40:26.655606 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:26.655572    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"]
Oct 31 00:40:26.658178 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:26.658162    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"
Oct 31 00:40:26.668402 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:26.668381    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"]
Oct 31 00:40:26.690773 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:26.690744    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5890f0ad-07a5-465e-b7ce-6174aeaba417-openshift-service-ca\") pod \"maas-api-f8cb46844-2jx8s\" (UID: \"5890f0ad-07a5-465e-b7ce-6174aeaba417\") " pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"
Oct 31 00:40:26.690919 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:26.690783    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5890f0ad-07a5-465e-b7ce-6174aeaba417-metrics-certs\") pod \"maas-api-f8cb46844-2jx8s\" (UID: \"5890f0ad-07a5-465e-b7ce-6174aeaba417\") " pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"
Oct 31 00:40:26.690919 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:26.690801    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzdmm\" (UniqueName: \"kubernetes.io/projected/5890f0ad-07a5-465e-b7ce-6174aeaba417-kube-api-access-kzdmm\") pod \"maas-api-f8cb46844-2jx8s\" (UID: \"5890f0ad-07a5-465e-b7ce-6174aeaba417\") " pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"
Oct 31 00:40:26.691006 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:26.690958    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5890f0ad-07a5-465e-b7ce-6174aeaba417-maas-api-tls\") pod \"maas-api-f8cb46844-2jx8s\" (UID: \"5890f0ad-07a5-465e-b7ce-6174aeaba417\") " pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"
Oct 31 00:40:26.792193 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:26.792154    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5890f0ad-07a5-465e-b7ce-6174aeaba417-openshift-service-ca\") pod \"maas-api-f8cb46844-2jx8s\" (UID: \"5890f0ad-07a5-465e-b7ce-6174aeaba417\") " pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"
Oct 31 00:40:26.792193 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:26.792197    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5890f0ad-07a5-465e-b7ce-6174aeaba417-metrics-certs\") pod \"maas-api-f8cb46844-2jx8s\" (UID: \"5890f0ad-07a5-465e-b7ce-6174aeaba417\") " pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"
Oct 31 00:40:26.792739 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:26.792243    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzdmm\" (UniqueName: \"kubernetes.io/projected/5890f0ad-07a5-465e-b7ce-6174aeaba417-kube-api-access-kzdmm\") pod \"maas-api-f8cb46844-2jx8s\" (UID: \"5890f0ad-07a5-465e-b7ce-6174aeaba417\") " pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"
Oct 31 00:40:26.792739 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:26.792333    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5890f0ad-07a5-465e-b7ce-6174aeaba417-maas-api-tls\") pod \"maas-api-f8cb46844-2jx8s\" (UID: \"5890f0ad-07a5-465e-b7ce-6174aeaba417\") " pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"
Oct 31 00:40:26.792838 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:26.792817    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5890f0ad-07a5-465e-b7ce-6174aeaba417-openshift-service-ca\") pod \"maas-api-f8cb46844-2jx8s\" (UID: \"5890f0ad-07a5-465e-b7ce-6174aeaba417\") " pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"
Oct 31 00:40:26.794692 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:26.794673    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5890f0ad-07a5-465e-b7ce-6174aeaba417-metrics-certs\") pod \"maas-api-f8cb46844-2jx8s\" (UID: \"5890f0ad-07a5-465e-b7ce-6174aeaba417\") " pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"
Oct 31 00:40:26.794752 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:26.794687    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5890f0ad-07a5-465e-b7ce-6174aeaba417-maas-api-tls\") pod \"maas-api-f8cb46844-2jx8s\" (UID: \"5890f0ad-07a5-465e-b7ce-6174aeaba417\") " pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"
Oct 31 00:40:26.800233 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:26.800191    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzdmm\" (UniqueName: \"kubernetes.io/projected/5890f0ad-07a5-465e-b7ce-6174aeaba417-kube-api-access-kzdmm\") pod \"maas-api-f8cb46844-2jx8s\" (UID: \"5890f0ad-07a5-465e-b7ce-6174aeaba417\") " pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"
Oct 31 00:40:26.971162 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:26.971064    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"
Oct 31 00:40:27.239636 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:27.239607    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"]
Oct 31 00:40:27.242451 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:40:27.242424    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5890f0ad_07a5_465e_b7ce_6174aeaba417.slice/crio-f065e199fbb571f0314bbb394719e3d018a2c4959d88a426f88e9717d91a998a WatchSource:0}: Error finding container f065e199fbb571f0314bbb394719e3d018a2c4959d88a426f88e9717d91a998a: Status 404 returned error can't find the container with id f065e199fbb571f0314bbb394719e3d018a2c4959d88a426f88e9717d91a998a
Oct 31 00:40:27.749189 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:27.749147    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s" event={"ID":"5890f0ad-07a5-465e-b7ce-6174aeaba417","Type":"ContainerStarted","Data":"acff457b4a0c5234c0a61c27740d3da164226fad4a922cd264be73674f8767f0"}
Oct 31 00:40:27.749362 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:27.749258    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"
Oct 31 00:40:27.749362 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:27.749277    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s" event={"ID":"5890f0ad-07a5-465e-b7ce-6174aeaba417","Type":"ContainerStarted","Data":"f065e199fbb571f0314bbb394719e3d018a2c4959d88a426f88e9717d91a998a"}
Oct 31 00:40:27.770839 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:27.770792    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s" podStartSLOduration=1.377939611 podStartE2EDuration="1.770779324s" totalImagesPullingTime="392.839713ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:40:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:40:27.768824983 +0000 UTC m=+368.841865066" watchObservedRunningTime="2026-10-31 00:40:27.770779324 +0000 UTC m=+368.843819406"
Oct 31 00:40:33.759686 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:33.759610    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"
Oct 31 00:40:33.813187 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:33.813155    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"]
Oct 31 00:40:33.813397 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:33.813370    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j" podUID="3ae8063a-ac86-41ad-91d0-187c90b4e4c4" containerName="maas-api" containerID="cri-o://202d0105eb73f70082474004af2fe8e18f8ff84bf467c2bb2e9693acd90d5e20" gracePeriod=30
Oct 31 00:40:34.058742 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.058720    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"
Oct 31 00:40:34.163201 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.163167    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-maas-api-tls\") pod \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\" (UID: \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\") "
Oct 31 00:40:34.163201 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.163207    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-openshift-service-ca\") pod \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\" (UID: \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\") "
Oct 31 00:40:34.163470 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.163251    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-kube-api-access-vn5q5\" (UniqueName: \"kubernetes.io/projected/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-kube-api-access-vn5q5\") pod \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\" (UID: \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\") "
Oct 31 00:40:34.163470 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.163309    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-metrics-certs\") pod \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\" (UID: \"3ae8063a-ac86-41ad-91d0-187c90b4e4c4\") "
Oct 31 00:40:34.163680 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.163643    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-openshift-service-ca" pod "3ae8063a-ac86-41ad-91d0-187c90b4e4c4" (UID: "3ae8063a-ac86-41ad-91d0-187c90b4e4c4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:40:34.165431 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.165402    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-metrics-certs" pod "3ae8063a-ac86-41ad-91d0-187c90b4e4c4" (UID: "3ae8063a-ac86-41ad-91d0-187c90b4e4c4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:40:34.165523 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.165441    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-maas-api-tls" pod "3ae8063a-ac86-41ad-91d0-187c90b4e4c4" (UID: "3ae8063a-ac86-41ad-91d0-187c90b4e4c4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:40:34.165523 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.165461    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-kube-api-access-vn5q5" pod "3ae8063a-ac86-41ad-91d0-187c90b4e4c4" (UID: "3ae8063a-ac86-41ad-91d0-187c90b4e4c4"). InnerVolumeSpecName "kube-api-access-vn5q5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:40:34.264639 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.264604    5946 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-maas-api-tls\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:34.264639 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.264634    5946 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-openshift-service-ca\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:34.264639 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.264644    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn5q5\" (UniqueName: \"kubernetes.io/projected/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-kube-api-access-vn5q5\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:34.264856 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.264653    5946 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ae8063a-ac86-41ad-91d0-187c90b4e4c4-metrics-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:40:34.783315 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.783277    5946 generic.go:356] "Generic (PLEG): container finished" podID="3ae8063a-ac86-41ad-91d0-187c90b4e4c4" containerID="202d0105eb73f70082474004af2fe8e18f8ff84bf467c2bb2e9693acd90d5e20" exitCode=0
Oct 31 00:40:34.783740 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.783323    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"
Oct 31 00:40:34.783740 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.783329    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j" event={"ID":"3ae8063a-ac86-41ad-91d0-187c90b4e4c4","Type":"ContainerDied","Data":"202d0105eb73f70082474004af2fe8e18f8ff84bf467c2bb2e9693acd90d5e20"}
Oct 31 00:40:34.783740 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.783395    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j" event={"ID":"3ae8063a-ac86-41ad-91d0-187c90b4e4c4","Type":"ContainerDied","Data":"fd23ebf02feec6cac91d23d790442357194ed8d00b366d420867cfe031066e7b"}
Oct 31 00:40:34.783740 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.783416    5946 scope.go:122] "RemoveContainer" containerID="202d0105eb73f70082474004af2fe8e18f8ff84bf467c2bb2e9693acd90d5e20"
Oct 31 00:40:34.800112 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.800091    5946 scope.go:122] "RemoveContainer" containerID="202d0105eb73f70082474004af2fe8e18f8ff84bf467c2bb2e9693acd90d5e20"
Oct 31 00:40:34.800443 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:40:34.800411    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"202d0105eb73f70082474004af2fe8e18f8ff84bf467c2bb2e9693acd90d5e20\": container with ID starting with 202d0105eb73f70082474004af2fe8e18f8ff84bf467c2bb2e9693acd90d5e20 not found: ID does not exist" containerID="202d0105eb73f70082474004af2fe8e18f8ff84bf467c2bb2e9693acd90d5e20"
Oct 31 00:40:34.800516 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.800450    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"202d0105eb73f70082474004af2fe8e18f8ff84bf467c2bb2e9693acd90d5e20"} err="failed to get container status \"202d0105eb73f70082474004af2fe8e18f8ff84bf467c2bb2e9693acd90d5e20\": rpc error: code = NotFound desc = could not find container \"202d0105eb73f70082474004af2fe8e18f8ff84bf467c2bb2e9693acd90d5e20\": container with ID starting with 202d0105eb73f70082474004af2fe8e18f8ff84bf467c2bb2e9693acd90d5e20 not found: ID does not exist"
Oct 31 00:40:34.806926 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.806903    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"]
Oct 31 00:40:34.816895 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:34.816872    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6d669c7fcd-g264j"]
Oct 31 00:40:35.054937 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:40:35.054907    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="3ae8063a-ac86-41ad-91d0-187c90b4e4c4" path="/var/lib/kubelet/pods/3ae8063a-ac86-41ad-91d0-187c90b4e4c4/volumes"
Oct 31 00:40:41.379975 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:40:41.379940    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:41:11.381524 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:41:11.381484    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:41:41.380490 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:41:41.380454    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:41:45.225214 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.225176    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-9ldtx"]
Oct 31 00:41:45.225823 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.225801    5946 cpu_manager.go:414] "containerMap: removing container" podUID="3ae8063a-ac86-41ad-91d0-187c90b4e4c4" containerName="maas-api"
Oct 31 00:41:45.225908 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.225824    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="3ae8063a-ac86-41ad-91d0-187c90b4e4c4" containerName="maas-api"
Oct 31 00:41:45.225964 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.225945    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="3ae8063a-ac86-41ad-91d0-187c90b4e4c4" containerName="maas-api"
Oct 31 00:41:45.230128 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.230099    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.240000 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.239980    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Oct 31 00:41:45.240143 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.240040    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Oct 31 00:41:45.240143 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.240134    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"echo-simulator-kserve-self-signed-certs\""
Oct 31 00:41:45.240427 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.240245    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-66c4l\""
Oct 31 00:41:45.241357 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.241337    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-9ldtx"]
Oct 31 00:41:45.411130 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.411048    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1862797-b83c-47a9-8baa-17278e8fe9a7-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-9ldtx\" (UID: \"d1862797-b83c-47a9-8baa-17278e8fe9a7\") " pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.411130 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.411100    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1862797-b83c-47a9-8baa-17278e8fe9a7-home\") pod \"echo-simulator-kserve-64b6f8f96c-9ldtx\" (UID: \"d1862797-b83c-47a9-8baa-17278e8fe9a7\") " pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.411398 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.411161    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv5rp\" (UniqueName: \"kubernetes.io/projected/d1862797-b83c-47a9-8baa-17278e8fe9a7-kube-api-access-nv5rp\") pod \"echo-simulator-kserve-64b6f8f96c-9ldtx\" (UID: \"d1862797-b83c-47a9-8baa-17278e8fe9a7\") " pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.411398 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.411194    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1862797-b83c-47a9-8baa-17278e8fe9a7-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-9ldtx\" (UID: \"d1862797-b83c-47a9-8baa-17278e8fe9a7\") " pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.411398 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.411252    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1862797-b83c-47a9-8baa-17278e8fe9a7-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-9ldtx\" (UID: \"d1862797-b83c-47a9-8baa-17278e8fe9a7\") " pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.411398 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.411298    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1862797-b83c-47a9-8baa-17278e8fe9a7-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-9ldtx\" (UID: \"d1862797-b83c-47a9-8baa-17278e8fe9a7\") " pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.512688 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.512654    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1862797-b83c-47a9-8baa-17278e8fe9a7-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-9ldtx\" (UID: \"d1862797-b83c-47a9-8baa-17278e8fe9a7\") " pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.512859 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.512714    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1862797-b83c-47a9-8baa-17278e8fe9a7-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-9ldtx\" (UID: \"d1862797-b83c-47a9-8baa-17278e8fe9a7\") " pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.512859 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.512768    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1862797-b83c-47a9-8baa-17278e8fe9a7-home\") pod \"echo-simulator-kserve-64b6f8f96c-9ldtx\" (UID: \"d1862797-b83c-47a9-8baa-17278e8fe9a7\") " pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.512932 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.512903    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv5rp\" (UniqueName: \"kubernetes.io/projected/d1862797-b83c-47a9-8baa-17278e8fe9a7-kube-api-access-nv5rp\") pod \"echo-simulator-kserve-64b6f8f96c-9ldtx\" (UID: \"d1862797-b83c-47a9-8baa-17278e8fe9a7\") " pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.512990 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.512974    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1862797-b83c-47a9-8baa-17278e8fe9a7-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-9ldtx\" (UID: \"d1862797-b83c-47a9-8baa-17278e8fe9a7\") " pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.513038 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.513009    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1862797-b83c-47a9-8baa-17278e8fe9a7-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-9ldtx\" (UID: \"d1862797-b83c-47a9-8baa-17278e8fe9a7\") " pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.513110 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.513088    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d1862797-b83c-47a9-8baa-17278e8fe9a7-model-cache\") pod \"echo-simulator-kserve-64b6f8f96c-9ldtx\" (UID: \"d1862797-b83c-47a9-8baa-17278e8fe9a7\") " pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.513110 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.513104    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d1862797-b83c-47a9-8baa-17278e8fe9a7-tmp-dir\") pod \"echo-simulator-kserve-64b6f8f96c-9ldtx\" (UID: \"d1862797-b83c-47a9-8baa-17278e8fe9a7\") " pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.513244 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.513142    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d1862797-b83c-47a9-8baa-17278e8fe9a7-home\") pod \"echo-simulator-kserve-64b6f8f96c-9ldtx\" (UID: \"d1862797-b83c-47a9-8baa-17278e8fe9a7\") " pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.515182 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.515152    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d1862797-b83c-47a9-8baa-17278e8fe9a7-dshm\") pod \"echo-simulator-kserve-64b6f8f96c-9ldtx\" (UID: \"d1862797-b83c-47a9-8baa-17278e8fe9a7\") " pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.515473 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.515455    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d1862797-b83c-47a9-8baa-17278e8fe9a7-tls-certs\") pod \"echo-simulator-kserve-64b6f8f96c-9ldtx\" (UID: \"d1862797-b83c-47a9-8baa-17278e8fe9a7\") " pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.520469 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.520449    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv5rp\" (UniqueName: \"kubernetes.io/projected/d1862797-b83c-47a9-8baa-17278e8fe9a7-kube-api-access-nv5rp\") pod \"echo-simulator-kserve-64b6f8f96c-9ldtx\" (UID: \"d1862797-b83c-47a9-8baa-17278e8fe9a7\") " pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.544726 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.544706    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:45.603207 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.603181    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:41:45.818336 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:45.818260    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/echo-simulator-kserve-64b6f8f96c-9ldtx"]
Oct 31 00:41:45.821198 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:41:45.821169    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1862797_b83c_47a9_8baa_17278e8fe9a7.slice/crio-8c918c48860199015f37216f08e76d2756e14bd62bedb090ca956d2d9d15d11e WatchSource:0}: Error finding container 8c918c48860199015f37216f08e76d2756e14bd62bedb090ca956d2d9d15d11e: Status 404 returned error can't find the container with id 8c918c48860199015f37216f08e76d2756e14bd62bedb090ca956d2d9d15d11e
Oct 31 00:41:46.107137 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.107037    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx" event={"ID":"d1862797-b83c-47a9-8baa-17278e8fe9a7","Type":"ContainerStarted","Data":"8c918c48860199015f37216f08e76d2756e14bd62bedb090ca956d2d9d15d11e"}
Oct 31 00:41:46.378752 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.378681    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"]
Oct 31 00:41:46.382684 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.382663    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.389818 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.389780    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Oct 31 00:41:46.392061 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.392020    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"]
Oct 31 00:41:46.523977 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.523937    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3604cdc5-119f-483a-984d-314258d993ec-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l\" (UID: \"3604cdc5-119f-483a-984d-314258d993ec\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.524161 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.524006    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3604cdc5-119f-483a-984d-314258d993ec-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l\" (UID: \"3604cdc5-119f-483a-984d-314258d993ec\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.524161 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.524122    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3604cdc5-119f-483a-984d-314258d993ec-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l\" (UID: \"3604cdc5-119f-483a-984d-314258d993ec\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.524286 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.524170    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54kqp\" (UniqueName: \"kubernetes.io/projected/3604cdc5-119f-483a-984d-314258d993ec-kube-api-access-54kqp\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l\" (UID: \"3604cdc5-119f-483a-984d-314258d993ec\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.524330 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.524286    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3604cdc5-119f-483a-984d-314258d993ec-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l\" (UID: \"3604cdc5-119f-483a-984d-314258d993ec\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.524369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.524328    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3604cdc5-119f-483a-984d-314258d993ec-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l\" (UID: \"3604cdc5-119f-483a-984d-314258d993ec\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.625190 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.625154    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3604cdc5-119f-483a-984d-314258d993ec-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l\" (UID: \"3604cdc5-119f-483a-984d-314258d993ec\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.625507 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.625236    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3604cdc5-119f-483a-984d-314258d993ec-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l\" (UID: \"3604cdc5-119f-483a-984d-314258d993ec\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.625507 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.625311    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3604cdc5-119f-483a-984d-314258d993ec-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l\" (UID: \"3604cdc5-119f-483a-984d-314258d993ec\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.625507 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.625351    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3604cdc5-119f-483a-984d-314258d993ec-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l\" (UID: \"3604cdc5-119f-483a-984d-314258d993ec\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.625507 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.625390    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3604cdc5-119f-483a-984d-314258d993ec-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l\" (UID: \"3604cdc5-119f-483a-984d-314258d993ec\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.625507 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.625413    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54kqp\" (UniqueName: \"kubernetes.io/projected/3604cdc5-119f-483a-984d-314258d993ec-kube-api-access-54kqp\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l\" (UID: \"3604cdc5-119f-483a-984d-314258d993ec\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.626233 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.626119    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3604cdc5-119f-483a-984d-314258d993ec-home\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l\" (UID: \"3604cdc5-119f-483a-984d-314258d993ec\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.626233 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.626168    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3604cdc5-119f-483a-984d-314258d993ec-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l\" (UID: \"3604cdc5-119f-483a-984d-314258d993ec\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.626233 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.626204    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3604cdc5-119f-483a-984d-314258d993ec-model-cache\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l\" (UID: \"3604cdc5-119f-483a-984d-314258d993ec\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.628090 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.628043    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3604cdc5-119f-483a-984d-314258d993ec-dshm\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l\" (UID: \"3604cdc5-119f-483a-984d-314258d993ec\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.628473 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.628454    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3604cdc5-119f-483a-984d-314258d993ec-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l\" (UID: \"3604cdc5-119f-483a-984d-314258d993ec\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.642193 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.642070    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54kqp\" (UniqueName: \"kubernetes.io/projected/3604cdc5-119f-483a-984d-314258d993ec-kube-api-access-54kqp\") pod \"facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l\" (UID: \"3604cdc5-119f-483a-984d-314258d993ec\") " pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.698623 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.698578    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:46.987877 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:46.987785    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"]
Oct 31 00:41:46.991431 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:41:46.991399    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3604cdc5_119f_483a_984d_314258d993ec.slice/crio-ebec94862370ab9f903cf511538e9900cde22a4f71302bafca513f6e0800a8d2 WatchSource:0}: Error finding container ebec94862370ab9f903cf511538e9900cde22a4f71302bafca513f6e0800a8d2: Status 404 returned error can't find the container with id ebec94862370ab9f903cf511538e9900cde22a4f71302bafca513f6e0800a8d2
Oct 31 00:41:47.056593 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:47.056558    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:41:47.113434 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:47.113406    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l" event={"ID":"3604cdc5-119f-483a-984d-314258d993ec","Type":"ContainerStarted","Data":"ebec94862370ab9f903cf511538e9900cde22a4f71302bafca513f6e0800a8d2"}
Oct 31 00:41:48.121191 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:48.121095    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx" event={"ID":"d1862797-b83c-47a9-8baa-17278e8fe9a7","Type":"ContainerStarted","Data":"bd0888a4ee555c23d881ff5a91c13d8ccae9502710f9cb1920a7981db06a604c"}
Oct 31 00:41:48.139404 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:48.139353    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx" podStartSLOduration=1.113115728 podStartE2EDuration="3.139339583s" totalImagesPullingTime="2.026223855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:41:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:41:48.13874588 +0000 UTC m=+449.211786007" watchObservedRunningTime="2026-10-31 00:41:48.139339583 +0000 UTC m=+449.212379664"
Oct 31 00:41:48.545612 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:48.545580    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:48.859070 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:48.859036    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:41:48.924878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:48.924848    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"]
Oct 31 00:41:48.928674 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:48.928654    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:48.934437 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:48.934412    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Oct 31 00:41:48.940722 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:48.940698    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"]
Oct 31 00:41:49.050717 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.050685    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a744bfbf-fecf-436e-9bf6-d15f6964214a-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr\" (UID: \"a744bfbf-fecf-436e-9bf6-d15f6964214a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.050880 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.050728    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a744bfbf-fecf-436e-9bf6-d15f6964214a-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr\" (UID: \"a744bfbf-fecf-436e-9bf6-d15f6964214a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.050880 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.050788    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkdmp\" (UniqueName: \"kubernetes.io/projected/a744bfbf-fecf-436e-9bf6-d15f6964214a-kube-api-access-gkdmp\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr\" (UID: \"a744bfbf-fecf-436e-9bf6-d15f6964214a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.050880 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.050821    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a744bfbf-fecf-436e-9bf6-d15f6964214a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr\" (UID: \"a744bfbf-fecf-436e-9bf6-d15f6964214a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.050991 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.050922    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a744bfbf-fecf-436e-9bf6-d15f6964214a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr\" (UID: \"a744bfbf-fecf-436e-9bf6-d15f6964214a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.050991 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.050962    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a744bfbf-fecf-436e-9bf6-d15f6964214a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr\" (UID: \"a744bfbf-fecf-436e-9bf6-d15f6964214a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.127507 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.127429    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l" event={"ID":"3604cdc5-119f-483a-984d-314258d993ec","Type":"ContainerStarted","Data":"b3fd446b86d83e41842de7cd50e055663ad824fbe19cec10327a6557912aea85"}
Oct 31 00:41:49.147433 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.147387    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l" podStartSLOduration=1.800665884 podStartE2EDuration="3.147373899s" totalImagesPullingTime="1.346708015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:41:49.146981392 +0000 UTC m=+450.220021474" watchObservedRunningTime="2026-10-31 00:41:49.147373899 +0000 UTC m=+450.220414011"
Oct 31 00:41:49.152082 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.152056    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a744bfbf-fecf-436e-9bf6-d15f6964214a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr\" (UID: \"a744bfbf-fecf-436e-9bf6-d15f6964214a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.152206 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.152150    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a744bfbf-fecf-436e-9bf6-d15f6964214a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr\" (UID: \"a744bfbf-fecf-436e-9bf6-d15f6964214a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.152206 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.152184    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a744bfbf-fecf-436e-9bf6-d15f6964214a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr\" (UID: \"a744bfbf-fecf-436e-9bf6-d15f6964214a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.152355 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.152252    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a744bfbf-fecf-436e-9bf6-d15f6964214a-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr\" (UID: \"a744bfbf-fecf-436e-9bf6-d15f6964214a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.152355 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.152294    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a744bfbf-fecf-436e-9bf6-d15f6964214a-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr\" (UID: \"a744bfbf-fecf-436e-9bf6-d15f6964214a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.152355 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.152344    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkdmp\" (UniqueName: \"kubernetes.io/projected/a744bfbf-fecf-436e-9bf6-d15f6964214a-kube-api-access-gkdmp\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr\" (UID: \"a744bfbf-fecf-436e-9bf6-d15f6964214a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.152665 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.152639    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a744bfbf-fecf-436e-9bf6-d15f6964214a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr\" (UID: \"a744bfbf-fecf-436e-9bf6-d15f6964214a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.152751 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.152690    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a744bfbf-fecf-436e-9bf6-d15f6964214a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr\" (UID: \"a744bfbf-fecf-436e-9bf6-d15f6964214a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.152751 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.152742    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a744bfbf-fecf-436e-9bf6-d15f6964214a-home\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr\" (UID: \"a744bfbf-fecf-436e-9bf6-d15f6964214a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.154671 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.154644    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a744bfbf-fecf-436e-9bf6-d15f6964214a-dshm\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr\" (UID: \"a744bfbf-fecf-436e-9bf6-d15f6964214a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.154979 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.154962    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a744bfbf-fecf-436e-9bf6-d15f6964214a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr\" (UID: \"a744bfbf-fecf-436e-9bf6-d15f6964214a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.160190 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.160170    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkdmp\" (UniqueName: \"kubernetes.io/projected/a744bfbf-fecf-436e-9bf6-d15f6964214a-kube-api-access-gkdmp\") pod \"e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr\" (UID: \"a744bfbf-fecf-436e-9bf6-d15f6964214a\") " pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.243418 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.243386    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:49.518460 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.518433    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"]
Oct 31 00:41:49.520345 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:41:49.520313    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda744bfbf_fecf_436e_9bf6_d15f6964214a.slice/crio-8051856e2688d549b348527308775cf13651eba1e7dcbd9e93c2677fc47970cb WatchSource:0}: Error finding container 8051856e2688d549b348527308775cf13651eba1e7dcbd9e93c2677fc47970cb: Status 404 returned error can't find the container with id 8051856e2688d549b348527308775cf13651eba1e7dcbd9e93c2677fc47970cb
Oct 31 00:41:49.699257 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:49.699210    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:50.133962 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:50.133861    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr" event={"ID":"a744bfbf-fecf-436e-9bf6-d15f6964214a","Type":"ContainerStarted","Data":"b6f5c3af1630c4112de171365fc327f44f045135a340e7241cfb9c96c66ff0b7"}
Oct 31 00:41:50.133962 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:50.133925    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr" event={"ID":"a744bfbf-fecf-436e-9bf6-d15f6964214a","Type":"ContainerStarted","Data":"8051856e2688d549b348527308775cf13651eba1e7dcbd9e93c2677fc47970cb"}
Oct 31 00:41:50.152936 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:50.152896    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr" podStartSLOduration=1.854806901 podStartE2EDuration="2.152884354s" totalImagesPullingTime="298.077453ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:41:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:41:50.151704722 +0000 UTC m=+451.224744804" watchObservedRunningTime="2026-10-31 00:41:50.152884354 +0000 UTC m=+451.225924436"
Oct 31 00:41:50.243909 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:50.243879    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:51.726964 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.726926    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"]
Oct 31 00:41:51.731421 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.731398    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:51.735519 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.735497    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Oct 31 00:41:51.739976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.739940    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"]
Oct 31 00:41:51.783673 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.783639    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71306bfa-d4b5-481f-a5e4-27ed52cf328c-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-qzg9d\" (UID: \"71306bfa-d4b5-481f-a5e4-27ed52cf328c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:51.783821 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.783680    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71306bfa-d4b5-481f-a5e4-27ed52cf328c-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-qzg9d\" (UID: \"71306bfa-d4b5-481f-a5e4-27ed52cf328c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:51.783821 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.783705    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71306bfa-d4b5-481f-a5e4-27ed52cf328c-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-qzg9d\" (UID: \"71306bfa-d4b5-481f-a5e4-27ed52cf328c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:51.783908 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.783824    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71306bfa-d4b5-481f-a5e4-27ed52cf328c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-qzg9d\" (UID: \"71306bfa-d4b5-481f-a5e4-27ed52cf328c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:51.783908 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.783859    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k2vb\" (UniqueName: \"kubernetes.io/projected/71306bfa-d4b5-481f-a5e4-27ed52cf328c-kube-api-access-9k2vb\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-qzg9d\" (UID: \"71306bfa-d4b5-481f-a5e4-27ed52cf328c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:51.783981 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.783943    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71306bfa-d4b5-481f-a5e4-27ed52cf328c-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-qzg9d\" (UID: \"71306bfa-d4b5-481f-a5e4-27ed52cf328c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:51.884907 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.884872    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71306bfa-d4b5-481f-a5e4-27ed52cf328c-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-qzg9d\" (UID: \"71306bfa-d4b5-481f-a5e4-27ed52cf328c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:51.885094 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.884916    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71306bfa-d4b5-481f-a5e4-27ed52cf328c-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-qzg9d\" (UID: \"71306bfa-d4b5-481f-a5e4-27ed52cf328c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:51.885094 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.884940    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71306bfa-d4b5-481f-a5e4-27ed52cf328c-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-qzg9d\" (UID: \"71306bfa-d4b5-481f-a5e4-27ed52cf328c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:51.885094 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.884960    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71306bfa-d4b5-481f-a5e4-27ed52cf328c-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-qzg9d\" (UID: \"71306bfa-d4b5-481f-a5e4-27ed52cf328c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:51.885094 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.885009    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71306bfa-d4b5-481f-a5e4-27ed52cf328c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-qzg9d\" (UID: \"71306bfa-d4b5-481f-a5e4-27ed52cf328c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:51.885094 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.885055    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9k2vb\" (UniqueName: \"kubernetes.io/projected/71306bfa-d4b5-481f-a5e4-27ed52cf328c-kube-api-access-9k2vb\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-qzg9d\" (UID: \"71306bfa-d4b5-481f-a5e4-27ed52cf328c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:51.885501 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.885467    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/71306bfa-d4b5-481f-a5e4-27ed52cf328c-home\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-qzg9d\" (UID: \"71306bfa-d4b5-481f-a5e4-27ed52cf328c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:51.885614 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.885471    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/71306bfa-d4b5-481f-a5e4-27ed52cf328c-model-cache\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-qzg9d\" (UID: \"71306bfa-d4b5-481f-a5e4-27ed52cf328c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:51.885614 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.885560    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/71306bfa-d4b5-481f-a5e4-27ed52cf328c-tmp-dir\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-qzg9d\" (UID: \"71306bfa-d4b5-481f-a5e4-27ed52cf328c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:51.887284 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.887257    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/71306bfa-d4b5-481f-a5e4-27ed52cf328c-dshm\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-qzg9d\" (UID: \"71306bfa-d4b5-481f-a5e4-27ed52cf328c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:51.887562 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.887544    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/71306bfa-d4b5-481f-a5e4-27ed52cf328c-tls-certs\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-qzg9d\" (UID: \"71306bfa-d4b5-481f-a5e4-27ed52cf328c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:51.896448 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:51.896425    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k2vb\" (UniqueName: \"kubernetes.io/projected/71306bfa-d4b5-481f-a5e4-27ed52cf328c-kube-api-access-9k2vb\") pod \"e2e-embedding-simulated-kserve-67bf594cd6-qzg9d\" (UID: \"71306bfa-d4b5-481f-a5e4-27ed52cf328c\") " pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:52.046029 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.046005    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:52.322774 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.322712    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"]
Oct 31 00:41:52.325593 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:41:52.325565    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71306bfa_d4b5_481f_a5e4_27ed52cf328c.slice/crio-8579c01cb2c6a12576a4fa271c229022fca8fc149d291e6bb2ccd35faef31177 WatchSource:0}: Error finding container 8579c01cb2c6a12576a4fa271c229022fca8fc149d291e6bb2ccd35faef31177: Status 404 returned error can't find the container with id 8579c01cb2c6a12576a4fa271c229022fca8fc149d291e6bb2ccd35faef31177
Oct 31 00:41:52.384501 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.384477    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:41:52.776767 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.776732    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"]
Oct 31 00:41:52.781170 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.781148    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:52.792980 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.792957    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-zc8dd\" (UID: \"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:52.792980 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.792971    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Oct 31 00:41:52.793087 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.792990    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-zc8dd\" (UID: \"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:52.793131 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.793102    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-zc8dd\" (UID: \"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:52.793163 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.793141    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-zc8dd\" (UID: \"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:52.793200 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.793178    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvndz\" (UniqueName: \"kubernetes.io/projected/3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597-kube-api-access-nvndz\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-zc8dd\" (UID: \"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:52.793305 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.793283    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-zc8dd\" (UID: \"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:52.795823 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.795798    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"]
Oct 31 00:41:52.894089 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.894020    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-zc8dd\" (UID: \"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:52.894089 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.894062    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-zc8dd\" (UID: \"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:52.894332 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.894092    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvndz\" (UniqueName: \"kubernetes.io/projected/3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597-kube-api-access-nvndz\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-zc8dd\" (UID: \"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:52.894332 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.894126    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-zc8dd\" (UID: \"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:52.894332 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.894162    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-zc8dd\" (UID: \"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:52.894332 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.894176    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-zc8dd\" (UID: \"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:52.895042 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.894499    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-zc8dd\" (UID: \"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:52.895042 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.894769    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597-model-cache\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-zc8dd\" (UID: \"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:52.895042 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.894886    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597-home\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-zc8dd\" (UID: \"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:52.896782 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.896754    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597-dshm\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-zc8dd\" (UID: \"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:52.897209 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.897165    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-zc8dd\" (UID: \"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:52.902697 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:52.902679    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvndz\" (UniqueName: \"kubernetes.io/projected/3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597-kube-api-access-nvndz\") pod \"e2e-trlp-test-simulated-kserve-69b588897d-zc8dd\" (UID: \"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597\") " pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:53.094439 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:53.094402    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:53.153372 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:53.152507    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d" event={"ID":"71306bfa-d4b5-481f-a5e4-27ed52cf328c","Type":"ContainerStarted","Data":"4adc33978eb40803f73c1055550e11d61c1c3f1304ee32c047290dc90788fb68"}
Oct 31 00:41:53.153372 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:53.152576    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d" event={"ID":"71306bfa-d4b5-481f-a5e4-27ed52cf328c","Type":"ContainerStarted","Data":"8579c01cb2c6a12576a4fa271c229022fca8fc149d291e6bb2ccd35faef31177"}
Oct 31 00:41:53.177627 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:53.177578    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d" podStartSLOduration=1.867133395 podStartE2EDuration="2.177564636s" totalImagesPullingTime="310.431241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:41:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:41:53.176641583 +0000 UTC m=+454.249681666" watchObservedRunningTime="2026-10-31 00:41:53.177564636 +0000 UTC m=+454.250604717"
Oct 31 00:41:53.369857 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:53.369825    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"]
Oct 31 00:41:53.373271 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:41:53.373243    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a9b8c8a_c0f9_47ea_9059_6f9da1c5b597.slice/crio-436fc4d46cf930163558b6edef1d4cda7644989b303a325d00c50a5c0af6dd91 WatchSource:0}: Error finding container 436fc4d46cf930163558b6edef1d4cda7644989b303a325d00c50a5c0af6dd91: Status 404 returned error can't find the container with id 436fc4d46cf930163558b6edef1d4cda7644989b303a325d00c50a5c0af6dd91
Oct 31 00:41:54.047046 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:54.047021    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:41:54.160245 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:54.160197    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd" event={"ID":"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597","Type":"ContainerStarted","Data":"9adf416d9722dbdd0d42170af87f85ebda402607c1fd720827af9b55087dd07b"}
Oct 31 00:41:54.160531 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:54.160504    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd" event={"ID":"3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597","Type":"ContainerStarted","Data":"436fc4d46cf930163558b6edef1d4cda7644989b303a325d00c50a5c0af6dd91"}
Oct 31 00:41:54.179891 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:54.179838    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd" podStartSLOduration=1.8782109519999999 podStartE2EDuration="2.179809217s" totalImagesPullingTime="301.598265ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:41:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:41:54.176870579 +0000 UTC m=+455.249910665" watchObservedRunningTime="2026-10-31 00:41:54.179809217 +0000 UTC m=+455.252849297"
Oct 31 00:41:55.094671 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:55.094619    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:41:55.544899 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:55.544819    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:55.557257 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:55.557233    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:56.180830 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:56.180799    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/echo-simulator-kserve-64b6f8f96c-9ldtx"
Oct 31 00:41:56.699200 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:56.699166    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:56.712082 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:56.712059    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:57.185944 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:57.185918    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l"
Oct 31 00:41:57.919172 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:57.919135    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"]
Oct 31 00:41:57.923083 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:57.923065    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:57.928769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:57.928748    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Oct 31 00:41:57.928870 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:57.928848    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-drfvd\""
Oct 31 00:41:57.935409 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:57.935380    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"]
Oct 31 00:41:57.945954 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:57.945932    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b670c3de-1e2e-47cf-af19-2a1669471c5a-workload-socket\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:57.946047 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:57.945965    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b670c3de-1e2e-47cf-af19-2a1669471c5a-workload-certs\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:57.946087 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:57.946053    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5l9h\" (UniqueName: \"kubernetes.io/projected/b670c3de-1e2e-47cf-af19-2a1669471c5a-kube-api-access-h5l9h\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:57.946118 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:57.946097    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b670c3de-1e2e-47cf-af19-2a1669471c5a-istio-token\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:57.946189 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:57.946173    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b670c3de-1e2e-47cf-af19-2a1669471c5a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:57.946260 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:57.946246    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b670c3de-1e2e-47cf-af19-2a1669471c5a-credential-socket\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:57.946300 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:57.946275    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b670c3de-1e2e-47cf-af19-2a1669471c5a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:57.946334 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:57.946297    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b670c3de-1e2e-47cf-af19-2a1669471c5a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:57.946404 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:57.946391    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b670c3de-1e2e-47cf-af19-2a1669471c5a-istio-data\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.047501 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.047462    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b670c3de-1e2e-47cf-af19-2a1669471c5a-credential-socket\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.047663 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.047516    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b670c3de-1e2e-47cf-af19-2a1669471c5a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.047663 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.047540    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b670c3de-1e2e-47cf-af19-2a1669471c5a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.047663 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.047575    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b670c3de-1e2e-47cf-af19-2a1669471c5a-istio-data\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.047663 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.047607    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b670c3de-1e2e-47cf-af19-2a1669471c5a-workload-socket\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.047663 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.047638    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b670c3de-1e2e-47cf-af19-2a1669471c5a-workload-certs\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.047946 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.047694    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5l9h\" (UniqueName: \"kubernetes.io/projected/b670c3de-1e2e-47cf-af19-2a1669471c5a-kube-api-access-h5l9h\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.047946 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.047730    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b670c3de-1e2e-47cf-af19-2a1669471c5a-istio-token\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.047946 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.047772    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b670c3de-1e2e-47cf-af19-2a1669471c5a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.047946 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.047868    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b670c3de-1e2e-47cf-af19-2a1669471c5a-credential-socket\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.047946 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.047897    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b670c3de-1e2e-47cf-af19-2a1669471c5a-istio-data\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.048261 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.048164    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b670c3de-1e2e-47cf-af19-2a1669471c5a-workload-certs\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.048440 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.048406    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b670c3de-1e2e-47cf-af19-2a1669471c5a-workload-socket\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.048536 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.048519    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b670c3de-1e2e-47cf-af19-2a1669471c5a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.049841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.049819    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b670c3de-1e2e-47cf-af19-2a1669471c5a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.049959 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.049939    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b670c3de-1e2e-47cf-af19-2a1669471c5a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.055460 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.055435    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b670c3de-1e2e-47cf-af19-2a1669471c5a-istio-token\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.055800 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.055779    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5l9h\" (UniqueName: \"kubernetes.io/projected/b670c3de-1e2e-47cf-af19-2a1669471c5a-kube-api-access-h5l9h\") pod \"maas-default-gateway-openshift-default-6f54779779-k62w7\" (UID: \"b670c3de-1e2e-47cf-af19-2a1669471c5a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.237594 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.237510    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:41:58.512944 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.512920    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"]
Oct 31 00:41:58.515312 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:41:58.515280    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb670c3de_1e2e_47cf_af19_2a1669471c5a.slice/crio-f82673b3adab2d4134f08eb787595a1036185885ddd6316abf505f496a779f6d WatchSource:0}: Error finding container f82673b3adab2d4134f08eb787595a1036185885ddd6316abf505f496a779f6d: Status 404 returned error can't find the container with id f82673b3adab2d4134f08eb787595a1036185885ddd6316abf505f496a779f6d
Oct 31 00:41:58.693933 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:58.693900    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:41:59.186033 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:59.185998    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7" event={"ID":"b670c3de-1e2e-47cf-af19-2a1669471c5a","Type":"ContainerStarted","Data":"f82673b3adab2d4134f08eb787595a1036185885ddd6316abf505f496a779f6d"}
Oct 31 00:41:59.244196 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:59.244162    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:41:59.256939 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:41:59.256915    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:42:00.207256 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:00.207151    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr"
Oct 31 00:42:01.765844 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:01.765810    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:42:01.766131 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:01.765878    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:42:01.766131 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:01.765908    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:42:02.048296 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:02.048262    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:42:02.068534 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:02.068508    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:42:02.208184 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:02.208136    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7" event={"ID":"b670c3de-1e2e-47cf-af19-2a1669471c5a","Type":"ContainerStarted","Data":"261b47e45173d18cb017855890444528de5ab6b4a41c8f9f873b22e51f8e6285"}
Oct 31 00:42:02.219844 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:02.219803    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-67bf594cd6-qzg9d"
Oct 31 00:42:02.238084 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:02.238054    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:42:02.239804 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:02.239716    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-k62w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Oct 31 00:42:02.239804 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:02.239776    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7" podUID="b670c3de-1e2e-47cf-af19-2a1669471c5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Oct 31 00:42:02.240883 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:02.240627    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7" podStartSLOduration=1.993094256 podStartE2EDuration="5.240610596s" totalImagesPullingTime="3.24751634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:41:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:42:02.239544918 +0000 UTC m=+463.312585012" watchObservedRunningTime="2026-10-31 00:42:02.240610596 +0000 UTC m=+463.313650679"
Oct 31 00:42:03.095582 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:03.095543    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:42:03.108127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:03.108101    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:42:03.225279 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:03.225252    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd"
Oct 31 00:42:03.258643 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:03.258602    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-k62w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Oct 31 00:42:03.258829 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:03.258667    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7" podUID="b670c3de-1e2e-47cf-af19-2a1669471c5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Oct 31 00:42:04.246595 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:04.246558    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-k62w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Oct 31 00:42:04.258335 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:04.258287    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7" podUID="b670c3de-1e2e-47cf-af19-2a1669471c5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Oct 31 00:42:05.245584 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:05.245549    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-k62w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Oct 31 00:42:05.245861 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:05.245832    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7" podUID="b670c3de-1e2e-47cf-af19-2a1669471c5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Oct 31 00:42:06.246977 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:06.246550    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-k62w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Oct 31 00:42:06.246977 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:06.246608    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7" podUID="b670c3de-1e2e-47cf-af19-2a1669471c5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Oct 31 00:42:07.258244 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:07.255714    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-k62w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Oct 31 00:42:07.258244 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:07.255777    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7" podUID="b670c3de-1e2e-47cf-af19-2a1669471c5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Oct 31 00:42:08.238477 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:08.238439    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-k62w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Oct 31 00:42:08.238651 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:08.238502    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7" podUID="b670c3de-1e2e-47cf-af19-2a1669471c5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Oct 31 00:42:09.238769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:09.238731    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-k62w7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body=
Oct 31 00:42:09.239241 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:09.238787    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7" podUID="b670c3de-1e2e-47cf-af19-2a1669471c5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused"
Oct 31 00:42:10.242791 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:10.242761    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:42:10.243209 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:10.243061    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:42:10.243684 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:10.243665    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7"
Oct 31 00:42:11.380513 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:42:11.380481    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:42:12.555514 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:12.555284    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/ai-gateway-controller-697b76b867-g76pk"]
Oct 31 00:42:12.560946 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:12.560922    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-697b76b867-g76pk"
Oct 31 00:42:12.569937 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:12.569916    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-metrics-tls\""
Oct 31 00:42:12.570187 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:12.570166    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"ai-gateway-controller-dockercfg-22nln\""
Oct 31 00:42:12.571917 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:12.571893    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-697b76b867-g76pk"]
Oct 31 00:42:12.576894 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:12.576872    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"ai-gateway-controller-parameters\""
Oct 31 00:42:12.717425 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:12.717393    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cptzm\" (UniqueName: \"kubernetes.io/projected/5cdcafc9-fc46-42ba-814b-9450b1ad9b06-kube-api-access-cptzm\") pod \"ai-gateway-controller-697b76b867-g76pk\" (UID: \"5cdcafc9-fc46-42ba-814b-9450b1ad9b06\") " pod="opendatahub/ai-gateway-controller-697b76b867-g76pk"
Oct 31 00:42:12.717596 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:12.717473    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cdcafc9-fc46-42ba-814b-9450b1ad9b06-metrics-certs\") pod \"ai-gateway-controller-697b76b867-g76pk\" (UID: \"5cdcafc9-fc46-42ba-814b-9450b1ad9b06\") " pod="opendatahub/ai-gateway-controller-697b76b867-g76pk"
Oct 31 00:42:12.818992 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:12.818902    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cptzm\" (UniqueName: \"kubernetes.io/projected/5cdcafc9-fc46-42ba-814b-9450b1ad9b06-kube-api-access-cptzm\") pod \"ai-gateway-controller-697b76b867-g76pk\" (UID: \"5cdcafc9-fc46-42ba-814b-9450b1ad9b06\") " pod="opendatahub/ai-gateway-controller-697b76b867-g76pk"
Oct 31 00:42:12.819161 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:12.819059    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cdcafc9-fc46-42ba-814b-9450b1ad9b06-metrics-certs\") pod \"ai-gateway-controller-697b76b867-g76pk\" (UID: \"5cdcafc9-fc46-42ba-814b-9450b1ad9b06\") " pod="opendatahub/ai-gateway-controller-697b76b867-g76pk"
Oct 31 00:42:12.821507 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:12.821488    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cdcafc9-fc46-42ba-814b-9450b1ad9b06-metrics-certs\") pod \"ai-gateway-controller-697b76b867-g76pk\" (UID: \"5cdcafc9-fc46-42ba-814b-9450b1ad9b06\") " pod="opendatahub/ai-gateway-controller-697b76b867-g76pk"
Oct 31 00:42:12.826790 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:12.826771    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cptzm\" (UniqueName: \"kubernetes.io/projected/5cdcafc9-fc46-42ba-814b-9450b1ad9b06-kube-api-access-cptzm\") pod \"ai-gateway-controller-697b76b867-g76pk\" (UID: \"5cdcafc9-fc46-42ba-814b-9450b1ad9b06\") " pod="opendatahub/ai-gateway-controller-697b76b867-g76pk"
Oct 31 00:42:12.886856 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:12.886827    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-697b76b867-g76pk"
Oct 31 00:42:12.943439 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:12.942526    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"]
Oct 31 00:42:12.947168 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:12.947145    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:12.957776 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:12.957686    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"]
Oct 31 00:42:13.020813 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.020776    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/806ab069-e9d3-404e-a334-cba5e5d2225b-workload-certs\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.020948 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.020850    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/806ab069-e9d3-404e-a334-cba5e5d2225b-workload-socket\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.020948 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.020875    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v9ln\" (UniqueName: \"kubernetes.io/projected/806ab069-e9d3-404e-a334-cba5e5d2225b-kube-api-access-5v9ln\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.021038 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.020982    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/806ab069-e9d3-404e-a334-cba5e5d2225b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.021038 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.021012    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/806ab069-e9d3-404e-a334-cba5e5d2225b-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.021101 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.021065    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/806ab069-e9d3-404e-a334-cba5e5d2225b-istio-token\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.021101 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.021085    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/806ab069-e9d3-404e-a334-cba5e5d2225b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.021189 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.021103    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/806ab069-e9d3-404e-a334-cba5e5d2225b-istio-data\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.021189 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.021173    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/806ab069-e9d3-404e-a334-cba5e5d2225b-credential-socket\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.122682 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.122599    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/806ab069-e9d3-404e-a334-cba5e5d2225b-workload-socket\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.122682 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.122633    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v9ln\" (UniqueName: \"kubernetes.io/projected/806ab069-e9d3-404e-a334-cba5e5d2225b-kube-api-access-5v9ln\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.122682 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.122678    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/806ab069-e9d3-404e-a334-cba5e5d2225b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.122966 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.122702    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/806ab069-e9d3-404e-a334-cba5e5d2225b-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.122966 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.122848    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/806ab069-e9d3-404e-a334-cba5e5d2225b-istio-token\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.122966 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.122887    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/806ab069-e9d3-404e-a334-cba5e5d2225b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.123130 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.123024    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/806ab069-e9d3-404e-a334-cba5e5d2225b-istio-data\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.123130 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.123032    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/806ab069-e9d3-404e-a334-cba5e5d2225b-workload-socket\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.123277 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.123135    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/806ab069-e9d3-404e-a334-cba5e5d2225b-credential-socket\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.123277 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.123182    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/806ab069-e9d3-404e-a334-cba5e5d2225b-workload-certs\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.123383 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.123323    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/806ab069-e9d3-404e-a334-cba5e5d2225b-istio-data\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.123513 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.123489    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/806ab069-e9d3-404e-a334-cba5e5d2225b-workload-certs\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.123555 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.123507    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/806ab069-e9d3-404e-a334-cba5e5d2225b-credential-socket\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.123613 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.123593    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/806ab069-e9d3-404e-a334-cba5e5d2225b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.124996 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.124975    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/806ab069-e9d3-404e-a334-cba5e5d2225b-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.125281 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.125262    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/806ab069-e9d3-404e-a334-cba5e5d2225b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.130674 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.130655    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/806ab069-e9d3-404e-a334-cba5e5d2225b-istio-token\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.130862 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.130844    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v9ln\" (UniqueName: \"kubernetes.io/projected/806ab069-e9d3-404e-a334-cba5e5d2225b-kube-api-access-5v9ln\") pod \"maas-default-gateway-openshift-default-6f54779779-zrxbz\" (UID: \"806ab069-e9d3-404e-a334-cba5e5d2225b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.164119 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.164096    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/ai-gateway-controller-697b76b867-g76pk"]
Oct 31 00:42:13.166175 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:42:13.166152    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cdcafc9_fc46_42ba_814b_9450b1ad9b06.slice/crio-9fc8831a159efdffe0fd06e408a30b01b32e5d753a4a6447270eecf21ee9fe9c WatchSource:0}: Error finding container 9fc8831a159efdffe0fd06e408a30b01b32e5d753a4a6447270eecf21ee9fe9c: Status 404 returned error can't find the container with id 9fc8831a159efdffe0fd06e408a30b01b32e5d753a4a6447270eecf21ee9fe9c
Oct 31 00:42:13.268699 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.268670    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:13.298610 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.298582    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-697b76b867-g76pk" event={"ID":"5cdcafc9-fc46-42ba-814b-9450b1ad9b06","Type":"ContainerStarted","Data":"9fc8831a159efdffe0fd06e408a30b01b32e5d753a4a6447270eecf21ee9fe9c"}
Oct 31 00:42:13.545870 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.545846    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"]
Oct 31 00:42:13.548092 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:42:13.548062    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod806ab069_e9d3_404e_a334_cba5e5d2225b.slice/crio-1fd1c272f3469ee21af46958b285d52b56cc9e57f43d51f45203019bbbd50942 WatchSource:0}: Error finding container 1fd1c272f3469ee21af46958b285d52b56cc9e57f43d51f45203019bbbd50942: Status 404 returned error can't find the container with id 1fd1c272f3469ee21af46958b285d52b56cc9e57f43d51f45203019bbbd50942
Oct 31 00:42:13.551401 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.551371    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:42:13.551488 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.551433    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:42:13.551488 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:13.551460    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:42:14.305351 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:14.305319    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz" event={"ID":"806ab069-e9d3-404e-a334-cba5e5d2225b","Type":"ContainerStarted","Data":"b49d198e8a29ffdae302ab0ba7f0553c7eeb781c99dd4ac20585259f72cff0cf"}
Oct 31 00:42:14.305736 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:14.305371    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz" event={"ID":"806ab069-e9d3-404e-a334-cba5e5d2225b","Type":"ContainerStarted","Data":"1fd1c272f3469ee21af46958b285d52b56cc9e57f43d51f45203019bbbd50942"}
Oct 31 00:42:14.358633 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:14.358558    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz" podStartSLOduration=2.358533877 podStartE2EDuration="2.358533877s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:42:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:42:14.345206665 +0000 UTC m=+475.418246747" watchObservedRunningTime="2026-10-31 00:42:14.358533877 +0000 UTC m=+475.431573971"
Oct 31 00:42:15.269122 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:15.269085    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:15.270471 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:15.270438    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-zrxbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Oct 31 00:42:15.270607 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:15.270488    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz" podUID="806ab069-e9d3-404e-a334-cba5e5d2225b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Oct 31 00:42:16.269279 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:16.269209    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-zrxbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Oct 31 00:42:16.269679 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:16.269306    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz" podUID="806ab069-e9d3-404e-a334-cba5e5d2225b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Oct 31 00:42:17.269747 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:17.269706    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-zrxbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Oct 31 00:42:17.270259 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:17.269764    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz" podUID="806ab069-e9d3-404e-a334-cba5e5d2225b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Oct 31 00:42:17.325090 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:17.325060    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-697b76b867-g76pk" event={"ID":"5cdcafc9-fc46-42ba-814b-9450b1ad9b06","Type":"ContainerStarted","Data":"29e462c1a79147c69a054a115d682bfcd597d70f85e1721eef3f77939c991bd2"}
Oct 31 00:42:17.325343 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:17.325159    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/ai-gateway-controller-697b76b867-g76pk"
Oct 31 00:42:18.269665 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:18.269630    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-zrxbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Oct 31 00:42:18.269934 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:18.269686    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz" podUID="806ab069-e9d3-404e-a334-cba5e5d2225b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Oct 31 00:42:19.269631 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:19.269595    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-zrxbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Oct 31 00:42:19.269826 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:19.269657    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz" podUID="806ab069-e9d3-404e-a334-cba5e5d2225b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Oct 31 00:42:20.270098 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:20.270049    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-zrxbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body=
Oct 31 00:42:20.270526 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:20.270126    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz" podUID="806ab069-e9d3-404e-a334-cba5e5d2225b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused"
Oct 31 00:42:22.269772 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:22.269727    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-zrxbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:42:22.270256 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:22.269787    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz" podUID="806ab069-e9d3-404e-a334-cba5e5d2225b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:42:23.312363 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:23.312328    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-zrxbz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:42:23.312835 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:23.312385    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz" podUID="806ab069-e9d3-404e-a334-cba5e5d2225b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:42:24.148164 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:24.148134    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:24.148628 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:24.148594    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:24.149510 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:24.149488    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz"
Oct 31 00:42:24.170096 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:24.170050    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/ai-gateway-controller-697b76b867-g76pk" podStartSLOduration=8.308717117 podStartE2EDuration="12.170036696s" totalImagesPullingTime="3.861319579s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:42:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:42:17.347142326 +0000 UTC m=+478.420182409" watchObservedRunningTime="2026-10-31 00:42:24.170036696 +0000 UTC m=+485.243076781"
Oct 31 00:42:28.333298 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:28.333269    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/ai-gateway-controller-697b76b867-g76pk"
Oct 31 00:42:41.380580 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:42:41.380544    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:42:43.011820 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:43.011786    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-697b76b867-g76pk"]
Oct 31 00:42:43.012190 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:43.012011    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/ai-gateway-controller-697b76b867-g76pk" podUID="5cdcafc9-fc46-42ba-814b-9450b1ad9b06" containerName="manager" containerID="cri-o://29e462c1a79147c69a054a115d682bfcd597d70f85e1721eef3f77939c991bd2" gracePeriod=30
Oct 31 00:42:43.266879 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:43.266820    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-697b76b867-g76pk"
Oct 31 00:42:43.352779 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:43.352746    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5cdcafc9-fc46-42ba-814b-9450b1ad9b06-kube-api-access-cptzm\" (UniqueName: \"kubernetes.io/projected/5cdcafc9-fc46-42ba-814b-9450b1ad9b06-kube-api-access-cptzm\") pod \"5cdcafc9-fc46-42ba-814b-9450b1ad9b06\" (UID: \"5cdcafc9-fc46-42ba-814b-9450b1ad9b06\") "
Oct 31 00:42:43.352968 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:43.352950    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5cdcafc9-fc46-42ba-814b-9450b1ad9b06-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cdcafc9-fc46-42ba-814b-9450b1ad9b06-metrics-certs\") pod \"5cdcafc9-fc46-42ba-814b-9450b1ad9b06\" (UID: \"5cdcafc9-fc46-42ba-814b-9450b1ad9b06\") "
Oct 31 00:42:43.354751 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:43.354722    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cdcafc9-fc46-42ba-814b-9450b1ad9b06-kube-api-access-cptzm" pod "5cdcafc9-fc46-42ba-814b-9450b1ad9b06" (UID: "5cdcafc9-fc46-42ba-814b-9450b1ad9b06"). InnerVolumeSpecName "kube-api-access-cptzm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:42:43.354865 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:43.354801    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5cdcafc9-fc46-42ba-814b-9450b1ad9b06-metrics-certs" pod "5cdcafc9-fc46-42ba-814b-9450b1ad9b06" (UID: "5cdcafc9-fc46-42ba-814b-9450b1ad9b06"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:42:43.454660 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:43.454629    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cptzm\" (UniqueName: \"kubernetes.io/projected/5cdcafc9-fc46-42ba-814b-9450b1ad9b06-kube-api-access-cptzm\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:42:43.454660 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:43.454657    5946 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5cdcafc9-fc46-42ba-814b-9450b1ad9b06-metrics-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:42:43.476807 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:43.476777    5946 generic.go:356] "Generic (PLEG): container finished" podID="5cdcafc9-fc46-42ba-814b-9450b1ad9b06" containerID="29e462c1a79147c69a054a115d682bfcd597d70f85e1721eef3f77939c991bd2" exitCode=0
Oct 31 00:42:43.476938 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:43.476816    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-697b76b867-g76pk" event={"ID":"5cdcafc9-fc46-42ba-814b-9450b1ad9b06","Type":"ContainerDied","Data":"29e462c1a79147c69a054a115d682bfcd597d70f85e1721eef3f77939c991bd2"}
Oct 31 00:42:43.476938 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:43.476831    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/ai-gateway-controller-697b76b867-g76pk"
Oct 31 00:42:43.476938 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:43.476862    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/ai-gateway-controller-697b76b867-g76pk" event={"ID":"5cdcafc9-fc46-42ba-814b-9450b1ad9b06","Type":"ContainerDied","Data":"9fc8831a159efdffe0fd06e408a30b01b32e5d753a4a6447270eecf21ee9fe9c"}
Oct 31 00:42:43.476938 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:43.476882    5946 scope.go:122] "RemoveContainer" containerID="29e462c1a79147c69a054a115d682bfcd597d70f85e1721eef3f77939c991bd2"
Oct 31 00:42:43.486319 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:43.486300    5946 scope.go:122] "RemoveContainer" containerID="29e462c1a79147c69a054a115d682bfcd597d70f85e1721eef3f77939c991bd2"
Oct 31 00:42:43.486605 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:42:43.486585    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29e462c1a79147c69a054a115d682bfcd597d70f85e1721eef3f77939c991bd2\": container with ID starting with 29e462c1a79147c69a054a115d682bfcd597d70f85e1721eef3f77939c991bd2 not found: ID does not exist" containerID="29e462c1a79147c69a054a115d682bfcd597d70f85e1721eef3f77939c991bd2"
Oct 31 00:42:43.486653 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:43.486615    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29e462c1a79147c69a054a115d682bfcd597d70f85e1721eef3f77939c991bd2"} err="failed to get container status \"29e462c1a79147c69a054a115d682bfcd597d70f85e1721eef3f77939c991bd2\": rpc error: code = NotFound desc = could not find container \"29e462c1a79147c69a054a115d682bfcd597d70f85e1721eef3f77939c991bd2\": container with ID starting with 29e462c1a79147c69a054a115d682bfcd597d70f85e1721eef3f77939c991bd2 not found: ID does not exist"
Oct 31 00:42:43.499539 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:43.499513    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/ai-gateway-controller-697b76b867-g76pk"]
Oct 31 00:42:43.501921 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:43.501898    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/ai-gateway-controller-697b76b867-g76pk"]
Oct 31 00:42:45.055096 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:42:45.055065    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5cdcafc9-fc46-42ba-814b-9450b1ad9b06" path="/var/lib/kubelet/pods/5cdcafc9-fc46-42ba-814b-9450b1ad9b06/volumes"
Oct 31 00:43:11.379826 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:43:11.379790    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:43:12.266434 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.266405    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"]
Oct 31 00:43:12.268599 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.266903    5946 cpu_manager.go:414] "containerMap: removing container" podUID="5cdcafc9-fc46-42ba-814b-9450b1ad9b06" containerName="manager"
Oct 31 00:43:12.268599 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.266916    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5cdcafc9-fc46-42ba-814b-9450b1ad9b06" containerName="manager"
Oct 31 00:43:12.268599 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.267018    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="5cdcafc9-fc46-42ba-814b-9450b1ad9b06" containerName="manager"
Oct 31 00:43:12.270136 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.270118    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.276906 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.276886    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w5-44bc67-openshift-default-dockercfg-z6hg4\""
Oct 31 00:43:12.284413 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.284390    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"]
Oct 31 00:43:12.341760 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.341723    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-workload-certs\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.341940 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.341795    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-podinfo\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.341940 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.341857    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc8f1228-2303-4afe-a4cc-831825f95a18-istiod-ca-cert\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.341940 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.341889    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fv98f\" (UniqueName: \"kubernetes.io/projected/fc8f1228-2303-4afe-a4cc-831825f95a18-kube-api-access-fv98f\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.342132 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.341984    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-token\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.342132 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.342048    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-envoy\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.342277 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.342153    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-credential-socket\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.342377 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.342293    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-workload-socket\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.342377 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.342321    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-data\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.443444 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.443410    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-workload-socket\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.443900 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.443454    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-data\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.443900 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.443505    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-workload-certs\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.443900 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.443544    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-podinfo\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.443900 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.443577    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc8f1228-2303-4afe-a4cc-831825f95a18-istiod-ca-cert\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.443900 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.443598    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fv98f\" (UniqueName: \"kubernetes.io/projected/fc8f1228-2303-4afe-a4cc-831825f95a18-kube-api-access-fv98f\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.443900 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.443631    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-token\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.443900 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.443672    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-envoy\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.443900 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.443698    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-credential-socket\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.443900 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.443890    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-workload-socket\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.444440 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.444108    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-credential-socket\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.444440 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.444244    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-data\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.444440 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.444320    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-workload-certs\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.445295 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.445269    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc8f1228-2303-4afe-a4cc-831825f95a18-istiod-ca-cert\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.446356 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.446331    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-podinfo\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.446473 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.446452    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-envoy\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.456472 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.456417    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-token\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.457325 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.457300    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fv98f\" (UniqueName: \"kubernetes.io/projected/fc8f1228-2303-4afe-a4cc-831825f95a18-kube-api-access-fv98f\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.532449 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.532376    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"]
Oct 31 00:43:12.537553 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.537531    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.550019 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.548564    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"]
Oct 31 00:43:12.566526 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.566503    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w4-5c2a03-openshift-default-dockercfg-6267p\""
Oct 31 00:43:12.585527 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.585502    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:12.622943 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.622906    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"]
Oct 31 00:43:12.628075 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.628048    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.637559 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.637531    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"]
Oct 31 00:43:12.645982 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.645953    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-workload-socket\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.646107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.646014    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-credential-socket\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.646107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.646059    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-envoy\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.646107 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.646100    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-podinfo\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.646292 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.646147    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/294716ae-2b4b-48e2-bec4-e84bcac470b4-istiod-ca-cert\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.646292 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.646201    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-data\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.646292 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.646264    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-workload-certs\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.646397 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.646289    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22hqr\" (UniqueName: \"kubernetes.io/projected/294716ae-2b4b-48e2-bec4-e84bcac470b4-kube-api-access-22hqr\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.646479 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.646460    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-token\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.673263 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.672195    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w1-7f1496-openshift-default-dockercfg-jpdcs\""
Oct 31 00:43:12.747707 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.747675    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-data\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.747863 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.747717    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-workload-socket\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.747863 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.747796    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-workload-certs\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.747988 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.747858    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22hqr\" (UniqueName: \"kubernetes.io/projected/294716ae-2b4b-48e2-bec4-e84bcac470b4-kube-api-access-22hqr\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.747988 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.747916    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v28r4\" (UniqueName: \"kubernetes.io/projected/6990c602-9395-451f-ae35-8a351c5aacf7-kube-api-access-v28r4\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.748094 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.748042    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-token\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.748152 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.748109    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-data\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.748212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.748128    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-workload-socket\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.748212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.748162    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-workload-certs\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.748212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.748186    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-istio-data\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.748395 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.748246    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-credential-socket\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.748395 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.748293    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6990c602-9395-451f-ae35-8a351c5aacf7-istio-token\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.748395 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.748323    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-envoy\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.748395 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.748368    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-podinfo\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.748609 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.748402    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-workload-socket\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.748609 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.748407    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-credential-socket\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.748609 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.748461    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-credential-socket\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.748768 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.748608    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-workload-certs\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.748768 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.748665    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/294716ae-2b4b-48e2-bec4-e84bcac470b4-istiod-ca-cert\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.748768 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.748696    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-istio-envoy\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.748768 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.748728    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6990c602-9395-451f-ae35-8a351c5aacf7-istio-podinfo\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.748768 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.748757    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6990c602-9395-451f-ae35-8a351c5aacf7-istiod-ca-cert\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.749347 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.749325    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/294716ae-2b4b-48e2-bec4-e84bcac470b4-istiod-ca-cert\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.750648 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.750624    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-envoy\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.750838 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.750818    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-podinfo\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.758480 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.758451    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-token\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.758672 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.758610    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22hqr\" (UniqueName: \"kubernetes.io/projected/294716ae-2b4b-48e2-bec4-e84bcac470b4-kube-api-access-22hqr\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.849854 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.849819    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-istio-data\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.850040 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.849877    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6990c602-9395-451f-ae35-8a351c5aacf7-istio-token\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.850040 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.849906    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-credential-socket\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.850040 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.849929    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-workload-certs\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.850040 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.849950    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-istio-envoy\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.850040 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.849972    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6990c602-9395-451f-ae35-8a351c5aacf7-istio-podinfo\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.850040 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.849998    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6990c602-9395-451f-ae35-8a351c5aacf7-istiod-ca-cert\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.850486 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.850100    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-workload-socket\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.850486 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.850201    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v28r4\" (UniqueName: \"kubernetes.io/projected/6990c602-9395-451f-ae35-8a351c5aacf7-kube-api-access-v28r4\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.850486 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.850301    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-istio-data\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.850486 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.850348    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-workload-certs\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.850714 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.850579    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-workload-socket\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.850714 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.850631    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-credential-socket\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.851040 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.851019    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6990c602-9395-451f-ae35-8a351c5aacf7-istiod-ca-cert\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.852454 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.852426    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-istio-envoy\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.852588 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.852571    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6990c602-9395-451f-ae35-8a351c5aacf7-istio-podinfo\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.854712 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.854691    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:12.858586 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.858564    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6990c602-9395-451f-ae35-8a351c5aacf7-istio-token\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.860395 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.860376    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v28r4\" (UniqueName: \"kubernetes.io/projected/6990c602-9395-451f-ae35-8a351c5aacf7-kube-api-access-v28r4\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:12.879570 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.879539    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"]
Oct 31 00:43:12.881793 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:43:12.881763    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc8f1228_2303_4afe_a4cc_831825f95a18.slice/crio-18f3afbba2a64170ebdfcc0367e2dddcfcedb9f56fb9eaf291fd3084d88b7bc7 WatchSource:0}: Error finding container 18f3afbba2a64170ebdfcc0367e2dddcfcedb9f56fb9eaf291fd3084d88b7bc7: Status 404 returned error can't find the container with id 18f3afbba2a64170ebdfcc0367e2dddcfcedb9f56fb9eaf291fd3084d88b7bc7
Oct 31 00:43:12.884399 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.884364    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:43:12.884507 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.884459    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:43:12.884507 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.884489    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:43:12.952281 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:12.952256    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:13.157384 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.157354    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"]
Oct 31 00:43:13.160439 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:43:13.160402    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod294716ae_2b4b_48e2_bec4_e84bcac470b4.slice/crio-198ef368bf49093e5916699400e1e7d0471c0c10428ae3860753af61186c816f WatchSource:0}: Error finding container 198ef368bf49093e5916699400e1e7d0471c0c10428ae3860753af61186c816f: Status 404 returned error can't find the container with id 198ef368bf49093e5916699400e1e7d0471c0c10428ae3860753af61186c816f
Oct 31 00:43:13.163339 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.163306    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:43:13.163427 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.163374    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:43:13.163427 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.163408    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:43:13.271776 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.271751    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"]
Oct 31 00:43:13.274022 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:43:13.273989    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6990c602_9395_451f_ae35_8a351c5aacf7.slice/crio-28be893a65ab9070e682aed78f4684c7c927a1d4e4977cebe6fc17735f0018d3 WatchSource:0}: Error finding container 28be893a65ab9070e682aed78f4684c7c927a1d4e4977cebe6fc17735f0018d3: Status 404 returned error can't find the container with id 28be893a65ab9070e682aed78f4684c7c927a1d4e4977cebe6fc17735f0018d3
Oct 31 00:43:13.276697 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.276667    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:43:13.276786 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.276728    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:43:13.276786 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.276756    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:43:13.634086 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.634054    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm" event={"ID":"294716ae-2b4b-48e2-bec4-e84bcac470b4","Type":"ContainerStarted","Data":"06de6cd8b0f1ee69cbfd1def8f44cc3bca7c462308d1f5d7eabc2b296df250de"}
Oct 31 00:43:13.634564 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.634120    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm" event={"ID":"294716ae-2b4b-48e2-bec4-e84bcac470b4","Type":"ContainerStarted","Data":"198ef368bf49093e5916699400e1e7d0471c0c10428ae3860753af61186c816f"}
Oct 31 00:43:13.635681 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.635656    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg" event={"ID":"fc8f1228-2303-4afe-a4cc-831825f95a18","Type":"ContainerStarted","Data":"fe0f7ab6cf3e10f7e6db3c44cf3db3c47bcd218197688fa0f555ca6717c0cf68"}
Oct 31 00:43:13.635773 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.635706    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg" event={"ID":"fc8f1228-2303-4afe-a4cc-831825f95a18","Type":"ContainerStarted","Data":"18f3afbba2a64170ebdfcc0367e2dddcfcedb9f56fb9eaf291fd3084d88b7bc7"}
Oct 31 00:43:13.637160 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.637137    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m" event={"ID":"6990c602-9395-451f-ae35-8a351c5aacf7","Type":"ContainerStarted","Data":"0e44cdabb93cf120d5932387bdd5de6e1323abcabd26043ccd7f9a2f286d3d9e"}
Oct 31 00:43:13.637254 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.637240    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m" event={"ID":"6990c602-9395-451f-ae35-8a351c5aacf7","Type":"ContainerStarted","Data":"28be893a65ab9070e682aed78f4684c7c927a1d4e4977cebe6fc17735f0018d3"}
Oct 31 00:43:13.654703 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.654653    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm" podStartSLOduration=1.654639044 podStartE2EDuration="1.654639044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:43:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:43:13.653215513 +0000 UTC m=+534.726255598" watchObservedRunningTime="2026-10-31 00:43:13.654639044 +0000 UTC m=+534.727679127"
Oct 31 00:43:13.679737 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.679690    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg" podStartSLOduration=1.67967767 podStartE2EDuration="1.67967767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:43:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:43:13.678210507 +0000 UTC m=+534.751250589" watchObservedRunningTime="2026-10-31 00:43:13.67967767 +0000 UTC m=+534.752717751"
Oct 31 00:43:13.700501 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.700455    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m" podStartSLOduration=1.7004411209999999 podStartE2EDuration="1.700441121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:43:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:43:13.699156094 +0000 UTC m=+534.772196175" watchObservedRunningTime="2026-10-31 00:43:13.700441121 +0000 UTC m=+534.773481202"
Oct 31 00:43:13.855680 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.855647    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:13.952460 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:13.952378    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:14.586015 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:14.585987    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:14.591125 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:14.591101    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:14.643569 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:14.643543    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:14.644266 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:14.644249    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:14.861177 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:14.861099    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:14.958197 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:14.958168    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:15.650663 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:15.650624    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:15.651101 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:15.650688    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:15.651498 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:15.651477    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:15.651638 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:15.651532    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:17.349024 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:17.348971    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf"]
Oct 31 00:43:17.353406 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:17.353381    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf"
Oct 31 00:43:17.367373 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:17.367347    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w6-47f370\""
Oct 31 00:43:17.372090 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:17.371986    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf"]
Oct 31 00:43:17.512243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:17.510126    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30197b12-e066-43b4-b920-c1757b9516ce-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf\" (UID: \"30197b12-e066-43b4-b920-c1757b9516ce\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf"
Oct 31 00:43:17.512243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:17.510341    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mm69\" (UniqueName: \"kubernetes.io/projected/30197b12-e066-43b4-b920-c1757b9516ce-kube-api-access-2mm69\") pod \"payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf\" (UID: \"30197b12-e066-43b4-b920-c1757b9516ce\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf"
Oct 31 00:43:17.612296 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:17.611789    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mm69\" (UniqueName: \"kubernetes.io/projected/30197b12-e066-43b4-b920-c1757b9516ce-kube-api-access-2mm69\") pod \"payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf\" (UID: \"30197b12-e066-43b4-b920-c1757b9516ce\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf"
Oct 31 00:43:17.612296 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:17.611962    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30197b12-e066-43b4-b920-c1757b9516ce-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf\" (UID: \"30197b12-e066-43b4-b920-c1757b9516ce\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf"
Oct 31 00:43:17.613245 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:17.612915    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30197b12-e066-43b4-b920-c1757b9516ce-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf\" (UID: \"30197b12-e066-43b4-b920-c1757b9516ce\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf"
Oct 31 00:43:17.646539 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:17.646456    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mm69\" (UniqueName: \"kubernetes.io/projected/30197b12-e066-43b4-b920-c1757b9516ce-kube-api-access-2mm69\") pod \"payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf\" (UID: \"30197b12-e066-43b4-b920-c1757b9516ce\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf"
Oct 31 00:43:17.681195 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:17.681163    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf"
Oct 31 00:43:17.960004 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:17.959980    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf"]
Oct 31 00:43:17.962678 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:43:17.962647    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30197b12_e066_43b4_b920_c1757b9516ce.slice/crio-0a3b784a3b66a841b9a73791ed4710ca04707d8a5f2aeb498852bba051083c1d WatchSource:0}: Error finding container 0a3b784a3b66a841b9a73791ed4710ca04707d8a5f2aeb498852bba051083c1d: Status 404 returned error can't find the container with id 0a3b784a3b66a841b9a73791ed4710ca04707d8a5f2aeb498852bba051083c1d
Oct 31 00:43:17.988673 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:17.988644    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb"]
Oct 31 00:43:17.993920 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:17.993901    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb"
Oct 31 00:43:18.004873 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.004847    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb"]
Oct 31 00:43:18.066797 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.066763    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-5c2a03\""
Oct 31 00:43:18.067022 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.066924    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-5c2a03-dockercfg-s9tk9\""
Oct 31 00:43:18.116660 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.116625    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f284a1af-11d1-42bf-b051-a534bed8b400-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb\" (UID: \"f284a1af-11d1-42bf-b051-a534bed8b400\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb"
Oct 31 00:43:18.116826 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.116673    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxstc\" (UniqueName: \"kubernetes.io/projected/f284a1af-11d1-42bf-b051-a534bed8b400-kube-api-access-cxstc\") pod \"payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb\" (UID: \"f284a1af-11d1-42bf-b051-a534bed8b400\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb"
Oct 31 00:43:18.192788 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.192748    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"]
Oct 31 00:43:18.197041 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.197018    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"
Oct 31 00:43:18.213054 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.212986    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"]
Oct 31 00:43:18.218252 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.218207    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f284a1af-11d1-42bf-b051-a534bed8b400-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb\" (UID: \"f284a1af-11d1-42bf-b051-a534bed8b400\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb"
Oct 31 00:43:18.218357 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.218279    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxstc\" (UniqueName: \"kubernetes.io/projected/f284a1af-11d1-42bf-b051-a534bed8b400-kube-api-access-cxstc\") pod \"payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb\" (UID: \"f284a1af-11d1-42bf-b051-a534bed8b400\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb"
Oct 31 00:43:18.218982 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.218964    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f284a1af-11d1-42bf-b051-a534bed8b400-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb\" (UID: \"f284a1af-11d1-42bf-b051-a534bed8b400\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb"
Oct 31 00:43:18.229126 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.229081    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxstc\" (UniqueName: \"kubernetes.io/projected/f284a1af-11d1-42bf-b051-a534bed8b400-kube-api-access-cxstc\") pod \"payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb\" (UID: \"f284a1af-11d1-42bf-b051-a534bed8b400\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb"
Oct 31 00:43:18.266522 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.266493    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w6-47f370-serving-cert\""
Oct 31 00:43:18.309186 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.309157    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb"
Oct 31 00:43:18.319712 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.319688    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bed92ef5-059c-49d2-832f-f0af407f26f6-metrics-certs\") pod \"maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t\" (UID: \"bed92ef5-059c-49d2-832f-f0af407f26f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"
Oct 31 00:43:18.319821 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.319743    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bed92ef5-059c-49d2-832f-f0af407f26f6-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t\" (UID: \"bed92ef5-059c-49d2-832f-f0af407f26f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"
Oct 31 00:43:18.319934 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.319912    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bed92ef5-059c-49d2-832f-f0af407f26f6-maas-api-tls\") pod \"maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t\" (UID: \"bed92ef5-059c-49d2-832f-f0af407f26f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"
Oct 31 00:43:18.319997 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.319977    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkdjj\" (UniqueName: \"kubernetes.io/projected/bed92ef5-059c-49d2-832f-f0af407f26f6-kube-api-access-fkdjj\") pod \"maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t\" (UID: \"bed92ef5-059c-49d2-832f-f0af407f26f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"
Oct 31 00:43:18.421235 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.421184    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bed92ef5-059c-49d2-832f-f0af407f26f6-metrics-certs\") pod \"maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t\" (UID: \"bed92ef5-059c-49d2-832f-f0af407f26f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"
Oct 31 00:43:18.421720 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.421262    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bed92ef5-059c-49d2-832f-f0af407f26f6-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t\" (UID: \"bed92ef5-059c-49d2-832f-f0af407f26f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"
Oct 31 00:43:18.421720 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.421330    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bed92ef5-059c-49d2-832f-f0af407f26f6-maas-api-tls\") pod \"maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t\" (UID: \"bed92ef5-059c-49d2-832f-f0af407f26f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"
Oct 31 00:43:18.421720 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.421383    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkdjj\" (UniqueName: \"kubernetes.io/projected/bed92ef5-059c-49d2-832f-f0af407f26f6-kube-api-access-fkdjj\") pod \"maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t\" (UID: \"bed92ef5-059c-49d2-832f-f0af407f26f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"
Oct 31 00:43:18.422089 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.422064    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bed92ef5-059c-49d2-832f-f0af407f26f6-openshift-service-ca\") pod \"maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t\" (UID: \"bed92ef5-059c-49d2-832f-f0af407f26f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"
Oct 31 00:43:18.424172 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.424151    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bed92ef5-059c-49d2-832f-f0af407f26f6-metrics-certs\") pod \"maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t\" (UID: \"bed92ef5-059c-49d2-832f-f0af407f26f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"
Oct 31 00:43:18.424314 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.424255    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bed92ef5-059c-49d2-832f-f0af407f26f6-maas-api-tls\") pod \"maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t\" (UID: \"bed92ef5-059c-49d2-832f-f0af407f26f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"
Oct 31 00:43:18.428468 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.428446    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkdjj\" (UniqueName: \"kubernetes.io/projected/bed92ef5-059c-49d2-832f-f0af407f26f6-kube-api-access-fkdjj\") pod \"maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t\" (UID: \"bed92ef5-059c-49d2-832f-f0af407f26f6\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"
Oct 31 00:43:18.522729 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.522567    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"
Oct 31 00:43:18.585553 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.585519    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb"]
Oct 31 00:43:18.588829 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:43:18.588301    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf284a1af_11d1_42bf_b051_a534bed8b400.slice/crio-758c047e6ce5a9768818cbf6a29fd6180ba0a300d473499dc025002970a5c02b WatchSource:0}: Error finding container 758c047e6ce5a9768818cbf6a29fd6180ba0a300d473499dc025002970a5c02b: Status 404 returned error can't find the container with id 758c047e6ce5a9768818cbf6a29fd6180ba0a300d473499dc025002970a5c02b
Oct 31 00:43:18.674069 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.674030    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf" event={"ID":"30197b12-e066-43b4-b920-c1757b9516ce","Type":"ContainerStarted","Data":"0a3b784a3b66a841b9a73791ed4710ca04707d8a5f2aeb498852bba051083c1d"}
Oct 31 00:43:18.676462 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.676380    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb" event={"ID":"f284a1af-11d1-42bf-b051-a534bed8b400","Type":"ContainerStarted","Data":"758c047e6ce5a9768818cbf6a29fd6180ba0a300d473499dc025002970a5c02b"}
Oct 31 00:43:18.812550 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:18.812518    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"]
Oct 31 00:43:18.818848 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:43:18.818808    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbed92ef5_059c_49d2_832f_f0af407f26f6.slice/crio-27f9ed6aac38bf6cb33dc920b484776d708366365f28263d9fdb4721f4175fca WatchSource:0}: Error finding container 27f9ed6aac38bf6cb33dc920b484776d708366365f28263d9fdb4721f4175fca: Status 404 returned error can't find the container with id 27f9ed6aac38bf6cb33dc920b484776d708366365f28263d9fdb4721f4175fca
Oct 31 00:43:19.243106 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.242291    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"]
Oct 31 00:43:19.249528 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.248748    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"]
Oct 31 00:43:19.249528 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.248869    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"
Oct 31 00:43:19.255270 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.254406    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w4-5c2a03-serving-cert\""
Oct 31 00:43:19.334895 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.334862    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95983973-b5ea-4f87-a3f5-62f5c9850747-metrics-certs\") pod \"maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx\" (UID: \"95983973-b5ea-4f87-a3f5-62f5c9850747\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"
Oct 31 00:43:19.335072 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.334967    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95983973-b5ea-4f87-a3f5-62f5c9850747-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx\" (UID: \"95983973-b5ea-4f87-a3f5-62f5c9850747\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"
Oct 31 00:43:19.335151 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.335086    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzjhn\" (UniqueName: \"kubernetes.io/projected/95983973-b5ea-4f87-a3f5-62f5c9850747-kube-api-access-lzjhn\") pod \"maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx\" (UID: \"95983973-b5ea-4f87-a3f5-62f5c9850747\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"
Oct 31 00:43:19.335229 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.335147    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95983973-b5ea-4f87-a3f5-62f5c9850747-maas-api-tls\") pod \"maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx\" (UID: \"95983973-b5ea-4f87-a3f5-62f5c9850747\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"
Oct 31 00:43:19.436526 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.436490    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95983973-b5ea-4f87-a3f5-62f5c9850747-maas-api-tls\") pod \"maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx\" (UID: \"95983973-b5ea-4f87-a3f5-62f5c9850747\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"
Oct 31 00:43:19.436981 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.436591    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95983973-b5ea-4f87-a3f5-62f5c9850747-metrics-certs\") pod \"maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx\" (UID: \"95983973-b5ea-4f87-a3f5-62f5c9850747\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"
Oct 31 00:43:19.436981 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.436663    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95983973-b5ea-4f87-a3f5-62f5c9850747-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx\" (UID: \"95983973-b5ea-4f87-a3f5-62f5c9850747\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"
Oct 31 00:43:19.436981 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.436839    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzjhn\" (UniqueName: \"kubernetes.io/projected/95983973-b5ea-4f87-a3f5-62f5c9850747-kube-api-access-lzjhn\") pod \"maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx\" (UID: \"95983973-b5ea-4f87-a3f5-62f5c9850747\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"
Oct 31 00:43:19.437691 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.437666    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95983973-b5ea-4f87-a3f5-62f5c9850747-openshift-service-ca\") pod \"maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx\" (UID: \"95983973-b5ea-4f87-a3f5-62f5c9850747\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"
Oct 31 00:43:19.439405 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.439383    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95983973-b5ea-4f87-a3f5-62f5c9850747-maas-api-tls\") pod \"maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx\" (UID: \"95983973-b5ea-4f87-a3f5-62f5c9850747\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"
Oct 31 00:43:19.440152 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.440127    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95983973-b5ea-4f87-a3f5-62f5c9850747-metrics-certs\") pod \"maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx\" (UID: \"95983973-b5ea-4f87-a3f5-62f5c9850747\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"
Oct 31 00:43:19.454919 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.454890    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzjhn\" (UniqueName: \"kubernetes.io/projected/95983973-b5ea-4f87-a3f5-62f5c9850747-kube-api-access-lzjhn\") pod \"maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx\" (UID: \"95983973-b5ea-4f87-a3f5-62f5c9850747\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"
Oct 31 00:43:19.579049 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.579009    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"
Oct 31 00:43:19.693126 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.692565    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t" event={"ID":"bed92ef5-059c-49d2-832f-f0af407f26f6","Type":"ContainerStarted","Data":"50e5da50e1b5950def20e2530e168b7f47b43947da0c321a98a9ecd3259980e7"}
Oct 31 00:43:19.693126 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.692631    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t" event={"ID":"bed92ef5-059c-49d2-832f-f0af407f26f6","Type":"ContainerStarted","Data":"27f9ed6aac38bf6cb33dc920b484776d708366365f28263d9fdb4721f4175fca"}
Oct 31 00:43:19.693126 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.692859    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"
Oct 31 00:43:19.886066 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.885248    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t" podStartSLOduration=1.40158717 podStartE2EDuration="1.885213426s" totalImagesPullingTime="483.626256ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:43:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:43:19.714901719 +0000 UTC m=+540.787941800" watchObservedRunningTime="2026-10-31 00:43:19.885213426 +0000 UTC m=+540.958253510"
Oct 31 00:43:19.886473 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:19.886446    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"]
Oct 31 00:43:19.889658 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:43:19.889630    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95983973_b5ea_4f87_a3f5_62f5c9850747.slice/crio-391f4e78ed9a530506df30ea9d2447cb57f5f65439b7ac4a57044e3fd5acbd28 WatchSource:0}: Error finding container 391f4e78ed9a530506df30ea9d2447cb57f5f65439b7ac4a57044e3fd5acbd28: Status 404 returned error can't find the container with id 391f4e78ed9a530506df30ea9d2447cb57f5f65439b7ac4a57044e3fd5acbd28
Oct 31 00:43:20.702958 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:20.702877    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx" event={"ID":"95983973-b5ea-4f87-a3f5-62f5c9850747","Type":"ContainerStarted","Data":"12e847ab86706da5967dc79d108bf9530f98e5f4e942f0cf62ffa5536b4d6a27"}
Oct 31 00:43:20.702958 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:20.702941    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx" event={"ID":"95983973-b5ea-4f87-a3f5-62f5c9850747","Type":"ContainerStarted","Data":"391f4e78ed9a530506df30ea9d2447cb57f5f65439b7ac4a57044e3fd5acbd28"}
Oct 31 00:43:20.703445 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:20.703003    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"
Oct 31 00:43:20.724451 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:20.724392    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx" podStartSLOduration=1.281775022 podStartE2EDuration="1.724376043s" totalImagesPullingTime="442.601021ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:43:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:43:20.723124842 +0000 UTC m=+541.796164926" watchObservedRunningTime="2026-10-31 00:43:20.724376043 +0000 UTC m=+541.797416125"
Oct 31 00:43:21.103256 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.103184    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"]
Oct 31 00:43:21.107914 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.107504    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"
Oct 31 00:43:21.115609 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.115585    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w5-44bc67-serving-cert\""
Oct 31 00:43:21.119532 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.119318    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"]
Oct 31 00:43:21.263290 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.263254    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l9jj\" (UniqueName: \"kubernetes.io/projected/c6595fa5-8566-4e13-8d16-d818383d84d0-kube-api-access-6l9jj\") pod \"maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt\" (UID: \"c6595fa5-8566-4e13-8d16-d818383d84d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"
Oct 31 00:43:21.263465 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.263370    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6595fa5-8566-4e13-8d16-d818383d84d0-maas-api-tls\") pod \"maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt\" (UID: \"c6595fa5-8566-4e13-8d16-d818383d84d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"
Oct 31 00:43:21.263583 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.263555    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6595fa5-8566-4e13-8d16-d818383d84d0-metrics-certs\") pod \"maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt\" (UID: \"c6595fa5-8566-4e13-8d16-d818383d84d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"
Oct 31 00:43:21.263632 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.263600    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6595fa5-8566-4e13-8d16-d818383d84d0-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt\" (UID: \"c6595fa5-8566-4e13-8d16-d818383d84d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"
Oct 31 00:43:21.365318 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.365213    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l9jj\" (UniqueName: \"kubernetes.io/projected/c6595fa5-8566-4e13-8d16-d818383d84d0-kube-api-access-6l9jj\") pod \"maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt\" (UID: \"c6595fa5-8566-4e13-8d16-d818383d84d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"
Oct 31 00:43:21.365318 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.365310    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6595fa5-8566-4e13-8d16-d818383d84d0-maas-api-tls\") pod \"maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt\" (UID: \"c6595fa5-8566-4e13-8d16-d818383d84d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"
Oct 31 00:43:21.365532 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.365425    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6595fa5-8566-4e13-8d16-d818383d84d0-metrics-certs\") pod \"maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt\" (UID: \"c6595fa5-8566-4e13-8d16-d818383d84d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"
Oct 31 00:43:21.365532 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.365451    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6595fa5-8566-4e13-8d16-d818383d84d0-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt\" (UID: \"c6595fa5-8566-4e13-8d16-d818383d84d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"
Oct 31 00:43:21.366104 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.366081    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6595fa5-8566-4e13-8d16-d818383d84d0-openshift-service-ca\") pod \"maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt\" (UID: \"c6595fa5-8566-4e13-8d16-d818383d84d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"
Oct 31 00:43:21.367965 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.367944    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6595fa5-8566-4e13-8d16-d818383d84d0-metrics-certs\") pod \"maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt\" (UID: \"c6595fa5-8566-4e13-8d16-d818383d84d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"
Oct 31 00:43:21.368399 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.368376    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6595fa5-8566-4e13-8d16-d818383d84d0-maas-api-tls\") pod \"maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt\" (UID: \"c6595fa5-8566-4e13-8d16-d818383d84d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"
Oct 31 00:43:21.373719 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.373696    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l9jj\" (UniqueName: \"kubernetes.io/projected/c6595fa5-8566-4e13-8d16-d818383d84d0-kube-api-access-6l9jj\") pod \"maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt\" (UID: \"c6595fa5-8566-4e13-8d16-d818383d84d0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"
Oct 31 00:43:21.423418 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.423387    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:43:21.430956 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.430932    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"
Oct 31 00:43:21.709982 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.709892    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb" event={"ID":"f284a1af-11d1-42bf-b051-a534bed8b400","Type":"ContainerStarted","Data":"0aec0d5c8dd185d14de5a8f7566f910d3db242487018e2d38707b1f7ae8c6c77"}
Oct 31 00:43:21.709982 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.709953    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb"
Oct 31 00:43:21.711667 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.711640    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf" event={"ID":"30197b12-e066-43b4-b920-c1757b9516ce","Type":"ContainerStarted","Data":"241b5a59980fffdac4e0fed21bf31dec936876360eaeaf25548e4b5596adae57"}
Oct 31 00:43:21.711858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.711839    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf"
Oct 31 00:43:21.714817 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.714799    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"]
Oct 31 00:43:21.717126 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:43:21.717097    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6595fa5_8566_4e13_8d16_d818383d84d0.slice/crio-f729301f8958ed51993d3b4269fc903f687271c9483e5d4f04ca7fef468b943d WatchSource:0}: Error finding container f729301f8958ed51993d3b4269fc903f687271c9483e5d4f04ca7fef468b943d: Status 404 returned error can't find the container with id f729301f8958ed51993d3b4269fc903f687271c9483e5d4f04ca7fef468b943d
Oct 31 00:43:21.729308 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.729261    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb" podStartSLOduration=2.216234471 podStartE2EDuration="4.72924654s" totalImagesPullingTime="2.513012069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:43:21.728131129 +0000 UTC m=+542.801171211" watchObservedRunningTime="2026-10-31 00:43:21.72924654 +0000 UTC m=+542.802286623"
Oct 31 00:43:21.750982 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:21.750932    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf" podStartSLOduration=1.9432834780000001 podStartE2EDuration="4.750921649s" totalImagesPullingTime="2.807638171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:43:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:43:21.749369968 +0000 UTC m=+542.822410050" watchObservedRunningTime="2026-10-31 00:43:21.750921649 +0000 UTC m=+542.823961731"
Oct 31 00:43:22.112144 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.112112    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"]
Oct 31 00:43:22.117914 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.117688    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"
Oct 31 00:43:22.132712 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.132687    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"]
Oct 31 00:43:22.143486 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.143463    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w1-7f1496-serving-cert\""
Oct 31 00:43:22.275454 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.275420    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1fecfeb-15bf-4365-a76f-915eda6b56a0-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg\" (UID: \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"
Oct 31 00:43:22.275634 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.275571    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7bb2\" (UniqueName: \"kubernetes.io/projected/a1fecfeb-15bf-4365-a76f-915eda6b56a0-kube-api-access-t7bb2\") pod \"maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg\" (UID: \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"
Oct 31 00:43:22.275634 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.275615    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1fecfeb-15bf-4365-a76f-915eda6b56a0-maas-api-tls\") pod \"maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg\" (UID: \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"
Oct 31 00:43:22.275721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.275700    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1fecfeb-15bf-4365-a76f-915eda6b56a0-metrics-certs\") pod \"maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg\" (UID: \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"
Oct 31 00:43:22.376840 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.376763    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1fecfeb-15bf-4365-a76f-915eda6b56a0-metrics-certs\") pod \"maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg\" (UID: \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"
Oct 31 00:43:22.376840 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.376822    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1fecfeb-15bf-4365-a76f-915eda6b56a0-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg\" (UID: \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"
Oct 31 00:43:22.377045 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.376882    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7bb2\" (UniqueName: \"kubernetes.io/projected/a1fecfeb-15bf-4365-a76f-915eda6b56a0-kube-api-access-t7bb2\") pod \"maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg\" (UID: \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"
Oct 31 00:43:22.377045 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.376911    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1fecfeb-15bf-4365-a76f-915eda6b56a0-maas-api-tls\") pod \"maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg\" (UID: \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"
Oct 31 00:43:22.377607 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.377583    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1fecfeb-15bf-4365-a76f-915eda6b56a0-openshift-service-ca\") pod \"maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg\" (UID: \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"
Oct 31 00:43:22.379320 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.379298    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1fecfeb-15bf-4365-a76f-915eda6b56a0-maas-api-tls\") pod \"maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg\" (UID: \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"
Oct 31 00:43:22.379414 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.379397    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1fecfeb-15bf-4365-a76f-915eda6b56a0-metrics-certs\") pod \"maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg\" (UID: \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"
Oct 31 00:43:22.419777 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.419747    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7bb2\" (UniqueName: \"kubernetes.io/projected/a1fecfeb-15bf-4365-a76f-915eda6b56a0-kube-api-access-t7bb2\") pod \"maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg\" (UID: \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"
Oct 31 00:43:22.439583 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.439559    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"
Oct 31 00:43:22.725398 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.725296    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt" event={"ID":"c6595fa5-8566-4e13-8d16-d818383d84d0","Type":"ContainerStarted","Data":"dcbad80e34184cef5d368fee9187eb12c55eeb96cda7a67633819cc8b83a0996"}
Oct 31 00:43:22.725857 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.725756    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"
Oct 31 00:43:22.725857 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.725795    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt" event={"ID":"c6595fa5-8566-4e13-8d16-d818383d84d0","Type":"ContainerStarted","Data":"f729301f8958ed51993d3b4269fc903f687271c9483e5d4f04ca7fef468b943d"}
Oct 31 00:43:22.725857 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.725827    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"]
Oct 31 00:43:22.729120 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:43:22.729091    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1fecfeb_15bf_4365_a76f_915eda6b56a0.slice/crio-014e1dbe730bf387609429c1d5fc9c27b9f5967acca9e71ec734bbc2f0ccd55d WatchSource:0}: Error finding container 014e1dbe730bf387609429c1d5fc9c27b9f5967acca9e71ec734bbc2f0ccd55d: Status 404 returned error can't find the container with id 014e1dbe730bf387609429c1d5fc9c27b9f5967acca9e71ec734bbc2f0ccd55d
Oct 31 00:43:22.764824 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:22.764755    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt" podStartSLOduration=1.368318709 podStartE2EDuration="1.76473295s" totalImagesPullingTime="396.414241ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:43:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:43:22.764096193 +0000 UTC m=+543.837136277" watchObservedRunningTime="2026-10-31 00:43:22.76473295 +0000 UTC m=+543.837773035"
Oct 31 00:43:23.732286 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:23.732244    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg" event={"ID":"a1fecfeb-15bf-4365-a76f-915eda6b56a0","Type":"ContainerStarted","Data":"6f789875da1d7e55213ee9e68b5caaf4a335f26994b1dfdf0a3e2b61f1d7ab2a"}
Oct 31 00:43:23.732676 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:23.732306    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg" event={"ID":"a1fecfeb-15bf-4365-a76f-915eda6b56a0","Type":"ContainerStarted","Data":"014e1dbe730bf387609429c1d5fc9c27b9f5967acca9e71ec734bbc2f0ccd55d"}
Oct 31 00:43:23.732676 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:23.732335    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"
Oct 31 00:43:23.764878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:23.764825    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg" podStartSLOduration=1.323579295 podStartE2EDuration="1.764810386s" totalImagesPullingTime="441.231091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:43:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:43:23.761373411 +0000 UTC m=+544.834413494" watchObservedRunningTime="2026-10-31 00:43:23.764810386 +0000 UTC m=+544.837850468"
Oct 31 00:43:24.628175 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:24.628136    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"]
Oct 31 00:43:24.632553 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:24.632531    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"
Oct 31 00:43:24.665430 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:24.665398    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-w3-1d4a7e-serving-cert\""
Oct 31 00:43:24.669016 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:24.668986    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"]
Oct 31 00:43:24.805494 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:24.805457    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53825390-1f0f-4b49-9e59-b224c39aaf62-maas-api-tls\") pod \"maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v\" (UID: \"53825390-1f0f-4b49-9e59-b224c39aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"
Oct 31 00:43:24.805959 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:24.805505    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53825390-1f0f-4b49-9e59-b224c39aaf62-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v\" (UID: \"53825390-1f0f-4b49-9e59-b224c39aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"
Oct 31 00:43:24.805959 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:24.805673    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53825390-1f0f-4b49-9e59-b224c39aaf62-metrics-certs\") pod \"maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v\" (UID: \"53825390-1f0f-4b49-9e59-b224c39aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"
Oct 31 00:43:24.805959 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:24.805780    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xffh7\" (UniqueName: \"kubernetes.io/projected/53825390-1f0f-4b49-9e59-b224c39aaf62-kube-api-access-xffh7\") pod \"maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v\" (UID: \"53825390-1f0f-4b49-9e59-b224c39aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"
Oct 31 00:43:24.906699 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:24.906609    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53825390-1f0f-4b49-9e59-b224c39aaf62-maas-api-tls\") pod \"maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v\" (UID: \"53825390-1f0f-4b49-9e59-b224c39aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"
Oct 31 00:43:24.906699 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:24.906657    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53825390-1f0f-4b49-9e59-b224c39aaf62-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v\" (UID: \"53825390-1f0f-4b49-9e59-b224c39aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"
Oct 31 00:43:24.906949 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:24.906756    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53825390-1f0f-4b49-9e59-b224c39aaf62-metrics-certs\") pod \"maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v\" (UID: \"53825390-1f0f-4b49-9e59-b224c39aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"
Oct 31 00:43:24.906949 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:24.906885    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xffh7\" (UniqueName: \"kubernetes.io/projected/53825390-1f0f-4b49-9e59-b224c39aaf62-kube-api-access-xffh7\") pod \"maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v\" (UID: \"53825390-1f0f-4b49-9e59-b224c39aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"
Oct 31 00:43:24.907557 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:24.907532    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53825390-1f0f-4b49-9e59-b224c39aaf62-openshift-service-ca\") pod \"maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v\" (UID: \"53825390-1f0f-4b49-9e59-b224c39aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"
Oct 31 00:43:24.908972 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:24.908952    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53825390-1f0f-4b49-9e59-b224c39aaf62-maas-api-tls\") pod \"maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v\" (UID: \"53825390-1f0f-4b49-9e59-b224c39aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"
Oct 31 00:43:24.909155 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:24.909138    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53825390-1f0f-4b49-9e59-b224c39aaf62-metrics-certs\") pod \"maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v\" (UID: \"53825390-1f0f-4b49-9e59-b224c39aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"
Oct 31 00:43:24.914693 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:24.914669    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xffh7\" (UniqueName: \"kubernetes.io/projected/53825390-1f0f-4b49-9e59-b224c39aaf62-kube-api-access-xffh7\") pod \"maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v\" (UID: \"53825390-1f0f-4b49-9e59-b224c39aaf62\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"
Oct 31 00:43:24.981383 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:24.981354    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"
Oct 31 00:43:25.280853 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:25.280825    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"]
Oct 31 00:43:25.282903 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:43:25.282873    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53825390_1f0f_4b49_9e59_b224c39aaf62.slice/crio-c26540d0b0c6205eccfb26f6a2ee3461d86379ddd66ad8a500c131e8820676ad WatchSource:0}: Error finding container c26540d0b0c6205eccfb26f6a2ee3461d86379ddd66ad8a500c131e8820676ad: Status 404 returned error can't find the container with id c26540d0b0c6205eccfb26f6a2ee3461d86379ddd66ad8a500c131e8820676ad
Oct 31 00:43:25.709169 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:25.709139    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"
Oct 31 00:43:25.774177 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:25.770451    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v" event={"ID":"53825390-1f0f-4b49-9e59-b224c39aaf62","Type":"ContainerStarted","Data":"c26540d0b0c6205eccfb26f6a2ee3461d86379ddd66ad8a500c131e8820676ad"}
Oct 31 00:43:26.410090 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:26.410045    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:43:26.716744 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:26.716665    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"
Oct 31 00:43:26.780589 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:26.780553    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v" event={"ID":"53825390-1f0f-4b49-9e59-b224c39aaf62","Type":"ContainerStarted","Data":"b7768b3387c9a38ad19fe664438ec76a89b12ccf5c41f6ce577840ea341ba44a"}
Oct 31 00:43:26.781322 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:26.781279    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"
Oct 31 00:43:26.801844 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:26.801800    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v" podStartSLOduration=2.274802928 podStartE2EDuration="2.801787019s" totalImagesPullingTime="526.984091ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:43:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:43:26.800377863 +0000 UTC m=+547.873417946" watchObservedRunningTime="2026-10-31 00:43:26.801787019 +0000 UTC m=+547.874827133"
Oct 31 00:43:29.789290 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:29.786919    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"
Oct 31 00:43:29.789290 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:29.787117    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"
Oct 31 00:43:31.704632 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:31.704332    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:43:31.704632 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:31.704385    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm" podUID="294716ae-2b4b-48e2-bec4-e84bcac470b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:43:32.730012 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:32.729427    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb"
Oct 31 00:43:32.731612 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:32.731590    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf"
Oct 31 00:43:32.808753 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:32.808718    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:43:32.809081 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:32.809064    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"
Oct 31 00:43:34.845212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:34.845177    5946 generic.go:356] "Generic (PLEG): container finished" podID="294716ae-2b4b-48e2-bec4-e84bcac470b4" containerID="06de6cd8b0f1ee69cbfd1def8f44cc3bca7c462308d1f5d7eabc2b296df250de" exitCode=0
Oct 31 00:43:34.845686 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:34.845410    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm" event={"ID":"294716ae-2b4b-48e2-bec4-e84bcac470b4","Type":"ContainerDied","Data":"06de6cd8b0f1ee69cbfd1def8f44cc3bca7c462308d1f5d7eabc2b296df250de"}
Oct 31 00:43:34.845973 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:34.845953    5946 scope.go:122] "RemoveContainer" containerID="06de6cd8b0f1ee69cbfd1def8f44cc3bca7c462308d1f5d7eabc2b296df250de"
Oct 31 00:43:34.847668 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:34.847635    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:43:34.847804 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:34.847728    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:43:34.847804 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:34.847779    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:43:35.866934 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:35.866894    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm" event={"ID":"294716ae-2b4b-48e2-bec4-e84bcac470b4","Type":"ContainerStarted","Data":"bf48909405741b26bbb8fcdffb6ebb73422ae1cb4aaf8584f7dbc97b6ad8f93d"}
Oct 31 00:43:36.859108 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:36.858647    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:36.859108 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:36.858782    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Oct 31 00:43:36.859108 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:36.858825    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm" podUID="294716ae-2b4b-48e2-bec4-e84bcac470b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Oct 31 00:43:37.856414 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:37.855638    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Oct 31 00:43:37.856414 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:37.855748    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm" podUID="294716ae-2b4b-48e2-bec4-e84bcac470b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Oct 31 00:43:37.888865 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:37.888826    5946 generic.go:356] "Generic (PLEG): container finished" podID="fc8f1228-2303-4afe-a4cc-831825f95a18" containerID="fe0f7ab6cf3e10f7e6db3c44cf3db3c47bcd218197688fa0f555ca6717c0cf68" exitCode=0
Oct 31 00:43:37.889031 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:37.888915    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg" event={"ID":"fc8f1228-2303-4afe-a4cc-831825f95a18","Type":"ContainerDied","Data":"fe0f7ab6cf3e10f7e6db3c44cf3db3c47bcd218197688fa0f555ca6717c0cf68"}
Oct 31 00:43:37.889544 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:37.889525    5946 scope.go:122] "RemoveContainer" containerID="fe0f7ab6cf3e10f7e6db3c44cf3db3c47bcd218197688fa0f555ca6717c0cf68"
Oct 31 00:43:37.891245 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:37.891198    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:43:37.891331 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:37.891306    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:43:37.891380 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:37.891354    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:43:38.856049 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:38.855604    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Oct 31 00:43:38.856049 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:38.855666    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm" podUID="294716ae-2b4b-48e2-bec4-e84bcac470b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Oct 31 00:43:38.898971 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:38.898916    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg" event={"ID":"fc8f1228-2303-4afe-a4cc-831825f95a18","Type":"ContainerStarted","Data":"22bf527a018d1251e033e9c23c20277999449820abba0a1847bde10fdb6c20de"}
Oct 31 00:43:38.901396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:38.901372    5946 generic.go:356] "Generic (PLEG): container finished" podID="6990c602-9395-451f-ae35-8a351c5aacf7" containerID="0e44cdabb93cf120d5932387bdd5de6e1323abcabd26043ccd7f9a2f286d3d9e" exitCode=0
Oct 31 00:43:38.901506 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:38.901410    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m" event={"ID":"6990c602-9395-451f-ae35-8a351c5aacf7","Type":"ContainerDied","Data":"0e44cdabb93cf120d5932387bdd5de6e1323abcabd26043ccd7f9a2f286d3d9e"}
Oct 31 00:43:38.901716 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:38.901703    5946 scope.go:122] "RemoveContainer" containerID="0e44cdabb93cf120d5932387bdd5de6e1323abcabd26043ccd7f9a2f286d3d9e"
Oct 31 00:43:38.902989 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:38.902960    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:43:38.903045 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:38.903032    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:43:38.903093 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:38.903082    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:43:39.586793 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:39.586752    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:39.587202 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:39.587179    5946 patch_prober.go:29] interesting pod/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Oct 31 00:43:39.587417 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:39.587383    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg" podUID="fc8f1228-2303-4afe-a4cc-831825f95a18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Oct 31 00:43:39.862296 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:39.861602    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Oct 31 00:43:39.862296 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:39.861662    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm" podUID="294716ae-2b4b-48e2-bec4-e84bcac470b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Oct 31 00:43:39.921245 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:39.918516    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m" event={"ID":"6990c602-9395-451f-ae35-8a351c5aacf7","Type":"ContainerStarted","Data":"ea44a86b2c07bb290dbeb148c7fb19617764d9fb36037e9d9c1fe7b51da65d59"}
Oct 31 00:43:39.962243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:39.959294    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:40.595246 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:40.594833    5946 patch_prober.go:29] interesting pod/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Oct 31 00:43:40.606247 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:40.595455    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg" podUID="fc8f1228-2303-4afe-a4cc-831825f95a18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Oct 31 00:43:40.856778 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:40.856680    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Oct 31 00:43:40.857037 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:40.857006    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm" podUID="294716ae-2b4b-48e2-bec4-e84bcac470b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Oct 31 00:43:40.963240 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:40.953135    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Oct 31 00:43:40.963240 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:40.953207    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m" podUID="6990c602-9395-451f-ae35-8a351c5aacf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Oct 31 00:43:41.415869 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:43:41.415830    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:43:41.589661 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:41.589622    5946 patch_prober.go:29] interesting pod/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Oct 31 00:43:41.589952 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:41.589919    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg" podUID="fc8f1228-2303-4afe-a4cc-831825f95a18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Oct 31 00:43:41.958246 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:41.957963    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Oct 31 00:43:41.958246 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:41.958030    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m" podUID="6990c602-9395-451f-ae35-8a351c5aacf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Oct 31 00:43:42.056250 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:42.047647    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:42.056250 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:42.049480    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:42.070243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:42.068594    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:43:42.587047 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:42.586600    5946 patch_prober.go:29] interesting pod/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Oct 31 00:43:42.587047 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:42.586664    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg" podUID="fc8f1228-2303-4afe-a4cc-831825f95a18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Oct 31 00:43:42.955299 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:42.954648    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Oct 31 00:43:42.955299 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:42.954722    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m" podUID="6990c602-9395-451f-ae35-8a351c5aacf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Oct 31 00:43:43.586915 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:43.586876    5946 patch_prober.go:29] interesting pod/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Oct 31 00:43:43.587562 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:43.587518    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg" podUID="fc8f1228-2303-4afe-a4cc-831825f95a18" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Oct 31 00:43:43.970623 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:43.970528    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Oct 31 00:43:43.972029 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:43.971996    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m" podUID="6990c602-9395-451f-ae35-8a351c5aacf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Oct 31 00:43:44.619424 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:44.619390    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:44.620523 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:44.620499    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:44.621236 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:44.621200    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:43:44.957297 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:44.956541    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body=
Oct 31 00:43:44.957297 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:44.956605    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m" podUID="6990c602-9395-451f-ae35-8a351c5aacf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused"
Oct 31 00:43:45.649996 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:45.649962    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:45.970650 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:45.970564    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:45.986843 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:45.986821    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:43:46.240269 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:46.240153    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:43:59.916441 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:43:59.916402    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:44:11.382425 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:44:11.382388    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:44:12.525980 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.525942    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"]
Oct 31 00:44:12.530591 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.530566    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.544536 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.544513    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w6-47f370-openshift-default-dockercfg-bxkmf\""
Oct 31 00:44:12.545058 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.544987    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"]
Oct 31 00:44:12.593203 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.593162    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-credential-socket\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.593513 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.593211    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-data\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.593513 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.593368    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-workload-certs\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.593513 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.593402    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-envoy\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.593513 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.593456    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b097de73-6eef-4c19-88b4-77315c8b84fe-istiod-ca-cert\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.593842 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.593528    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-workload-socket\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.593842 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.593630    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgwlf\" (UniqueName: \"kubernetes.io/projected/b097de73-6eef-4c19-88b4-77315c8b84fe-kube-api-access-lgwlf\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.593842 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.593702    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-token\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.593842 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.593794    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-podinfo\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.694486 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.694451    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-workload-certs\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.694486 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.694494    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-envoy\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.694747 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.694529    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b097de73-6eef-4c19-88b4-77315c8b84fe-istiod-ca-cert\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.694747 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.694558    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-workload-socket\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.694747 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.694581    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgwlf\" (UniqueName: \"kubernetes.io/projected/b097de73-6eef-4c19-88b4-77315c8b84fe-kube-api-access-lgwlf\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.694747 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.694601    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-token\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.694747 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.694648    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-podinfo\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.694747 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.694737    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-credential-socket\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.695018 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.694769    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-data\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.695521 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.695490    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-data\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.699733 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.695654    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-workload-socket\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.699733 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.695630    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-workload-certs\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.699733 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.695722    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-credential-socket\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.699733 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.696093    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b097de73-6eef-4c19-88b4-77315c8b84fe-istiod-ca-cert\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.699733 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.698069    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-envoy\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.699733 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.699578    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-podinfo\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.708705 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.708295    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-token\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.713891 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.712416    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgwlf\" (UniqueName: \"kubernetes.io/projected/b097de73-6eef-4c19-88b4-77315c8b84fe-kube-api-access-lgwlf\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:12.848822 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:12.848785    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:13.129211 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:13.129188    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"]
Oct 31 00:44:13.131324 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:44:13.131296    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb097de73_6eef_4c19_88b4_77315c8b84fe.slice/crio-68dabb908f692bf307add105f13851d2c1d498a2ba7805227388ef0df3837a74 WatchSource:0}: Error finding container 68dabb908f692bf307add105f13851d2c1d498a2ba7805227388ef0df3837a74: Status 404 returned error can't find the container with id 68dabb908f692bf307add105f13851d2c1d498a2ba7805227388ef0df3837a74
Oct 31 00:44:13.133926 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:13.133890    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:44:13.134021 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:13.133978    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:44:13.134068 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:13.134028    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:44:13.156772 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:13.156744    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk" event={"ID":"b097de73-6eef-4c19-88b4-77315c8b84fe","Type":"ContainerStarted","Data":"68dabb908f692bf307add105f13851d2c1d498a2ba7805227388ef0df3837a74"}
Oct 31 00:44:14.168461 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:14.168417    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk" event={"ID":"b097de73-6eef-4c19-88b4-77315c8b84fe","Type":"ContainerStarted","Data":"d4eea465542207f8da50edf8407a50b474a159d02b1fad319f88ef743d6285af"}
Oct 31 00:44:14.191204 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:14.191147    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk" podStartSLOduration=2.19113316 podStartE2EDuration="2.19113316s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:44:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:44:14.189095007 +0000 UTC m=+595.262135090" watchObservedRunningTime="2026-10-31 00:44:14.19113316 +0000 UTC m=+595.264173243"
Oct 31 00:44:14.459384 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:14.457929    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:44:14.849659 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:14.849589    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:14.861401 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:14.861364    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 31 00:44:14.861670 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:14.861642    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk" podUID="b097de73-6eef-4c19-88b4-77315c8b84fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 31 00:44:15.861244 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:15.857654    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 31 00:44:15.861244 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:15.857721    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk" podUID="b097de73-6eef-4c19-88b4-77315c8b84fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 31 00:44:16.852548 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:16.852512    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 31 00:44:16.852840 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:16.852813    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk" podUID="b097de73-6eef-4c19-88b4-77315c8b84fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 31 00:44:17.078736 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.078709    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"]
Oct 31 00:44:17.082825 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.082804    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"]
Oct 31 00:44:17.082946 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.082880    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.093784 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.093741    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-47f370\"/\"kube-root-ca.crt\""
Oct 31 00:44:17.094420 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.094399    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w6-47f370\"/\"openshift-service-ca.crt\""
Oct 31 00:44:17.094570 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.094433    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-47f370\"/\"default-dockercfg-42hms\""
Oct 31 00:44:17.094678 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.094519    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-47f370\"/\"premium-w6-47f370-kserve-self-signed-certs\""
Oct 31 00:44:17.168352 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.168235    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-tmp-dir\") pod \"premium-w6-47f370-kserve-765b8c7947-v4db2\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") " pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.168352 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.168312    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72261b04-1609-4f79-9729-f918b643b0df-tls-certs\") pod \"premium-w6-47f370-kserve-765b8c7947-v4db2\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") " pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.168352 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.168342    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-home\") pod \"premium-w6-47f370-kserve-765b8c7947-v4db2\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") " pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.168689 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.168510    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njmqx\" (UniqueName: \"kubernetes.io/projected/72261b04-1609-4f79-9729-f918b643b0df-kube-api-access-njmqx\") pod \"premium-w6-47f370-kserve-765b8c7947-v4db2\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") " pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.169404 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.169375    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-dshm\") pod \"premium-w6-47f370-kserve-765b8c7947-v4db2\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") " pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.169608 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.169590    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-model-cache\") pod \"premium-w6-47f370-kserve-765b8c7947-v4db2\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") " pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.271066 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.271030    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72261b04-1609-4f79-9729-f918b643b0df-tls-certs\") pod \"premium-w6-47f370-kserve-765b8c7947-v4db2\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") " pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.271066 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.271071    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-home\") pod \"premium-w6-47f370-kserve-765b8c7947-v4db2\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") " pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.271375 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.271169    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njmqx\" (UniqueName: \"kubernetes.io/projected/72261b04-1609-4f79-9729-f918b643b0df-kube-api-access-njmqx\") pod \"premium-w6-47f370-kserve-765b8c7947-v4db2\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") " pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.271375 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.271196    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-dshm\") pod \"premium-w6-47f370-kserve-765b8c7947-v4db2\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") " pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.271375 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.271251    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-model-cache\") pod \"premium-w6-47f370-kserve-765b8c7947-v4db2\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") " pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.271375 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.271298    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-tmp-dir\") pod \"premium-w6-47f370-kserve-765b8c7947-v4db2\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") " pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.271776 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.271753    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-tmp-dir\") pod \"premium-w6-47f370-kserve-765b8c7947-v4db2\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") " pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.271904 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.271782    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-model-cache\") pod \"premium-w6-47f370-kserve-765b8c7947-v4db2\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") " pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.271904 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.271842    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-home\") pod \"premium-w6-47f370-kserve-765b8c7947-v4db2\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") " pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.274017 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.273991    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-dshm\") pod \"premium-w6-47f370-kserve-765b8c7947-v4db2\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") " pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.274489 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.274469    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72261b04-1609-4f79-9729-f918b643b0df-tls-certs\") pod \"premium-w6-47f370-kserve-765b8c7947-v4db2\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") " pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.279794 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.279770    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njmqx\" (UniqueName: \"kubernetes.io/projected/72261b04-1609-4f79-9729-f918b643b0df-kube-api-access-njmqx\") pod \"premium-w6-47f370-kserve-765b8c7947-v4db2\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") " pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.402814 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.402772    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:17.707514 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.707485    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"]
Oct 31 00:44:17.709323 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:44:17.709289    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72261b04_1609_4f79_9729_f918b643b0df.slice/crio-75ea64b10d52877f10ef074844bc6ef9007ef7c040b049df558e1a3250f51a49 WatchSource:0}: Error finding container 75ea64b10d52877f10ef074844bc6ef9007ef7c040b049df558e1a3250f51a49: Status 404 returned error can't find the container with id 75ea64b10d52877f10ef074844bc6ef9007ef7c040b049df558e1a3250f51a49
Oct 31 00:44:17.856163 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.855697    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 31 00:44:17.856163 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:17.855771    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk" podUID="b097de73-6eef-4c19-88b4-77315c8b84fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 31 00:44:18.201200 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:18.200969    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2" event={"ID":"72261b04-1609-4f79-9729-f918b643b0df","Type":"ContainerStarted","Data":"9504a75200c28ef01914e872cc5c1e6cfdee26a6befbdfd49012df87dfbdd64a"}
Oct 31 00:44:18.201200 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:18.201017    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2" event={"ID":"72261b04-1609-4f79-9729-f918b643b0df","Type":"ContainerStarted","Data":"75ea64b10d52877f10ef074844bc6ef9007ef7c040b049df558e1a3250f51a49"}
Oct 31 00:44:18.219443 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:18.219391    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2" podStartSLOduration=1.219372978 podStartE2EDuration="1.219372978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:44:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:44:18.218654481 +0000 UTC m=+599.291694565" watchObservedRunningTime="2026-10-31 00:44:18.219372978 +0000 UTC m=+599.292413057"
Oct 31 00:44:18.403443 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:18.403409    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:18.853243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:18.853163    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body=
Oct 31 00:44:18.853453 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:18.853389    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk" podUID="b097de73-6eef-4c19-88b4-77315c8b84fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused"
Oct 31 00:44:19.854077 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:19.854045    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:19.854564 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:19.854542    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:19.855260 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:19.855241    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:44:27.403290 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.403252    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:27.415551 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.415528    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:27.867516 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.867483    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"]
Oct 31 00:44:27.873209 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.873185    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.882427 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.882398    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w3-1d4a7e-openshift-default-dockercfg-sn4k2\""
Oct 31 00:44:27.890720 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.890691    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"]
Oct 31 00:44:27.896961 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.896933    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-credential-socket\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.897110 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.897011    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-podinfo\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.897177 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.897121    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-data\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.897269 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.897172    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-workload-certs\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.897388 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.897363    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-token\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.897449 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.897424    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssxsc\" (UniqueName: \"kubernetes.io/projected/fafaee93-015a-4a0b-bee3-115fc381d2e8-kube-api-access-ssxsc\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.897530 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.897514    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-envoy\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.897597 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.897547    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-workload-socket\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.897597 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.897574    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fafaee93-015a-4a0b-bee3-115fc381d2e8-istiod-ca-cert\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.998729 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.998696    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-credential-socket\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.998939 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.998764    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-podinfo\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.998939 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.998791    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-data\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.998939 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.998814    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-workload-certs\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.998939 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.998868    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-token\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.998939 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.998902    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssxsc\" (UniqueName: \"kubernetes.io/projected/fafaee93-015a-4a0b-bee3-115fc381d2e8-kube-api-access-ssxsc\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.999244 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.998954    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-envoy\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.999244 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.998996    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-workload-socket\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.999244 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.999020    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fafaee93-015a-4a0b-bee3-115fc381d2e8-istiod-ca-cert\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.999244 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.999199    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-credential-socket\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.999528 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.999508    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-workload-certs\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.999595 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.999544    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-data\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.999653 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.999608    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-workload-socket\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:27.999846 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:27.999829    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fafaee93-015a-4a0b-bee3-115fc381d2e8-istiod-ca-cert\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:28.001340 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:28.001312    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-envoy\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:28.001551 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:28.001536    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-podinfo\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:28.007748 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:28.007726    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssxsc\" (UniqueName: \"kubernetes.io/projected/fafaee93-015a-4a0b-bee3-115fc381d2e8-kube-api-access-ssxsc\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:28.007979 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:28.007961    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-token\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:28.189584 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:28.189509    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:28.276508 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:28.276474    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:44:28.474058 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:28.474030    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"]
Oct 31 00:44:28.475792 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:44:28.475766    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfafaee93_015a_4a0b_bee3_115fc381d2e8.slice/crio-9993f661078b41883a9d70d0e01ed228eed03ff8796b230912b84de6e412b0f5 WatchSource:0}: Error finding container 9993f661078b41883a9d70d0e01ed228eed03ff8796b230912b84de6e412b0f5: Status 404 returned error can't find the container with id 9993f661078b41883a9d70d0e01ed228eed03ff8796b230912b84de6e412b0f5
Oct 31 00:44:28.478462 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:28.478433    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:44:28.478528 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:28.478498    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:44:28.478528 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:28.478522    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:44:29.272769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:29.272723    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km" event={"ID":"fafaee93-015a-4a0b-bee3-115fc381d2e8","Type":"ContainerStarted","Data":"b9a5e8793578da590fc30f213581907708737d419356264f586eea61a6e727aa"}
Oct 31 00:44:29.272993 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:29.272804    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km" event={"ID":"fafaee93-015a-4a0b-bee3-115fc381d2e8","Type":"ContainerStarted","Data":"9993f661078b41883a9d70d0e01ed228eed03ff8796b230912b84de6e412b0f5"}
Oct 31 00:44:29.297679 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:29.297630    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km" podStartSLOduration=2.297615585 podStartE2EDuration="2.297615585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:44:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:44:29.294852968 +0000 UTC m=+610.367893051" watchObservedRunningTime="2026-10-31 00:44:29.297615585 +0000 UTC m=+610.370655666"
Oct 31 00:44:30.190755 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:30.190726    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:30.192273 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:30.192249    5946 patch_prober.go:29] interesting pod/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 31 00:44:30.192402 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:30.192297    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km" podUID="fafaee93-015a-4a0b-bee3-115fc381d2e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 31 00:44:31.190174 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:31.190142    5946 patch_prober.go:29] interesting pod/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 31 00:44:31.190343 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:31.190194    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km" podUID="fafaee93-015a-4a0b-bee3-115fc381d2e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 31 00:44:32.190614 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:32.190581    5946 patch_prober.go:29] interesting pod/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 31 00:44:32.191011 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:32.190630    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km" podUID="fafaee93-015a-4a0b-bee3-115fc381d2e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 31 00:44:33.190593 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:33.190557    5946 patch_prober.go:29] interesting pod/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 31 00:44:33.190806 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:33.190626    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km" podUID="fafaee93-015a-4a0b-bee3-115fc381d2e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 31 00:44:33.198760 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:33.198730    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:44:34.190505 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:34.190469    5946 patch_prober.go:29] interesting pod/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body=
Oct 31 00:44:34.190736 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:34.190533    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km" podUID="fafaee93-015a-4a0b-bee3-115fc381d2e8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused"
Oct 31 00:44:35.249310 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:35.249278    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:35.249825 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:35.249559    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:35.250419 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:35.250401    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:44:41.380946 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:44:41.380908    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:44:42.598367 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.598326    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"]
Oct 31 00:44:42.602792 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.602772    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.612666 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.612645    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w2-b433e6-openshift-default-dockercfg-72t9t\""
Oct 31 00:44:42.621979 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.621940    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"]
Oct 31 00:44:42.695385 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.695350    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-credential-socket\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.695560 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.695398    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-istio-envoy\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.695560 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.695428    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-workload-socket\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.695560 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.695499    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d477e0c1-fc81-4087-a694-3a2e41433050-istiod-ca-cert\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.695682 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.695620    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-workload-certs\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.695782 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.695761    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d477e0c1-fc81-4087-a694-3a2e41433050-istio-podinfo\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.695825 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.695800    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-istio-data\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.695880 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.695826    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4vt8\" (UniqueName: \"kubernetes.io/projected/d477e0c1-fc81-4087-a694-3a2e41433050-kube-api-access-r4vt8\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.695963 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.695946    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d477e0c1-fc81-4087-a694-3a2e41433050-istio-token\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.797041 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.797009    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d477e0c1-fc81-4087-a694-3a2e41433050-istio-token\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.797246 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.797095    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-credential-socket\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.797246 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.797129    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-istio-envoy\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.797246 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.797157    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-workload-socket\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.797246 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.797192    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d477e0c1-fc81-4087-a694-3a2e41433050-istiod-ca-cert\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.797488 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.797260    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-workload-certs\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.797488 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.797363    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d477e0c1-fc81-4087-a694-3a2e41433050-istio-podinfo\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.797488 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.797396    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-istio-data\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.797488 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.797421    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4vt8\" (UniqueName: \"kubernetes.io/projected/d477e0c1-fc81-4087-a694-3a2e41433050-kube-api-access-r4vt8\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.797685 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.797576    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-credential-socket\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.797935 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.797907    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d477e0c1-fc81-4087-a694-3a2e41433050-istiod-ca-cert\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.798311 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.798289    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-workload-socket\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.798393 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.798316    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-workload-certs\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.798556 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.798535    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-istio-data\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.799817 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.799794    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-istio-envoy\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.801465 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.801446    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d477e0c1-fc81-4087-a694-3a2e41433050-istio-podinfo\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.811371 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.811346    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4vt8\" (UniqueName: \"kubernetes.io/projected/d477e0c1-fc81-4087-a694-3a2e41433050-kube-api-access-r4vt8\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.812791 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.812770    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d477e0c1-fc81-4087-a694-3a2e41433050-istio-token\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:42.917208 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:42.917125    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:43.232977 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:43.232942    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"]
Oct 31 00:44:43.234996 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:44:43.234971    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd477e0c1_fc81_4087_a694_3a2e41433050.slice/crio-8ef10ccbc27e248587dda390fe3188101000788ce071264722db188d01cfeba8 WatchSource:0}: Error finding container 8ef10ccbc27e248587dda390fe3188101000788ce071264722db188d01cfeba8: Status 404 returned error can't find the container with id 8ef10ccbc27e248587dda390fe3188101000788ce071264722db188d01cfeba8
Oct 31 00:44:43.237536 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:43.237508    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:44:43.237598 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:43.237573    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:44:43.237631 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:43.237606    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:44:43.360297 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:43.360254    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4" event={"ID":"d477e0c1-fc81-4087-a694-3a2e41433050","Type":"ContainerStarted","Data":"eede84a6cba49b580c460ba0e4cedb013881c8700c2a8415f0a3a1a9a38e3c2a"}
Oct 31 00:44:43.360488 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:43.360316    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4" event={"ID":"d477e0c1-fc81-4087-a694-3a2e41433050","Type":"ContainerStarted","Data":"8ef10ccbc27e248587dda390fe3188101000788ce071264722db188d01cfeba8"}
Oct 31 00:44:43.381163 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:43.381114    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4" podStartSLOduration=1.381099235 podStartE2EDuration="1.381099235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:44:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:44:43.37996104 +0000 UTC m=+624.453001123" watchObservedRunningTime="2026-10-31 00:44:43.381099235 +0000 UTC m=+624.454139317"
Oct 31 00:44:43.918241 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:43.918175    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:44.920075 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:44.920039    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 31 00:44:44.920597 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:44.920097    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4" podUID="d477e0c1-fc81-4087-a694-3a2e41433050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 31 00:44:45.917832 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:45.917800    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 31 00:44:45.918013 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:45.917849    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4" podUID="d477e0c1-fc81-4087-a694-3a2e41433050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 31 00:44:46.918380 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:46.918345    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 31 00:44:46.918781 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:46.918399    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4" podUID="d477e0c1-fc81-4087-a694-3a2e41433050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 31 00:44:47.918212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:47.918177    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 31 00:44:47.918408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:47.918276    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4" podUID="d477e0c1-fc81-4087-a694-3a2e41433050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 31 00:44:48.917478 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:48.917443    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Oct 31 00:44:48.917640 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:48.917524    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4" podUID="d477e0c1-fc81-4087-a694-3a2e41433050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Oct 31 00:44:50.808721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:50.808658    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:50.809940 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:50.809917    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:50.810777 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:50.810754    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:44:57.956694 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:57.956659    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"]
Oct 31 00:44:57.962075 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:57.962055    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:57.971868 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:57.971844    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-f99ac0-openshift-default-dockercfg-5jrvn\""
Oct 31 00:44:57.974436 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:57.974410    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"]
Oct 31 00:44:58.067704 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.067667    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-data\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.067878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.067718    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-token\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.067878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.067804    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-workload-certs\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.067878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.067827    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcw99\" (UniqueName: \"kubernetes.io/projected/6f1f21c9-c572-4c8c-8368-ff74ff058804-kube-api-access-pcw99\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.068058 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.068030    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-envoy\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.068134 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.068120    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-credential-socket\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.068182 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.068156    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-workload-socket\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.068182 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.068172    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-podinfo\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.068320 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.068302    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1f21c9-c572-4c8c-8368-ff74ff058804-istiod-ca-cert\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.169469 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.169434    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-envoy\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.169661 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.169486    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-credential-socket\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.169661 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.169614    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-workload-socket\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.169661 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.169645    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-podinfo\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.169836 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.169708    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1f21c9-c572-4c8c-8368-ff74ff058804-istiod-ca-cert\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.169836 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.169776    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-data\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.169836 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.169816    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-token\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.170045 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.169862    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-workload-certs\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.170045 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.169882    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-credential-socket\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.170045 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.169892    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcw99\" (UniqueName: \"kubernetes.io/projected/6f1f21c9-c572-4c8c-8368-ff74ff058804-kube-api-access-pcw99\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.170045 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.169978    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-workload-socket\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.170289 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.170202    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-data\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.170344 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.170304    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-workload-certs\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.170754 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.170725    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1f21c9-c572-4c8c-8368-ff74ff058804-istiod-ca-cert\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.171929 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.171908    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-envoy\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.172475 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.172452    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-podinfo\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.179425 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.179402    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcw99\" (UniqueName: \"kubernetes.io/projected/6f1f21c9-c572-4c8c-8368-ff74ff058804-kube-api-access-pcw99\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.179836 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.179815    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-token\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.277536 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.277442    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:44:58.583406 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.583378    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"]
Oct 31 00:44:58.585363 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:44:58.585334    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1f21c9_c572_4c8c_8368_ff74ff058804.slice/crio-4ce86b484132b6905a2385bee2794db676645f030766f0a12463800d8122826e WatchSource:0}: Error finding container 4ce86b484132b6905a2385bee2794db676645f030766f0a12463800d8122826e: Status 404 returned error can't find the container with id 4ce86b484132b6905a2385bee2794db676645f030766f0a12463800d8122826e
Oct 31 00:44:58.588330 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.588291    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:44:58.588443 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.588367    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:44:58.588443 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:58.588399    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:44:59.466948 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:59.466913    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g" event={"ID":"6f1f21c9-c572-4c8c-8368-ff74ff058804","Type":"ContainerStarted","Data":"db69b4af81ea7046eae4af262c1dbc6014ffa6d0b5e787d7b5c72ca0128bae79"}
Oct 31 00:44:59.467392 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:59.466978    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g" event={"ID":"6f1f21c9-c572-4c8c-8368-ff74ff058804","Type":"ContainerStarted","Data":"4ce86b484132b6905a2385bee2794db676645f030766f0a12463800d8122826e"}
Oct 31 00:44:59.493595 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:44:59.493547    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g" podStartSLOduration=2.493533713 podStartE2EDuration="2.493533713s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:44:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:44:59.490339458 +0000 UTC m=+640.563379578" watchObservedRunningTime="2026-10-31 00:44:59.493533713 +0000 UTC m=+640.566573828"
Oct 31 00:45:00.098997 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:00.098960    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:45:00.278165 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:00.278132    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:45:00.279340 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:00.279306    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 31 00:45:00.279479 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:00.279363    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g" podUID="6f1f21c9-c572-4c8c-8368-ff74ff058804" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 31 00:45:01.278712 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:01.278676    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 31 00:45:01.279078 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:01.278729    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g" podUID="6f1f21c9-c572-4c8c-8368-ff74ff058804" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 31 00:45:02.278655 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:02.278617    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 31 00:45:02.278836 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:02.278675    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g" podUID="6f1f21c9-c572-4c8c-8368-ff74ff058804" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 31 00:45:03.278846 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:03.278812    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 31 00:45:03.279304 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:03.278870    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g" podUID="6f1f21c9-c572-4c8c-8368-ff74ff058804" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 31 00:45:04.278299 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:04.278256    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Oct 31 00:45:04.278486 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:04.278309    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g" podUID="6f1f21c9-c572-4c8c-8368-ff74ff058804" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Oct 31 00:45:06.253679 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:06.253648    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:45:06.255411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:06.255378    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:45:06.255981 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:06.255957    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:45:11.415130 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:45:11.415083    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:45:16.884636 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:16.884602    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk"]
Oct 31 00:45:16.889131 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:16.889111    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk"
Oct 31 00:45:16.897809 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:16.897789    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"opendatahub-ca\""
Oct 31 00:45:16.897978 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:16.897876    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-slc7v\""
Oct 31 00:45:16.899989 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:16.899968    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk"]
Oct 31 00:45:16.945790 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:16.945756    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bb38541e-5383-4f91-a21e-27b83c11b0b9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-655741d9-767xk\" (UID: \"bb38541e-5383-4f91-a21e-27b83c11b0b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk"
Oct 31 00:45:16.945960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:16.945889    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4f2j\" (UniqueName: \"kubernetes.io/projected/bb38541e-5383-4f91-a21e-27b83c11b0b9-kube-api-access-x4f2j\") pod \"maas-api-revoke-sub-655741d9-767xk\" (UID: \"bb38541e-5383-4f91-a21e-27b83c11b0b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk"
Oct 31 00:45:16.945960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:16.945926    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bb38541e-5383-4f91-a21e-27b83c11b0b9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-655741d9-767xk\" (UID: \"bb38541e-5383-4f91-a21e-27b83c11b0b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk"
Oct 31 00:45:17.047283 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:17.047245    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4f2j\" (UniqueName: \"kubernetes.io/projected/bb38541e-5383-4f91-a21e-27b83c11b0b9-kube-api-access-x4f2j\") pod \"maas-api-revoke-sub-655741d9-767xk\" (UID: \"bb38541e-5383-4f91-a21e-27b83c11b0b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk"
Oct 31 00:45:17.047283 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:17.047287    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bb38541e-5383-4f91-a21e-27b83c11b0b9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-655741d9-767xk\" (UID: \"bb38541e-5383-4f91-a21e-27b83c11b0b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk"
Oct 31 00:45:17.047516 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:17.047405    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bb38541e-5383-4f91-a21e-27b83c11b0b9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-655741d9-767xk\" (UID: \"bb38541e-5383-4f91-a21e-27b83c11b0b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk"
Oct 31 00:45:17.048087 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:17.048065    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bb38541e-5383-4f91-a21e-27b83c11b0b9-maas-api-openshift-ca\") pod \"maas-api-revoke-sub-655741d9-767xk\" (UID: \"bb38541e-5383-4f91-a21e-27b83c11b0b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk"
Oct 31 00:45:17.049803 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:17.049779    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bb38541e-5383-4f91-a21e-27b83c11b0b9-maas-api-xks-ca\") pod \"maas-api-revoke-sub-655741d9-767xk\" (UID: \"bb38541e-5383-4f91-a21e-27b83c11b0b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk"
Oct 31 00:45:17.056926 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:17.056903    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4f2j\" (UniqueName: \"kubernetes.io/projected/bb38541e-5383-4f91-a21e-27b83c11b0b9-kube-api-access-x4f2j\") pod \"maas-api-revoke-sub-655741d9-767xk\" (UID: \"bb38541e-5383-4f91-a21e-27b83c11b0b9\") " pod="odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk"
Oct 31 00:45:17.204821 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:17.204729    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk"
Oct 31 00:45:17.490602 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:17.490573    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk"]
Oct 31 00:45:17.493254 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:45:17.493198    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb38541e_5383_4f91_a21e_27b83c11b0b9.slice/crio-d0e624c2d7c86ea4728ad2e05fcb3434bb57c59f6b60cc200b3d93e9e3d5c346 WatchSource:0}: Error finding container d0e624c2d7c86ea4728ad2e05fcb3434bb57c59f6b60cc200b3d93e9e3d5c346: Status 404 returned error can't find the container with id d0e624c2d7c86ea4728ad2e05fcb3434bb57c59f6b60cc200b3d93e9e3d5c346
Oct 31 00:45:17.495540 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:17.495520    5946 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:45:17.587456 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:17.587424    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk" event={"ID":"bb38541e-5383-4f91-a21e-27b83c11b0b9","Type":"ContainerStarted","Data":"d0e624c2d7c86ea4728ad2e05fcb3434bb57c59f6b60cc200b3d93e9e3d5c346"}
Oct 31 00:45:20.607832 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:20.607791    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk" event={"ID":"bb38541e-5383-4f91-a21e-27b83c11b0b9","Type":"ContainerStarted","Data":"879bc2c1751168c8d87189215f18960db5276a429304cb550016ce08c53c3c50"}
Oct 31 00:45:20.627690 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:20.627628    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk" podStartSLOduration=1.831685479 podStartE2EDuration="4.62760831s" totalImagesPullingTime="2.795922831s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:45:20.625711844 +0000 UTC m=+661.698751926" watchObservedRunningTime="2026-10-31 00:45:20.62760831 +0000 UTC m=+661.700648392"
Oct 31 00:45:21.615121 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:21.615088    5946 generic.go:356] "Generic (PLEG): container finished" podID="bb38541e-5383-4f91-a21e-27b83c11b0b9" containerID="879bc2c1751168c8d87189215f18960db5276a429304cb550016ce08c53c3c50" exitCode=0
Oct 31 00:45:21.615567 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:21.615169    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk" event={"ID":"bb38541e-5383-4f91-a21e-27b83c11b0b9","Type":"ContainerDied","Data":"879bc2c1751168c8d87189215f18960db5276a429304cb550016ce08c53c3c50"}
Oct 31 00:45:22.768434 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:22.768410    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk"
Oct 31 00:45:22.826814 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:22.826785    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bb38541e-5383-4f91-a21e-27b83c11b0b9-kube-api-access-x4f2j\" (UniqueName: \"kubernetes.io/projected/bb38541e-5383-4f91-a21e-27b83c11b0b9-kube-api-access-x4f2j\") pod \"bb38541e-5383-4f91-a21e-27b83c11b0b9\" (UID: \"bb38541e-5383-4f91-a21e-27b83c11b0b9\") "
Oct 31 00:45:22.827003 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:22.826835    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bb38541e-5383-4f91-a21e-27b83c11b0b9-maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bb38541e-5383-4f91-a21e-27b83c11b0b9-maas-api-openshift-ca\") pod \"bb38541e-5383-4f91-a21e-27b83c11b0b9\" (UID: \"bb38541e-5383-4f91-a21e-27b83c11b0b9\") "
Oct 31 00:45:22.827003 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:22.826893    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bb38541e-5383-4f91-a21e-27b83c11b0b9-maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bb38541e-5383-4f91-a21e-27b83c11b0b9-maas-api-xks-ca\") pod \"bb38541e-5383-4f91-a21e-27b83c11b0b9\" (UID: \"bb38541e-5383-4f91-a21e-27b83c11b0b9\") "
Oct 31 00:45:22.827341 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:22.827310    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb38541e-5383-4f91-a21e-27b83c11b0b9-maas-api-openshift-ca" pod "bb38541e-5383-4f91-a21e-27b83c11b0b9" (UID: "bb38541e-5383-4f91-a21e-27b83c11b0b9"). InnerVolumeSpecName "maas-api-openshift-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:45:22.829066 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:22.829033    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bb38541e-5383-4f91-a21e-27b83c11b0b9-maas-api-xks-ca" pod "bb38541e-5383-4f91-a21e-27b83c11b0b9" (UID: "bb38541e-5383-4f91-a21e-27b83c11b0b9"). InnerVolumeSpecName "maas-api-xks-ca". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:45:22.829164 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:22.829065    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bb38541e-5383-4f91-a21e-27b83c11b0b9-kube-api-access-x4f2j" pod "bb38541e-5383-4f91-a21e-27b83c11b0b9" (UID: "bb38541e-5383-4f91-a21e-27b83c11b0b9"). InnerVolumeSpecName "kube-api-access-x4f2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:45:22.928851 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:22.928757    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4f2j\" (UniqueName: \"kubernetes.io/projected/bb38541e-5383-4f91-a21e-27b83c11b0b9-kube-api-access-x4f2j\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:45:22.928851 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:22.928791    5946 reconciler_common.go:299] "Volume detached for volume \"maas-api-openshift-ca\" (UniqueName: \"kubernetes.io/configmap/bb38541e-5383-4f91-a21e-27b83c11b0b9-maas-api-openshift-ca\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:45:22.928851 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:22.928807    5946 reconciler_common.go:299] "Volume detached for volume \"maas-api-xks-ca\" (UniqueName: \"kubernetes.io/secret/bb38541e-5383-4f91-a21e-27b83c11b0b9-maas-api-xks-ca\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:45:23.629536 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:23.629510    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk"
Oct 31 00:45:23.629715 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:23.629551    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk" event={"ID":"bb38541e-5383-4f91-a21e-27b83c11b0b9","Type":"ContainerDied","Data":"d0e624c2d7c86ea4728ad2e05fcb3434bb57c59f6b60cc200b3d93e9e3d5c346"}
Oct 31 00:45:23.629715 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:23.629632    5946 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0e624c2d7c86ea4728ad2e05fcb3434bb57c59f6b60cc200b3d93e9e3d5c346"
Oct 31 00:45:31.397288 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.397248    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"]
Oct 31 00:45:31.398088 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.398066    5946 cpu_manager.go:414] "containerMap: removing container" podUID="bb38541e-5383-4f91-a21e-27b83c11b0b9" containerName="revoke-keys"
Oct 31 00:45:31.398088 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.398089    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bb38541e-5383-4f91-a21e-27b83c11b0b9" containerName="revoke-keys"
Oct 31 00:45:31.398303 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.398232    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="bb38541e-5383-4f91-a21e-27b83c11b0b9" containerName="revoke-keys"
Oct 31 00:45:31.403108 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.403087    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.409581 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.409195    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w6-47f370\"/\"distinct-w6-47f370-kserve-self-signed-certs\""
Oct 31 00:45:31.411528 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.411501    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"]
Oct 31 00:45:31.457929 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.457898    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsmdm\" (UniqueName: \"kubernetes.io/projected/0518f203-0975-43bd-a3fb-53547d8b4846-kube-api-access-wsmdm\") pod \"distinct-w6-47f370-kserve-bf8d9b64b-tfchm\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") " pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.458079 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.457963    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-dshm\") pod \"distinct-w6-47f370-kserve-bf8d9b64b-tfchm\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") " pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.458079 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.458019    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-tmp-dir\") pod \"distinct-w6-47f370-kserve-bf8d9b64b-tfchm\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") " pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.458152 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.458132    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0518f203-0975-43bd-a3fb-53547d8b4846-tls-certs\") pod \"distinct-w6-47f370-kserve-bf8d9b64b-tfchm\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") " pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.458196 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.458184    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-model-cache\") pod \"distinct-w6-47f370-kserve-bf8d9b64b-tfchm\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") " pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.458299 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.458281    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-home\") pod \"distinct-w6-47f370-kserve-bf8d9b64b-tfchm\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") " pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.559132 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.559098    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-dshm\") pod \"distinct-w6-47f370-kserve-bf8d9b64b-tfchm\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") " pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.559352 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.559212    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-tmp-dir\") pod \"distinct-w6-47f370-kserve-bf8d9b64b-tfchm\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") " pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.559352 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.559313    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0518f203-0975-43bd-a3fb-53547d8b4846-tls-certs\") pod \"distinct-w6-47f370-kserve-bf8d9b64b-tfchm\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") " pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.559477 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.559398    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-model-cache\") pod \"distinct-w6-47f370-kserve-bf8d9b64b-tfchm\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") " pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.559477 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.559442    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-home\") pod \"distinct-w6-47f370-kserve-bf8d9b64b-tfchm\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") " pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.560153 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.559483    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsmdm\" (UniqueName: \"kubernetes.io/projected/0518f203-0975-43bd-a3fb-53547d8b4846-kube-api-access-wsmdm\") pod \"distinct-w6-47f370-kserve-bf8d9b64b-tfchm\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") " pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.560322 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.559773    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-tmp-dir\") pod \"distinct-w6-47f370-kserve-bf8d9b64b-tfchm\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") " pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.560322 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.559904    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-model-cache\") pod \"distinct-w6-47f370-kserve-bf8d9b64b-tfchm\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") " pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.560322 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.560041    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-home\") pod \"distinct-w6-47f370-kserve-bf8d9b64b-tfchm\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") " pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.562310 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.562278    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-dshm\") pod \"distinct-w6-47f370-kserve-bf8d9b64b-tfchm\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") " pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.562911 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.562889    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0518f203-0975-43bd-a3fb-53547d8b4846-tls-certs\") pod \"distinct-w6-47f370-kserve-bf8d9b64b-tfchm\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") " pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.575757 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.575694    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsmdm\" (UniqueName: \"kubernetes.io/projected/0518f203-0975-43bd-a3fb-53547d8b4846-kube-api-access-wsmdm\") pod \"distinct-w6-47f370-kserve-bf8d9b64b-tfchm\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") " pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:31.717942 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:31.717873    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:32.004955 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:32.004873    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"]
Oct 31 00:45:32.007529 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:45:32.007494    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0518f203_0975_43bd_a3fb_53547d8b4846.slice/crio-3a6fde423c7f58e2e882e6026985d89c7f247154792f1e48018b7475d07c134c WatchSource:0}: Error finding container 3a6fde423c7f58e2e882e6026985d89c7f247154792f1e48018b7475d07c134c: Status 404 returned error can't find the container with id 3a6fde423c7f58e2e882e6026985d89c7f247154792f1e48018b7475d07c134c
Oct 31 00:45:32.687804 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:32.687772    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm" event={"ID":"0518f203-0975-43bd-a3fb-53547d8b4846","Type":"ContainerStarted","Data":"d8f84680d06bc6db4ec70f7c5712493555dd7561736893be700bc3650520e348"}
Oct 31 00:45:32.687804 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:32.687814    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm" event={"ID":"0518f203-0975-43bd-a3fb-53547d8b4846","Type":"ContainerStarted","Data":"3a6fde423c7f58e2e882e6026985d89c7f247154792f1e48018b7475d07c134c"}
Oct 31 00:45:32.720311 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:32.720028    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:32.721923 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:32.721816    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm" podStartSLOduration=1.721797867 podStartE2EDuration="1.721797867s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:45:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:45:32.720972103 +0000 UTC m=+673.794012190" watchObservedRunningTime="2026-10-31 00:45:32.721797867 +0000 UTC m=+673.794837951"
Oct 31 00:45:37.197473 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:37.197435    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:45:41.381963 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:45:41.381926    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:45:41.718587 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:41.718506    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:41.731374 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:41.731351    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:41.765354 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:41.765330    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:45:42.552959 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.552926    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"]
Oct 31 00:45:42.574563 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.574530    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.574811 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.574791    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"]
Oct 31 00:45:42.663955 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.663910    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-istio-data\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.664148 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.664081    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50175a7b-1e0d-4398-bacb-afffae46b712-istio-token\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.664210 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.664183    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-workload-socket\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.664287 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.664271    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlkvg\" (UniqueName: \"kubernetes.io/projected/50175a7b-1e0d-4398-bacb-afffae46b712-kube-api-access-nlkvg\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.664340 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.664307    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-workload-certs\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.664423 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.664401    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-istio-envoy\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.664545 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.664531    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-credential-socket\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.664590 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.664579    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50175a7b-1e0d-4398-bacb-afffae46b712-istiod-ca-cert\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.664653 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.664641    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50175a7b-1e0d-4398-bacb-afffae46b712-istio-podinfo\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.765701 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.765660    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50175a7b-1e0d-4398-bacb-afffae46b712-istio-token\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.765899 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.765711    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-workload-socket\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.765899 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.765745    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlkvg\" (UniqueName: \"kubernetes.io/projected/50175a7b-1e0d-4398-bacb-afffae46b712-kube-api-access-nlkvg\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.765899 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.765763    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-workload-certs\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.765899 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.765794    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-istio-envoy\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.765899 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.765870    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-credential-socket\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.766180 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.765932    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50175a7b-1e0d-4398-bacb-afffae46b712-istiod-ca-cert\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.766180 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.766002    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50175a7b-1e0d-4398-bacb-afffae46b712-istio-podinfo\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.766180 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.766051    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-istio-data\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.766180 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.766174    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-workload-socket\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.766458 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.766207    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-workload-certs\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.766458 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.766340    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-credential-socket\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.766458 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.766414    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-istio-data\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.766782 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.766759    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50175a7b-1e0d-4398-bacb-afffae46b712-istiod-ca-cert\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.768150 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.768127    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-istio-envoy\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.768400 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.768385    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50175a7b-1e0d-4398-bacb-afffae46b712-istio-podinfo\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.780936 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.780914    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50175a7b-1e0d-4398-bacb-afffae46b712-istio-token\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.810736 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.810663    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlkvg\" (UniqueName: \"kubernetes.io/projected/50175a7b-1e0d-4398-bacb-afffae46b712-kube-api-access-nlkvg\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:42.895301 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:42.895169    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:43.176342 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.176310    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"]
Oct 31 00:45:43.176834 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:45:43.176809    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50175a7b_1e0d_4398_bacb_afffae46b712.slice/crio-3da41ded324d1b1349b37d35f78b18afa2d0a52e7bff9c875b42e91db4a765e1 WatchSource:0}: Error finding container 3da41ded324d1b1349b37d35f78b18afa2d0a52e7bff9c875b42e91db4a765e1: Status 404 returned error can't find the container with id 3da41ded324d1b1349b37d35f78b18afa2d0a52e7bff9c875b42e91db4a765e1
Oct 31 00:45:43.179479 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.179441    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:43.179653 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.179545    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:43.179653 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.179589    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:43.248334 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.246464    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"]
Oct 31 00:45:43.251920 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.251904    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.270611 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.269105    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"]
Oct 31 00:45:43.373025 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.372992    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-workload-certs\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.373189 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.373038    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-istio-data\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.373292 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.373264    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.373358 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.373341    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-workload-socket\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.373423 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.373407    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-istio-token\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.373460 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.373444    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.373547 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.373531    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpqnq\" (UniqueName: \"kubernetes.io/projected/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-kube-api-access-rpqnq\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.373647 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.373631    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-credential-socket\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.373748 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.373728    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.474940 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.474862    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-credential-socket\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.474940 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.474917    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.475160 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.474988    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-workload-certs\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.475160 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.475017    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-istio-data\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.475160 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.475082    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.475160 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.475112    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-workload-socket\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.475160 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.475149    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-istio-token\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.475426 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.475184    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.475477 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.475445    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-workload-certs\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.475524 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.475486    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-credential-socket\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.475524 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.475503    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpqnq\" (UniqueName: \"kubernetes.io/projected/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-kube-api-access-rpqnq\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.475920 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.475894    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-istio-data\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.476036 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.475954    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.476036 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.475991    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-workload-socket\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.477626 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.477605    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.477626 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.477615    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-istio-envoy\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.483590 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.483561    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpqnq\" (UniqueName: \"kubernetes.io/projected/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-kube-api-access-rpqnq\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.483939 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.483920    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/45bc1cee-bd0f-45be-a614-7d08c7fbf55a-istio-token\") pod \"maas-default-gateway-openshift-default-6f54779779-jbqxw\" (UID: \"45bc1cee-bd0f-45be-a614-7d08c7fbf55a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.578005 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.577973    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:43.789641 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.782567    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs" event={"ID":"50175a7b-1e0d-4398-bacb-afffae46b712","Type":"ContainerStarted","Data":"adfc225513da3a0cb85a05a9b660a9885284e31bfaafc8bcf64bf9b1d13b54a5"}
Oct 31 00:45:43.789641 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.782628    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs" event={"ID":"50175a7b-1e0d-4398-bacb-afffae46b712","Type":"ContainerStarted","Data":"3da41ded324d1b1349b37d35f78b18afa2d0a52e7bff9c875b42e91db4a765e1"}
Oct 31 00:45:43.818413 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.818361    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs" podStartSLOduration=1.818345492 podStartE2EDuration="1.818345492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:45:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:45:43.816466151 +0000 UTC m=+684.889506233" watchObservedRunningTime="2026-10-31 00:45:43.818345492 +0000 UTC m=+684.891385571"
Oct 31 00:45:43.895737 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.895684    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:43.899031 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.899010    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"]
Oct 31 00:45:43.900625 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:45:43.900605    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45bc1cee_bd0f_45be_a614_7d08c7fbf55a.slice/crio-46137364e5ae77b562e7543e259ce09db2cf276c03cb0a3e91802b0ba4e02051 WatchSource:0}: Error finding container 46137364e5ae77b562e7543e259ce09db2cf276c03cb0a3e91802b0ba4e02051: Status 404 returned error can't find the container with id 46137364e5ae77b562e7543e259ce09db2cf276c03cb0a3e91802b0ba4e02051
Oct 31 00:45:43.903450 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.903418    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:43.903531 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.903494    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:43.903595 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:43.903539    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:44.800706 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:44.800672    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw" event={"ID":"45bc1cee-bd0f-45be-a614-7d08c7fbf55a","Type":"ContainerStarted","Data":"7fad6452b8002b9325934c5988cff18578d52e68e800e616908e3c8309cd2d12"}
Oct 31 00:45:44.801197 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:44.800724    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw" event={"ID":"45bc1cee-bd0f-45be-a614-7d08c7fbf55a","Type":"ContainerStarted","Data":"46137364e5ae77b562e7543e259ce09db2cf276c03cb0a3e91802b0ba4e02051"}
Oct 31 00:45:44.825465 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:44.825418    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw" podStartSLOduration=1.8254042799999999 podStartE2EDuration="1.82540428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:45:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:45:44.82256463 +0000 UTC m=+685.895604723" watchObservedRunningTime="2026-10-31 00:45:44.82540428 +0000 UTC m=+685.898444362"
Oct 31 00:45:44.897083 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:44.897049    5946 patch_prober.go:29] interesting pod/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 31 00:45:44.897254 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:44.897096    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs" podUID="50175a7b-1e0d-4398-bacb-afffae46b712" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 31 00:45:45.579537 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:45.579506    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:45.587243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:45.585386    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-jbqxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 31 00:45:45.587243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:45.585440    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw" podUID="45bc1cee-bd0f-45be-a614-7d08c7fbf55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 31 00:45:45.895750 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:45.895661    5946 patch_prober.go:29] interesting pod/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 31 00:45:45.895750 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:45.895711    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs" podUID="50175a7b-1e0d-4398-bacb-afffae46b712" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 31 00:45:46.586240 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:46.585792    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-jbqxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 31 00:45:46.586240 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:46.585850    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw" podUID="45bc1cee-bd0f-45be-a614-7d08c7fbf55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 31 00:45:46.896563 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:46.896450    5946 patch_prober.go:29] interesting pod/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 31 00:45:46.896563 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:46.896531    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs" podUID="50175a7b-1e0d-4398-bacb-afffae46b712" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 31 00:45:47.582806 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:47.582769    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-jbqxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 31 00:45:47.583058 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:47.583027    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw" podUID="45bc1cee-bd0f-45be-a614-7d08c7fbf55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 31 00:45:47.895840 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:47.895753    5946 patch_prober.go:29] interesting pod/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 31 00:45:47.895840 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:47.895808    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs" podUID="50175a7b-1e0d-4398-bacb-afffae46b712" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 31 00:45:48.580247 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:48.578544    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-jbqxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 31 00:45:48.580247 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:48.578603    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw" podUID="45bc1cee-bd0f-45be-a614-7d08c7fbf55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 31 00:45:48.895853 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:48.895779    5946 patch_prober.go:29] interesting pod/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused" start-of-body=
Oct 31 00:45:48.896060 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:48.896034    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs" podUID="50175a7b-1e0d-4398-bacb-afffae46b712" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.63:15021/healthz/ready\": dial tcp 10.134.0.63:15021: connect: connection refused"
Oct 31 00:45:49.579138 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:49.579095    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-jbqxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 31 00:45:49.579331 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:49.579165    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw" podUID="45bc1cee-bd0f-45be-a614-7d08c7fbf55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 31 00:45:49.999053 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:49.998957    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:50.000618 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:50.000591    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:50.003705 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:50.002571    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:45:50.578380 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:50.578342    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-jbqxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 31 00:45:50.578562 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:50.578405    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw" podUID="45bc1cee-bd0f-45be-a614-7d08c7fbf55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 31 00:45:51.580242 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:51.579636    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-jbqxw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused" start-of-body=
Oct 31 00:45:51.580242 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:51.579705    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw" podUID="45bc1cee-bd0f-45be-a614-7d08c7fbf55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": dial tcp 10.134.0.64:15021: connect: connection refused"
Oct 31 00:45:53.391873 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:53.391834    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:53.393352 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:53.393327    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:53.393975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:53.393955    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw"
Oct 31 00:45:57.693111 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.693077    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"]
Oct 31 00:45:57.701350 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.701328    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.707266 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.707206    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"]
Oct 31 00:45:57.712313 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.712290    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.719667 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.718879    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"]
Oct 31 00:45:57.738665 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.738643    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"]
Oct 31 00:45:57.866125 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.866091    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-credential-socket\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.866338 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.866142    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2048516f-a2f0-4e39-934b-719cde0e7619-istio-podinfo\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.866338 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.866258    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-istio-data\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.866338 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.866336    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-istio-data\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.866515 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.866368    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afc79d7c-316a-4546-afdb-06f3b6958755-istiod-ca-cert\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.866515 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.866390    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-workload-socket\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.866515 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.866441    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2048516f-a2f0-4e39-934b-719cde0e7619-istiod-ca-cert\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.866671 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.866512    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-workload-certs\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.866671 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.866548    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2wlp\" (UniqueName: \"kubernetes.io/projected/2048516f-a2f0-4e39-934b-719cde0e7619-kube-api-access-h2wlp\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.866671 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.866648    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-workload-socket\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.866794 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.866710    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2048516f-a2f0-4e39-934b-719cde0e7619-istio-token\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.866794 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.866785    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afc79d7c-316a-4546-afdb-06f3b6958755-istio-token\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.866870 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.866823    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afc79d7c-316a-4546-afdb-06f3b6958755-istio-podinfo\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.866907 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.866869    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-istio-envoy\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.866947 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.866904    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-istio-envoy\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.866947 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.866922    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-workload-certs\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.867017 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.866981    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-credential-socket\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.867017 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.867009    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8g99\" (UniqueName: \"kubernetes.io/projected/afc79d7c-316a-4546-afdb-06f3b6958755-kube-api-access-c8g99\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.936776 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.936742    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"]
Oct 31 00:45:57.941133 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.941110    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:57.968211 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968185    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2048516f-a2f0-4e39-934b-719cde0e7619-istio-podinfo\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.968371 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968276    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-istio-data\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.968371 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968337    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-istio-data\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.968520 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968388    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afc79d7c-316a-4546-afdb-06f3b6958755-istiod-ca-cert\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.968520 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968423    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-workload-socket\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.968520 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968470    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2048516f-a2f0-4e39-934b-719cde0e7619-istiod-ca-cert\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.968520 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968516    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-workload-certs\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.968720 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968540    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2wlp\" (UniqueName: \"kubernetes.io/projected/2048516f-a2f0-4e39-934b-719cde0e7619-kube-api-access-h2wlp\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.968720 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968586    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-workload-socket\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.968720 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968651    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2048516f-a2f0-4e39-934b-719cde0e7619-istio-token\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.968720 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968706    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afc79d7c-316a-4546-afdb-06f3b6958755-istio-token\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.968917 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968760    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afc79d7c-316a-4546-afdb-06f3b6958755-istio-podinfo\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.968917 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968770    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-istio-data\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.968917 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968789    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-istio-envoy\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.968917 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968861    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-istio-envoy\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.968917 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968897    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-workload-certs\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.969184 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968943    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-workload-socket\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.969184 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968923    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-credential-socket\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.969184 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.969007    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8g99\" (UniqueName: \"kubernetes.io/projected/afc79d7c-316a-4546-afdb-06f3b6958755-kube-api-access-c8g99\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.969184 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.969059    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-credential-socket\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.969436 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.969317    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-credential-socket\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.969436 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.968769    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-istio-data\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.969436 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.969375    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afc79d7c-316a-4546-afdb-06f3b6958755-istiod-ca-cert\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.969436 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.969430    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-credential-socket\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.969646 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.969463    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2048516f-a2f0-4e39-934b-719cde0e7619-istiod-ca-cert\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.970008 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.969714    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-workload-certs\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.970008 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.969742    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-workload-certs\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.970008 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.969964    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-workload-socket\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.971583 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.971558    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-istio-envoy\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.971848 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.971825    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-istio-envoy\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:57.971938 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.971909    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2048516f-a2f0-4e39-934b-719cde0e7619-istio-podinfo\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:57.972381 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:57.972359    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afc79d7c-316a-4546-afdb-06f3b6958755-istio-podinfo\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:58.002142 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.002111    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2048516f-a2f0-4e39-934b-719cde0e7619-istio-token\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:58.002915 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.002884    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afc79d7c-316a-4546-afdb-06f3b6958755-istio-token\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:58.013515 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.013494    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2wlp\" (UniqueName: \"kubernetes.io/projected/2048516f-a2f0-4e39-934b-719cde0e7619-kube-api-access-h2wlp\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:58.016466 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.016445    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8g99\" (UniqueName: \"kubernetes.io/projected/afc79d7c-316a-4546-afdb-06f3b6958755-kube-api-access-c8g99\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:58.026270 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.026250    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:58.041955 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.041932    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:58.077548 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.074608    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-workload-socket\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.077548 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.074743    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-data\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.077548 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.074794    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-workload-certs\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.077548 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.074819    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12052f5b-f4ad-4863-81b5-1b0063786b04-istiod-ca-cert\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.077548 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.074884    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f965g\" (UniqueName: \"kubernetes.io/projected/12052f5b-f4ad-4863-81b5-1b0063786b04-kube-api-access-f965g\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.077548 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.074939    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-podinfo\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.077548 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.074966    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-credential-socket\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.077548 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.075017    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-token\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.077548 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.075090    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-envoy\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.078939 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.078910    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"]
Oct 31 00:45:58.089267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.083255    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"]
Oct 31 00:45:58.118597 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.118370    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.133361 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.133330    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"]
Oct 31 00:45:58.138945 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.138922    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"]
Oct 31 00:45:58.149870 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.149851    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"]
Oct 31 00:45:58.150066 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.150055    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.176493 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.176451    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-token\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.176613 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.176541    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-envoy\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.176675 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.176639    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-workload-socket\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.176811 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.176743    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-data\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.176811 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.176787    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-workload-certs\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.176935 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.176809    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12052f5b-f4ad-4863-81b5-1b0063786b04-istiod-ca-cert\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.176935 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.176867    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f965g\" (UniqueName: \"kubernetes.io/projected/12052f5b-f4ad-4863-81b5-1b0063786b04-kube-api-access-f965g\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.176935 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.176920    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-podinfo\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.177158 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.176946    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-credential-socket\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.177378 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.177361    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-credential-socket\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.177900 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.177876    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-workload-certs\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.178176 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.178147    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12052f5b-f4ad-4863-81b5-1b0063786b04-istiod-ca-cert\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.189096 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.181618    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-data\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.189096 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.185780    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-workload-socket\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.189096 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.187248    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-envoy\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.189809 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.189782    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-podinfo\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.192539 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.192494    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f965g\" (UniqueName: \"kubernetes.io/projected/12052f5b-f4ad-4863-81b5-1b0063786b04-kube-api-access-f965g\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.193016 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.192989    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-token\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.256743 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.256657    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:58.278048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.278019    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-istio-envoy\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.278170 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.278051    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k58tw\" (UniqueName: \"kubernetes.io/projected/411306d4-6572-4b06-950c-2f9fdf30a713-kube-api-access-k58tw\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.278170 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.278089    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-credential-socket\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.278170 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.278120    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-istio-data\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.278375 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.278236    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/411306d4-6572-4b06-950c-2f9fdf30a713-istio-podinfo\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.278375 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.278263    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0324c9b7-a909-4a11-bab2-689600a09b88-istiod-ca-cert\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.278375 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.278359    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-istio-envoy\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.278539 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.278384    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0324c9b7-a909-4a11-bab2-689600a09b88-istio-podinfo\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.278539 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.278426    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-credential-socket\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.278539 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.278444    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-workload-certs\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.278539 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.278512    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0324c9b7-a909-4a11-bab2-689600a09b88-istio-token\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.278751 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.278564    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-istio-data\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.278751 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.278605    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9c96\" (UniqueName: \"kubernetes.io/projected/0324c9b7-a909-4a11-bab2-689600a09b88-kube-api-access-b9c96\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.278751 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.278647    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/411306d4-6572-4b06-950c-2f9fdf30a713-istiod-ca-cert\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.278751 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.278714    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-workload-certs\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.278751 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.278738    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-workload-socket\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.279001 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.278775    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/411306d4-6572-4b06-950c-2f9fdf30a713-istio-token\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.279001 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.278820    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-workload-socket\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.343683 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.343656    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"]
Oct 31 00:45:58.353451 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.352919    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:58.353451 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.352984    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:58.353451 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.353019    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:58.380736 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.380536    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0324c9b7-a909-4a11-bab2-689600a09b88-istiod-ca-cert\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.380736 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.380639    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-istio-envoy\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.380736 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.380674    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0324c9b7-a909-4a11-bab2-689600a09b88-istio-podinfo\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.380736 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.380702    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-credential-socket\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.380736 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.380728    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-workload-certs\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.381155 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.380809    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0324c9b7-a909-4a11-bab2-689600a09b88-istio-token\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.381155 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.380843    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-istio-data\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.381155 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.380875    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9c96\" (UniqueName: \"kubernetes.io/projected/0324c9b7-a909-4a11-bab2-689600a09b88-kube-api-access-b9c96\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.381155 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.380906    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/411306d4-6572-4b06-950c-2f9fdf30a713-istiod-ca-cert\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.381155 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.380984    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-workload-certs\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.381155 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.381015    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-workload-socket\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.381155 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.381062    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/411306d4-6572-4b06-950c-2f9fdf30a713-istio-token\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.381155 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.381127    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-workload-socket\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.381572 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.381170    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-istio-envoy\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.381572 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.381194    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k58tw\" (UniqueName: \"kubernetes.io/projected/411306d4-6572-4b06-950c-2f9fdf30a713-kube-api-access-k58tw\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.381572 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.381264    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-credential-socket\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.381572 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.381293    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-istio-data\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.381572 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.381338    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/411306d4-6572-4b06-950c-2f9fdf30a713-istio-podinfo\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.381572 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.381385    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0324c9b7-a909-4a11-bab2-689600a09b88-istiod-ca-cert\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.382466 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.382049    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/411306d4-6572-4b06-950c-2f9fdf30a713-istiod-ca-cert\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.382466 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.382072    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-workload-socket\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.384038 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.382899    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-workload-socket\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.384038 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.383169    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-credential-socket\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.384038 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.383450    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-workload-certs\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.384327 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.384063    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-workload-certs\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.384509 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.384364    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-istio-data\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.384962 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.384647    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-istio-envoy\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.385323 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.385272    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-credential-socket\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.385947 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.385924    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-istio-data\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.386092 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.386035    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0324c9b7-a909-4a11-bab2-689600a09b88-istio-podinfo\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.386703 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.386675    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-istio-envoy\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.387321 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.387290    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/411306d4-6572-4b06-950c-2f9fdf30a713-istio-podinfo\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.390177 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.390106    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"]
Oct 31 00:45:58.392174 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:45:58.392146    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2048516f_a2f0_4e39_934b_719cde0e7619.slice/crio-4b55e50b961b3f2aabc498b8f00692b21af7144302fd139c4004ab447192c13a WatchSource:0}: Error finding container 4b55e50b961b3f2aabc498b8f00692b21af7144302fd139c4004ab447192c13a: Status 404 returned error can't find the container with id 4b55e50b961b3f2aabc498b8f00692b21af7144302fd139c4004ab447192c13a
Oct 31 00:45:58.393984 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.393937    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/411306d4-6572-4b06-950c-2f9fdf30a713-istio-token\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.394263 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.394203    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:58.394344 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.394314    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:58.394384 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.394365    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:58.394848 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.394826    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k58tw\" (UniqueName: \"kubernetes.io/projected/411306d4-6572-4b06-950c-2f9fdf30a713-kube-api-access-k58tw\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.394965 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.394919    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0324c9b7-a909-4a11-bab2-689600a09b88-istio-token\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.397613 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.397581    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9c96\" (UniqueName: \"kubernetes.io/projected/0324c9b7-a909-4a11-bab2-689600a09b88-kube-api-access-b9c96\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.485716 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.485446    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:45:58.502545 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.502477    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:45:58.557574 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.557523    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"]
Oct 31 00:45:58.575267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.575133    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:58.576176 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.575732    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:58.576176 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.575808    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:58.818444 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.818410    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"]
Oct 31 00:45:58.823197 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.823162    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:58.823515 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.823492    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:58.823575 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.823544    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:58.842313 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.842186    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"]
Oct 31 00:45:58.844809 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:45:58.844782    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0324c9b7_a909_4a11_bab2_689600a09b88.slice/crio-fe17d3f034e2d155ef7bbfcbb762dc4085a1d67e348c3600a0af9932fdcbf856 WatchSource:0}: Error finding container fe17d3f034e2d155ef7bbfcbb762dc4085a1d67e348c3600a0af9932fdcbf856: Status 404 returned error can't find the container with id fe17d3f034e2d155ef7bbfcbb762dc4085a1d67e348c3600a0af9932fdcbf856
Oct 31 00:45:58.847554 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.847518    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:58.847664 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.847602    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:58.847664 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.847645    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:45:58.904185 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.904153    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs" event={"ID":"411306d4-6572-4b06-950c-2f9fdf30a713","Type":"ContainerStarted","Data":"dda3212fc2422babcb479406ed9a9c57ced0804e67529db40686e4dece20a9d4"}
Oct 31 00:45:58.907502 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.907473    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542" event={"ID":"afc79d7c-316a-4546-afdb-06f3b6958755","Type":"ContainerStarted","Data":"a0f5020a7fc34c713fa9555868a7bcdd00b2a128b9497ab8708b104a75326d47"}
Oct 31 00:45:58.907591 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.907533    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542" event={"ID":"afc79d7c-316a-4546-afdb-06f3b6958755","Type":"ContainerStarted","Data":"d86b5b6c53f0d2ab11c8f23109820bfccd77802da1ad0de20a661773b678a247"}
Oct 31 00:45:58.911145 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.911114    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l" event={"ID":"2048516f-a2f0-4e39-934b-719cde0e7619","Type":"ContainerStarted","Data":"1827ceae3e3bf57d32c7250daa9b99b42b344a07037acb8bfa0be00dc7600cc2"}
Oct 31 00:45:58.911270 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.911170    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l" event={"ID":"2048516f-a2f0-4e39-934b-719cde0e7619","Type":"ContainerStarted","Data":"4b55e50b961b3f2aabc498b8f00692b21af7144302fd139c4004ab447192c13a"}
Oct 31 00:45:58.915759 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.915732    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh" event={"ID":"0324c9b7-a909-4a11-bab2-689600a09b88","Type":"ContainerStarted","Data":"fe17d3f034e2d155ef7bbfcbb762dc4085a1d67e348c3600a0af9932fdcbf856"}
Oct 31 00:45:58.922043 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.920389    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl" event={"ID":"12052f5b-f4ad-4863-81b5-1b0063786b04","Type":"ContainerStarted","Data":"f47872931c70ce7dc283e1a56b02a33896695f4211f805cf592b44b17beb7895"}
Oct 31 00:45:58.922043 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.920608    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl" event={"ID":"12052f5b-f4ad-4863-81b5-1b0063786b04","Type":"ContainerStarted","Data":"32fb620bca6d67650f7da3c062cb57babe965efe4349b0328fcccbdab303599f"}
Oct 31 00:45:58.988257 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.975265    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l" podStartSLOduration=1.975245386 podStartE2EDuration="1.975245386s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:45:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:45:58.952677633 +0000 UTC m=+700.025717719" watchObservedRunningTime="2026-10-31 00:45:58.975245386 +0000 UTC m=+700.048285467"
Oct 31 00:45:58.988257 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:58.976153    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542" podStartSLOduration=1.9761391750000001 podStartE2EDuration="1.976139175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:45:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:45:58.931593072 +0000 UTC m=+700.004633166" watchObservedRunningTime="2026-10-31 00:45:58.976139175 +0000 UTC m=+700.049179257"
Oct 31 00:45:59.013238 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:59.000352    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl" podStartSLOduration=2.000331577 podStartE2EDuration="2.000331577s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:45:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:45:58.992881016 +0000 UTC m=+700.065921099" watchObservedRunningTime="2026-10-31 00:45:59.000331577 +0000 UTC m=+700.073371659"
Oct 31 00:45:59.030755 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:59.030720    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:45:59.030936 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:59.030834    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 31 00:45:59.030936 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:59.030872    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542" podUID="afc79d7c-316a-4546-afdb-06f3b6958755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 31 00:45:59.048675 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:59.048645    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:45:59.050341 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:59.050306    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 31 00:45:59.050554 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:59.050530    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l" podUID="2048516f-a2f0-4e39-934b-719cde0e7619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 31 00:45:59.271310 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:59.258776    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:45:59.285099 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:59.285065    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 31 00:45:59.300506 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:45:59.290160    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl" podUID="12052f5b-f4ad-4863-81b5-1b0063786b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 31 00:46:00.085527 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:00.084429    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 31 00:46:00.085527 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:00.084517    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l" podUID="2048516f-a2f0-4e39-934b-719cde0e7619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 31 00:46:00.085527 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:00.084950    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 31 00:46:00.085527 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:00.084985    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542" podUID="afc79d7c-316a-4546-afdb-06f3b6958755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 31 00:46:00.351308 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:00.342998    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 31 00:46:00.351308 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:00.343074    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl" podUID="12052f5b-f4ad-4863-81b5-1b0063786b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 31 00:46:00.370249 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:00.366021    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs" event={"ID":"411306d4-6572-4b06-950c-2f9fdf30a713","Type":"ContainerStarted","Data":"57192fe04d43f9319bac34e9978500ecaf10da10b946627b182e9d537d228565"}
Oct 31 00:46:00.408235 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:00.408183    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh" event={"ID":"0324c9b7-a909-4a11-bab2-689600a09b88","Type":"ContainerStarted","Data":"156a82c26cc282bc24001c4def7a947c34b5da3c44fbb87b50310453019412e3"}
Oct 31 00:46:00.489776 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:00.489745    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:46:00.504256 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:00.504205    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:46:00.508527 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:00.508500    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 31 00:46:00.508812 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:00.508787    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs" podUID="411306d4-6572-4b06-950c-2f9fdf30a713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 31 00:46:00.509376 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:00.509351    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 31 00:46:00.509561 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:00.509538    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh" podUID="0324c9b7-a909-4a11-bab2-689600a09b88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 31 00:46:00.539247 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:00.522368    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs" podStartSLOduration=2.522351296 podStartE2EDuration="2.522351296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:45:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:46:00.521617288 +0000 UTC m=+701.594657368" watchObservedRunningTime="2026-10-31 00:46:00.522351296 +0000 UTC m=+701.595391378"
Oct 31 00:46:00.639304 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:00.622669    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh" podStartSLOduration=2.6226410319999998 podStartE2EDuration="2.622641032s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:45:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:46:00.551379441 +0000 UTC m=+701.624419522" watchObservedRunningTime="2026-10-31 00:46:00.622641032 +0000 UTC m=+701.695681114"
Oct 31 00:46:01.029827 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:01.029724    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 31 00:46:01.030118 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:01.030073    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542" podUID="afc79d7c-316a-4546-afdb-06f3b6958755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 31 00:46:01.043080 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:01.043049    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 31 00:46:01.043390 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:01.043355    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l" podUID="2048516f-a2f0-4e39-934b-719cde0e7619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 31 00:46:01.265381 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:01.265341    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 31 00:46:01.265965 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:01.265936    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl" podUID="12052f5b-f4ad-4863-81b5-1b0063786b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 31 00:46:01.492239 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:01.491869    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 31 00:46:01.492239 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:01.491926    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs" podUID="411306d4-6572-4b06-950c-2f9fdf30a713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 31 00:46:01.526498 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:01.526464    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 31 00:46:01.526754 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:01.526724    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh" podUID="0324c9b7-a909-4a11-bab2-689600a09b88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 31 00:46:02.240366 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:02.235854    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 31 00:46:02.240366 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:02.235913    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542" podUID="afc79d7c-316a-4546-afdb-06f3b6958755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 31 00:46:02.251332 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:02.241785    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 31 00:46:02.251592 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:02.251561    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l" podUID="2048516f-a2f0-4e39-934b-719cde0e7619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 31 00:46:02.274241 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:02.270775    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 31 00:46:02.274241 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:02.270832    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl" podUID="12052f5b-f4ad-4863-81b5-1b0063786b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 31 00:46:02.489477 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:02.489439    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 31 00:46:02.489781 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:02.489751    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs" podUID="411306d4-6572-4b06-950c-2f9fdf30a713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 31 00:46:02.542300 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:02.521004    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 31 00:46:02.542300 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:02.521065    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh" podUID="0324c9b7-a909-4a11-bab2-689600a09b88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 31 00:46:02.798368 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:02.763866    5946 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm" podUID="0518f203-0975-43bd-a3fb-53547d8b4846" containerName="main" probeResult="failure" output="Get \"https://10.134.0.62:8000/health\": context deadline exceeded"
Oct 31 00:46:03.037039 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:03.036564    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 31 00:46:03.037039 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:03.036628    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542" podUID="afc79d7c-316a-4546-afdb-06f3b6958755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 31 00:46:03.096234 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:03.096128    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 31 00:46:03.106716 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:03.106428    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l" podUID="2048516f-a2f0-4e39-934b-719cde0e7619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 31 00:46:03.328564 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:03.328518    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2" podUID="72261b04-1609-4f79-9729-f918b643b0df" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:46:03.396445 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:03.396344    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 31 00:46:03.402240 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:03.396684    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl" podUID="12052f5b-f4ad-4863-81b5-1b0063786b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 31 00:46:03.495246 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:03.492936    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 31 00:46:03.495246 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:03.492994    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs" podUID="411306d4-6572-4b06-950c-2f9fdf30a713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 31 00:46:03.548244 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:03.512563    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 31 00:46:03.554388 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:03.554337    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh" podUID="0324c9b7-a909-4a11-bab2-689600a09b88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 31 00:46:03.830889 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:03.830129    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm" podUID="0518f203-0975-43bd-a3fb-53547d8b4846" containerName="main" probeResult="failure" output="Get \"https://10.134.0.62:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:46:04.027705 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:04.027664    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 31 00:46:04.027985 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:04.027951    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542" podUID="afc79d7c-316a-4546-afdb-06f3b6958755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 31 00:46:04.045826 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:04.045790    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 31 00:46:04.046090 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:04.046063    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l" podUID="2048516f-a2f0-4e39-934b-719cde0e7619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 31 00:46:04.314561 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:04.314526    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 31 00:46:04.314835 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:04.314802    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl" podUID="12052f5b-f4ad-4863-81b5-1b0063786b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 31 00:46:04.533245 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:04.521348    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 31 00:46:04.533245 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:04.521418    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs" podUID="411306d4-6572-4b06-950c-2f9fdf30a713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 31 00:46:04.548366 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:04.548332    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 31 00:46:04.548627 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:04.548593    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh" podUID="0324c9b7-a909-4a11-bab2-689600a09b88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 31 00:46:05.031243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:05.030347    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 31 00:46:05.031243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:05.030424    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542" podUID="afc79d7c-316a-4546-afdb-06f3b6958755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 31 00:46:05.042652 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:05.042604    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 31 00:46:05.042898 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:05.042865    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l" podUID="2048516f-a2f0-4e39-934b-719cde0e7619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 31 00:46:05.273243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:05.273074    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 31 00:46:05.273243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:05.273131    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl" podUID="12052f5b-f4ad-4863-81b5-1b0063786b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 31 00:46:05.518664 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:05.518630    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 31 00:46:05.537512 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:05.537472    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh" podUID="0324c9b7-a909-4a11-bab2-689600a09b88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 31 00:46:05.538364 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:05.518986    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 31 00:46:05.538606 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:05.538550    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs" podUID="411306d4-6572-4b06-950c-2f9fdf30a713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 31 00:46:06.052422 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:06.052380    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 31 00:46:06.052623 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:06.052458    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542" podUID="afc79d7c-316a-4546-afdb-06f3b6958755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 31 00:46:06.053156 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:06.053123    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 31 00:46:06.053303 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:06.053174    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l" podUID="2048516f-a2f0-4e39-934b-719cde0e7619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 31 00:46:06.287246 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:06.278075    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 31 00:46:06.287246 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:06.278133    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl" podUID="12052f5b-f4ad-4863-81b5-1b0063786b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 31 00:46:06.497298 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:06.489582    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 31 00:46:06.497298 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:06.489648    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs" podUID="411306d4-6572-4b06-950c-2f9fdf30a713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 31 00:46:06.527380 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:06.527344    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 31 00:46:06.527624 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:06.527595    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh" podUID="0324c9b7-a909-4a11-bab2-689600a09b88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 31 00:46:07.049898 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:07.043831    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused" start-of-body=
Oct 31 00:46:07.049898 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:07.043894    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542" podUID="afc79d7c-316a-4546-afdb-06f3b6958755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.65:15021/healthz/ready\": dial tcp 10.134.0.65:15021: connect: connection refused"
Oct 31 00:46:07.049898 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:07.044315    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused" start-of-body=
Oct 31 00:46:07.049898 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:07.044352    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l" podUID="2048516f-a2f0-4e39-934b-719cde0e7619" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.66:15021/healthz/ready\": dial tcp 10.134.0.66:15021: connect: connection refused"
Oct 31 00:46:07.271314 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:07.257555    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 31 00:46:07.271314 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:07.257615    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl" podUID="12052f5b-f4ad-4863-81b5-1b0063786b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 31 00:46:07.500297 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:07.496669    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 31 00:46:07.500297 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:07.496733    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs" podUID="411306d4-6572-4b06-950c-2f9fdf30a713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 31 00:46:07.530550 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:07.530511    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 31 00:46:07.603083 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:07.603042    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh" podUID="0324c9b7-a909-4a11-bab2-689600a09b88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 31 00:46:08.258243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:08.257515    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused" start-of-body=
Oct 31 00:46:08.258243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:08.257578    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl" podUID="12052f5b-f4ad-4863-81b5-1b0063786b04" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.67:15021/healthz/ready\": dial tcp 10.134.0.67:15021: connect: connection refused"
Oct 31 00:46:08.359268 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:08.359204    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:46:08.360671 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:08.360514    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:46:08.378531 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:08.378498    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:46:08.425924 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:08.425900    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:46:08.427045 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:08.427024    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:46:08.429515 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:08.429407    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:46:08.486376 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:08.486344    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused" start-of-body=
Oct 31 00:46:08.486607 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:08.486579    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs" podUID="411306d4-6572-4b06-950c-2f9fdf30a713" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.68:15021/healthz/ready\": dial tcp 10.134.0.68:15021: connect: connection refused"
Oct 31 00:46:08.506665 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:08.506634    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:46:08.510103 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:08.509634    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused" start-of-body=
Oct 31 00:46:08.510103 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:08.509717    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh" podUID="0324c9b7-a909-4a11-bab2-689600a09b88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": dial tcp 10.134.0.69:15021: connect: connection refused"
Oct 31 00:46:09.268863 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:09.268827    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:46:09.278241 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:09.275386    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:46:09.281172 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:09.281153    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:46:09.505525 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:09.505494    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:46:09.511620 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:09.511476    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:46:09.520805 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:09.520652    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:46:10.512390 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:10.512346    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:46:10.513374 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:10.513320    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh" podUID="0324c9b7-a909-4a11-bab2-689600a09b88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:46:11.563356 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:11.563314    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:46:11.563964 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:11.563929    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh" podUID="0324c9b7-a909-4a11-bab2-689600a09b88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:46:11.739259 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:46:11.738288    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:46:12.337243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:12.336493    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2" podUID="72261b04-1609-4f79-9729-f918b643b0df" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:46:12.413642 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:12.413607    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:46:12.415422 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:12.415401    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:46:12.427383 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:12.427353    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:46:26.988737 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:26.988706    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"]
Oct 31 00:46:26.994826 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:26.994805    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.001464 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.001439    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-7f1496\"/\"kube-root-ca.crt\""
Oct 31 00:46:27.002499 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.002476    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"]
Oct 31 00:46:27.005753 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.005732    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-7f1496\"/\"distinct-2-w1-7f1496-kserve-self-signed-certs\""
Oct 31 00:46:27.005753 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.005737    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w1-7f1496\"/\"default-dockercfg-zqzc6\""
Oct 31 00:46:27.074354 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.074328    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-dshm\") pod \"distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") " pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.074517 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.074378    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-model-cache\") pod \"distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") " pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.074517 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.074493    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-tmp-dir\") pod \"distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") " pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.074598 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.074523    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-home\") pod \"distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") " pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.074598 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.074560    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxbf2\" (UniqueName: \"kubernetes.io/projected/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-kube-api-access-jxbf2\") pod \"distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") " pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.074678 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.074662    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-tls-certs\") pod \"distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") " pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.101448 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.101420    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w1-7f1496\"/\"openshift-service-ca.crt\""
Oct 31 00:46:27.175546 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.175517    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-tls-certs\") pod \"distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") " pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.175737 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.175652    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-dshm\") pod \"distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") " pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.175737 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.175690    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-model-cache\") pod \"distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") " pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.175871 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.175772    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-tmp-dir\") pod \"distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") " pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.175871 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.175798    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-home\") pod \"distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") " pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.175871 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.175843    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxbf2\" (UniqueName: \"kubernetes.io/projected/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-kube-api-access-jxbf2\") pod \"distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") " pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.176283 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.176254    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-tmp-dir\") pod \"distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") " pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.176430 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.176391    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-home\") pod \"distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") " pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.176653 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.176634    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-model-cache\") pod \"distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") " pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.179086 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.179065    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-tls-certs\") pod \"distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") " pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.180253 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.180200    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-dshm\") pod \"distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") " pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.185974 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.185948    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxbf2\" (UniqueName: \"kubernetes.io/projected/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-kube-api-access-jxbf2\") pod \"distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") " pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.309920 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.309888    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:27.591569 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.591051    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"]
Oct 31 00:46:27.594300 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:46:27.594268    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad5db0b6_de09_4ba1_b5f4_6fe953615ecc.slice/crio-6e2476f642588de1bbc4b789f2ec1eb898fa80bfde3ece4396dbe7232b93fa80 WatchSource:0}: Error finding container 6e2476f642588de1bbc4b789f2ec1eb898fa80bfde3ece4396dbe7232b93fa80: Status 404 returned error can't find the container with id 6e2476f642588de1bbc4b789f2ec1eb898fa80bfde3ece4396dbe7232b93fa80
Oct 31 00:46:27.659243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.648430    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"]
Oct 31 00:46:27.659550 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.659300    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.721244 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.720275    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"]
Oct 31 00:46:27.768282 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.762662    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"]
Oct 31 00:46:27.805664 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.787769    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istiod-ca-cert\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.818927 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.806083    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-credential-socket\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.818927 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.806200    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-envoy\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.818927 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.806387    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-workload-socket\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.818927 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.806449    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wsp5\" (UniqueName: \"kubernetes.io/projected/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-kube-api-access-2wsp5\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.818927 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.806495    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-podinfo\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.818927 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.818473    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"]
Oct 31 00:46:27.818927 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.818597    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:27.823242 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.819580    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-workload-certs\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.823242 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.819624    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-data\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.823242 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.819659    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-token\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.922312 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.921428    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1626bf4d-1329-4475-85a5-3939af3db878-istio-token\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:27.922312 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.921497    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-credential-socket\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.922312 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.921534    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1626bf4d-1329-4475-85a5-3939af3db878-istio-podinfo\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:27.922312 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.921580    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-workload-certs\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:27.922312 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.921623    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-envoy\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.922312 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.921756    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-workload-socket\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.922312 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.921800    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wsp5\" (UniqueName: \"kubernetes.io/projected/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-kube-api-access-2wsp5\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.922312 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.921831    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-istio-envoy\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:27.922312 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.921861    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-istio-data\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:27.922312 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.921890    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-podinfo\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.922312 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.921929    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tf2p\" (UniqueName: \"kubernetes.io/projected/1626bf4d-1329-4475-85a5-3939af3db878-kube-api-access-4tf2p\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:27.922312 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.921983    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-workload-certs\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.922312 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.922008    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-workload-socket\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:27.922312 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.922034    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1626bf4d-1329-4475-85a5-3939af3db878-istiod-ca-cert\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:27.922312 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.922065    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-data\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.922312 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.922098    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-token\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.922312 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.922209    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istiod-ca-cert\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.924405 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.923420    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-credential-socket\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:27.924405 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.924024    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-credential-socket\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.927135 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.925527    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-workload-socket\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.927135 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.926538    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-workload-certs\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.927135 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.927051    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-envoy\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.927135 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.927073    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-data\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.927766 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.927733    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istiod-ca-cert\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.949798 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.949733    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-podinfo\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.954239 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.954185    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wsp5\" (UniqueName: \"kubernetes.io/projected/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-kube-api-access-2wsp5\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:27.955070 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:27.954677    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-token\") pod \"e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") " pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:28.012812 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.012514    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:28.051782 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.050110    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1626bf4d-1329-4475-85a5-3939af3db878-istio-token\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.051782 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.050171    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1626bf4d-1329-4475-85a5-3939af3db878-istio-podinfo\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.051782 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.050230    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-workload-certs\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.051782 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.050357    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-istio-envoy\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.051782 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.050384    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-istio-data\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.051782 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.050423    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tf2p\" (UniqueName: \"kubernetes.io/projected/1626bf4d-1329-4475-85a5-3939af3db878-kube-api-access-4tf2p\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.051782 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.050466    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-workload-socket\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.051782 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.050491    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1626bf4d-1329-4475-85a5-3939af3db878-istiod-ca-cert\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.051782 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.050585    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-credential-socket\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.051782 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.051064    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-credential-socket\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.053252 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.052896    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-istio-data\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.053252 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.053153    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-workload-certs\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.059323 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.058256    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-workload-socket\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.059323 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.059156    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1626bf4d-1329-4475-85a5-3939af3db878-istiod-ca-cert\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.092959 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.092894    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1626bf4d-1329-4475-85a5-3939af3db878-istio-podinfo\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.117287 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.116615    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-istio-envoy\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.124116 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.124086    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tf2p\" (UniqueName: \"kubernetes.io/projected/1626bf4d-1329-4475-85a5-3939af3db878-kube-api-access-4tf2p\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.130249 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.124574    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1626bf4d-1329-4475-85a5-3939af3db878-istio-token\") pod \"e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") " pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.160329 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.160304    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:28.566297 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.530709    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"]
Oct 31 00:46:28.647438 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.646579    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:28.661803 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.661766    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd" event={"ID":"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc","Type":"ContainerStarted","Data":"a64e8db8f4972e53bc5e74a9053b561a12e5e022323247729b359e825f6db42a"}
Oct 31 00:46:28.669354 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.669317    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd" event={"ID":"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc","Type":"ContainerStarted","Data":"6e2476f642588de1bbc4b789f2ec1eb898fa80bfde3ece4396dbe7232b93fa80"}
Oct 31 00:46:28.715283 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.715245    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"]
Oct 31 00:46:28.891242 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.866416    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-token\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:28.891601 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.891568    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-envoy\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:28.891859 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.891842    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-credential-socket\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:28.892180 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.892161    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-workload-socket\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:28.892417 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.892398    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-data\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:28.892679 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.892663    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istiod-ca-cert\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:28.893442 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.893420    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-64xmf\" (UniqueName: \"kubernetes.io/projected/d5c3e93a-655f-4a76-85ba-71a904a5dad2-kube-api-access-64xmf\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:28.893695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.893665    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-workload-certs\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:28.893887 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.893873    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-podinfo\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:28.969245 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:28.949137    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd" podStartSLOduration=2.949109649 podStartE2EDuration="2.949109649s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:46:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:46:28.74266594 +0000 UTC m=+729.815706022" watchObservedRunningTime="2026-10-31 00:46:28.949109649 +0000 UTC m=+730.022149743"
Oct 31 00:46:29.047652 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.046931    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-64xmf\" (UniqueName: \"kubernetes.io/projected/d5c3e93a-655f-4a76-85ba-71a904a5dad2-kube-api-access-64xmf\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:29.047652 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.046990    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-workload-certs\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:29.047652 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.047021    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-podinfo\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:29.047652 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.047143    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-token\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:29.047652 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.047198    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-envoy\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:29.047652 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.047349    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-credential-socket\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:29.047652 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.047421    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-workload-socket\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:29.047652 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.047477    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-data\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:29.047652 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.047569    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istiod-ca-cert\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:29.048931 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.048455    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istiod-ca-cert\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:29.057384 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.049099    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-workload-certs\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:29.116295 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.103275    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-credential-socket\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:29.164329 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.121881    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-workload-socket\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:29.164602 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.122112    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-data\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:29.204645 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.204597    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-envoy\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:29.319395 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.319365    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-podinfo\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:29.408296 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.323285    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2" podUID="72261b04-1609-4f79-9729-f918b643b0df" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:46:29.781083 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.760147    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm" podUID="0518f203-0975-43bd-a3fb-53547d8b4846" containerName="main" probeResult="failure" output="Get \"https://10.134.0.62:8000/ready\": context deadline exceeded"
Oct 31 00:46:29.914838 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.908020    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-64xmf\" (UniqueName: \"kubernetes.io/projected/d5c3e93a-655f-4a76-85ba-71a904a5dad2-kube-api-access-64xmf\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:30.031048 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:29.995625    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-token\") pod \"e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") " pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:30.101968 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:30.065860    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:30.208982 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:30.208647    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"]
Oct 31 00:46:30.210814 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:30.210793    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"]
Oct 31 00:46:30.297466 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:30.281061    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:46:30.297466 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:30.281151    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:46:30.297466 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:30.281199    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:46:30.297466 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:30.285277    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:30.309544 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:30.308297    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:46:30.309544 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:30.308403    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:46:30.309544 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:30.308456    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:46:30.939977 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:30.939950    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"]
Oct 31 00:46:30.941724 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:46:30.941677    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5c3e93a_655f_4a76_85ba_71a904a5dad2.slice/crio-c0afb974948e33c517334068b24608b2478907032a636bad3a55465d0713fdaa WatchSource:0}: Error finding container c0afb974948e33c517334068b24608b2478907032a636bad3a55465d0713fdaa: Status 404 returned error can't find the container with id c0afb974948e33c517334068b24608b2478907032a636bad3a55465d0713fdaa
Oct 31 00:46:30.944905 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:30.944867    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:46:30.945008 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:30.944955    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:46:30.945008 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:30.944999    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:46:31.262519 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:31.262420    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp" event={"ID":"1626bf4d-1329-4475-85a5-3939af3db878","Type":"ContainerStarted","Data":"45d24f5394c204c0215aff6f56767246e28d2df89c6bed282987b2ed9ac1f8c6"}
Oct 31 00:46:31.262519 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:31.262490    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp" event={"ID":"1626bf4d-1329-4475-85a5-3939af3db878","Type":"ContainerStarted","Data":"ef15ab45da5b47b706490a2429a032db4dfeb05d63cca051d3ff77d3ebfef39d"}
Oct 31 00:46:31.264267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:31.264202    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l" event={"ID":"d5c3e93a-655f-4a76-85ba-71a904a5dad2","Type":"ContainerStarted","Data":"dfc71840c203ae3e42bee1d59eb9afbf6c3704942522b3101d229cc317ae6ae5"}
Oct 31 00:46:31.264413 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:31.264292    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l" event={"ID":"d5c3e93a-655f-4a76-85ba-71a904a5dad2","Type":"ContainerStarted","Data":"c0afb974948e33c517334068b24608b2478907032a636bad3a55465d0713fdaa"}
Oct 31 00:46:31.266427 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:31.266404    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh" event={"ID":"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c","Type":"ContainerStarted","Data":"8823350bfd525dccd2b1a9c38e93977613f6536775ac078f9e4df50d8f1c233c"}
Oct 31 00:46:31.266517 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:31.266451    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh" event={"ID":"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c","Type":"ContainerStarted","Data":"75681f47e4fbe7cc729aeb3f322c2e34f86ab6136807241927a8a74184b72f9a"}
Oct 31 00:46:31.282529 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:31.282477    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp" podStartSLOduration=4.282460601 podStartE2EDuration="4.282460601s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:46:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:46:31.281743454 +0000 UTC m=+732.354783536" watchObservedRunningTime="2026-10-31 00:46:31.282460601 +0000 UTC m=+732.355500688"
Oct 31 00:46:31.288028 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:31.287967    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:31.302762 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:31.302720    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l" podStartSLOduration=3.302708356 podStartE2EDuration="3.302708356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:46:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:46:31.301132402 +0000 UTC m=+732.374172485" watchObservedRunningTime="2026-10-31 00:46:31.302708356 +0000 UTC m=+732.375748466"
Oct 31 00:46:31.319785 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:31.319716    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh" podStartSLOduration=4.31970515 podStartE2EDuration="4.31970515s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:46:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:46:31.319184079 +0000 UTC m=+732.392224172" watchObservedRunningTime="2026-10-31 00:46:31.31970515 +0000 UTC m=+732.392745230"
Oct 31 00:46:32.015244 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:32.014734    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:32.019869 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:32.019835    5946 patch_prober.go:29] interesting pod/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 31 00:46:32.020119 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:32.020091    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh" podUID="daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 31 00:46:32.168327 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:32.168283    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:32.168667 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:32.168361    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 31 00:46:32.169150 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:32.168834    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp" podUID="1626bf4d-1329-4475-85a5-3939af3db878" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 31 00:46:32.309725 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:32.309681    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 31 00:46:32.310275 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:32.310245    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l" podUID="d5c3e93a-655f-4a76-85ba-71a904a5dad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 31 00:46:33.015749 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:33.015706    5946 patch_prober.go:29] interesting pod/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 31 00:46:33.015927 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:33.015772    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh" podUID="daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 31 00:46:33.161709 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:33.161663    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 31 00:46:33.161970 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:33.161944    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp" podUID="1626bf4d-1329-4475-85a5-3939af3db878" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 31 00:46:33.303711 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:33.296380    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 31 00:46:33.303711 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:33.296444    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l" podUID="d5c3e93a-655f-4a76-85ba-71a904a5dad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 31 00:46:34.014371 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:34.013823    5946 patch_prober.go:29] interesting pod/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 31 00:46:34.014371 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:34.013888    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh" podUID="daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 31 00:46:34.167408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:34.167373    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 31 00:46:34.167686 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:34.167659    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp" podUID="1626bf4d-1329-4475-85a5-3939af3db878" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 31 00:46:34.295301 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:34.295120    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 31 00:46:34.295301 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:34.295177    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l" podUID="d5c3e93a-655f-4a76-85ba-71a904a5dad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 31 00:46:35.015681 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:35.015199    5946 patch_prober.go:29] interesting pod/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 31 00:46:35.015681 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:35.015276    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh" podUID="daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 31 00:46:35.165673 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:35.165624    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 31 00:46:35.165884 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:35.165713    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp" podUID="1626bf4d-1329-4475-85a5-3939af3db878" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 31 00:46:35.290295 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:35.289637    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 31 00:46:35.290295 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:35.289710    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l" podUID="d5c3e93a-655f-4a76-85ba-71a904a5dad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 31 00:46:36.021767 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:36.021728    5946 patch_prober.go:29] interesting pod/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 31 00:46:36.022190 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:36.022168    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh" podUID="daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 31 00:46:36.164688 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:36.164646    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 31 00:46:36.164937 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:36.164909    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp" podUID="1626bf4d-1329-4475-85a5-3939af3db878" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 31 00:46:36.296301 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:36.295634    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 31 00:46:36.296301 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:36.295701    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l" podUID="d5c3e93a-655f-4a76-85ba-71a904a5dad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 31 00:46:37.013990 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:37.013902    5946 patch_prober.go:29] interesting pod/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused" start-of-body=
Oct 31 00:46:37.014173 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:37.013997    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh" podUID="daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.71:15021/healthz/ready\": dial tcp 10.134.0.71:15021: connect: connection refused"
Oct 31 00:46:37.162645 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:37.162609    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused" start-of-body=
Oct 31 00:46:37.163272 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:37.163192    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp" podUID="1626bf4d-1329-4475-85a5-3939af3db878" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.72:15021/healthz/ready\": dial tcp 10.134.0.72:15021: connect: connection refused"
Oct 31 00:46:37.288001 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:37.287908    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Oct 31 00:46:37.288001 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:37.287959    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l" podUID="d5c3e93a-655f-4a76-85ba-71a904a5dad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Oct 31 00:46:37.310533 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:37.310497    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:37.330658 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:37.330626    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:37.498264 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:37.498233    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:46:38.243021 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.242973    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:38.244343 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.244320    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:38.245919 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.245896    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:46:38.570813 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.570770    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"]
Oct 31 00:46:38.576514 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.576471    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.583339 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.582788    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Oct 31 00:46:38.587579 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.587503    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Oct 31 00:46:38.587768 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.587750    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-srs6x\""
Oct 31 00:46:38.587858 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.587792    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Oct 31 00:46:38.596529 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.596503    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"]
Oct 31 00:46:38.643490 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.643441    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:38.645053 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.644987    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:38.648500 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.648463    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:46:38.672108 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.672080    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:38.673155 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.673133    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:38.674014 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.673993    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:46:38.771506 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.771203    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3725d6f-6a2d-4d05-86e7-104990c62ff8-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.771750 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.771580    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.771750 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.771613    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.771750 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.771657    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.771933 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.771779    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.771984 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.771940    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.772037 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.772011    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2bdh\" (UniqueName: \"kubernetes.io/projected/e3725d6f-6a2d-4d05-86e7-104990c62ff8-kube-api-access-x2bdh\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.873277 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.873195    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.873277 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.873265    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2bdh\" (UniqueName: \"kubernetes.io/projected/e3725d6f-6a2d-4d05-86e7-104990c62ff8-kube-api-access-x2bdh\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.873463 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.873294    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3725d6f-6a2d-4d05-86e7-104990c62ff8-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.873463 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.873453    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.873650 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.873612    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.873759 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.873734    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.873875 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.873852    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.874530 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.874507    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.876066 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.876040    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-cacerts\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.876177 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.876101    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3725d6f-6a2d-4d05-86e7-104990c62ff8-local-certs\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.876307 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.876289    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.876426 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.876410    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-kubeconfig\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.881069 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.881050    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-token\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.881396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.881378    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2bdh\" (UniqueName: \"kubernetes.io/projected/e3725d6f-6a2d-4d05-86e7-104990c62ff8-kube-api-access-x2bdh\") pod \"istiod-openshift-gateway-7ddd9cfdc8-278vj\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") " pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:38.921666 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:38.921637    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:39.233968 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:39.233937    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"]
Oct 31 00:46:39.235963 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:46:39.235937    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3725d6f_6a2d_4d05_86e7_104990c62ff8.slice/crio-b80bf411a73fa2b5b7b20f22c50038169d4c1a6148464caf417f22b6d4601638 WatchSource:0}: Error finding container b80bf411a73fa2b5b7b20f22c50038169d4c1a6148464caf417f22b6d4601638: Status 404 returned error can't find the container with id b80bf411a73fa2b5b7b20f22c50038169d4c1a6148464caf417f22b6d4601638
Oct 31 00:46:39.504930 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:39.504843    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj" event={"ID":"e3725d6f-6a2d-4d05-86e7-104990c62ff8","Type":"ContainerStarted","Data":"b80bf411a73fa2b5b7b20f22c50038169d4c1a6148464caf417f22b6d4601638"}
Oct 31 00:46:41.389826 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:46:41.389790    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:46:42.408415 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:42.408383    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:46:42.408740 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:42.408448    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:46:42.534238 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:42.534156    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj" event={"ID":"e3725d6f-6a2d-4d05-86e7-104990c62ff8","Type":"ContainerStarted","Data":"61e59266c63977c1f12ffcb0313c30eadb9a5d035ebcf62751b75ede0f1a04f2"}
Oct 31 00:46:42.534922 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:42.534299    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:42.559674 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:42.559627    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj" podStartSLOduration=1.391452937 podStartE2EDuration="4.559612366s" totalImagesPullingTime="3.168159429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:46:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:46:42.558051076 +0000 UTC m=+743.631091190" watchObservedRunningTime="2026-10-31 00:46:42.559612366 +0000 UTC m=+743.632652445"
Oct 31 00:46:43.219128 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.219094    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"]
Oct 31 00:46:43.224542 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.224136    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.246832 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.242779    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"]
Oct 31 00:46:43.355116 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.355083    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-workload-socket\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.355293 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.355142    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-credential-socket\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.355350 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.355285    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-podinfo\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.355396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.355360    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-token\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.355439 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.355399    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-data\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.355439 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.355417    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-envoy\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.355534 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.355465    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b77a849b-33f4-4a27-aaf5-45475b017feb-istiod-ca-cert\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.355620 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.355599    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-workload-certs\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.355740 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.355725    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvx4t\" (UniqueName: \"kubernetes.io/projected/b77a849b-33f4-4a27-aaf5-45475b017feb-kube-api-access-rvx4t\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.456695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.456664    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvx4t\" (UniqueName: \"kubernetes.io/projected/b77a849b-33f4-4a27-aaf5-45475b017feb-kube-api-access-rvx4t\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.457254 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.456763    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-workload-socket\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.457254 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.456804    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-credential-socket\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.457254 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.456820    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-podinfo\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.457254 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.456841    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-token\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.457254 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.456882    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-data\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.457254 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.456908    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-envoy\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.457254 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.456979    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b77a849b-33f4-4a27-aaf5-45475b017feb-istiod-ca-cert\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.457254 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.457042    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-workload-certs\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.457598 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.457257    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-credential-socket\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.457598 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.457268    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-workload-socket\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.457716 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.457593    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-workload-certs\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.457923 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.457814    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-data\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.458251 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.458197    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b77a849b-33f4-4a27-aaf5-45475b017feb-istiod-ca-cert\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.460079 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.460058    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-podinfo\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.460734 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.460714    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-envoy\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.483785 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.483726    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvx4t\" (UniqueName: \"kubernetes.io/projected/b77a849b-33f4-4a27-aaf5-45475b017feb-kube-api-access-rvx4t\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.509202 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.509169    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-token\") pod \"e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") " pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.542941 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.542915    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:46:43.553719 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.553681    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:43.841727 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.841694    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"]
Oct 31 00:46:43.842975 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:46:43.842949    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb77a849b_33f4_4a27_aaf5_45475b017feb.slice/crio-ed67f1c3c34220d25957049ec7e0b265f5ebe963802960a38902d5535ad09d1b WatchSource:0}: Error finding container ed67f1c3c34220d25957049ec7e0b265f5ebe963802960a38902d5535ad09d1b: Status 404 returned error can't find the container with id ed67f1c3c34220d25957049ec7e0b265f5ebe963802960a38902d5535ad09d1b
Oct 31 00:46:43.845728 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.845696    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:46:43.845807 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.845761    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:46:43.845807 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:43.845788    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:46:44.548884 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:44.548849    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77" event={"ID":"b77a849b-33f4-4a27-aaf5-45475b017feb","Type":"ContainerStarted","Data":"2632713fcd89a96bb0fbe14c007b21bf4878ee00554fecc55febd1d8c7afb29a"}
Oct 31 00:46:44.549280 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:44.548903    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77" event={"ID":"b77a849b-33f4-4a27-aaf5-45475b017feb","Type":"ContainerStarted","Data":"ed67f1c3c34220d25957049ec7e0b265f5ebe963802960a38902d5535ad09d1b"}
Oct 31 00:46:44.554275 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:44.554258    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:44.555569 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:44.555549    5946 patch_prober.go:29] interesting pod/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 31 00:46:44.555647 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:44.555592    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77" podUID="b77a849b-33f4-4a27-aaf5-45475b017feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 31 00:46:45.562253 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:45.555697    5946 patch_prober.go:29] interesting pod/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 31 00:46:45.562253 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:45.555750    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77" podUID="b77a849b-33f4-4a27-aaf5-45475b017feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 31 00:46:46.559703 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:46.559665    5946 patch_prober.go:29] interesting pod/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 31 00:46:46.559896 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:46.559730    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77" podUID="b77a849b-33f4-4a27-aaf5-45475b017feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 31 00:46:47.559569 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:47.559536    5946 patch_prober.go:29] interesting pod/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 31 00:46:47.560152 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:47.560121    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77" podUID="b77a849b-33f4-4a27-aaf5-45475b017feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 31 00:46:48.558581 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:48.558541    5946 patch_prober.go:29] interesting pod/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 31 00:46:48.558756 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:48.558600    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77" podUID="b77a849b-33f4-4a27-aaf5-45475b017feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 31 00:46:49.555955 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:49.555921    5946 patch_prober.go:29] interesting pod/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 31 00:46:49.556591 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:49.556561    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77" podUID="b77a849b-33f4-4a27-aaf5-45475b017feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 31 00:46:50.071833 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:50.071767    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77" podStartSLOduration=7.071746487 podStartE2EDuration="7.071746487s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:46:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:46:44.572075595 +0000 UTC m=+745.645115687" watchObservedRunningTime="2026-10-31 00:46:50.071746487 +0000 UTC m=+751.144786568"
Oct 31 00:46:50.073812 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:50.073771    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:46:50.554294 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:50.554213    5946 patch_prober.go:29] interesting pod/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused" start-of-body=
Oct 31 00:46:50.554472 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:50.554293    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77" podUID="b77a849b-33f4-4a27-aaf5-45475b017feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": dial tcp 10.134.0.75:15021: connect: connection refused"
Oct 31 00:46:51.566530 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:51.566496    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:51.568657 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:51.568636    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:51.572510 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:51.572432    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:46:54.687515 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:54.687467    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:46:54.688692 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:46:54.688660    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l" podUID="d5c3e93a-655f-4a76-85ba-71a904a5dad2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:47:11.544243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:11.532380    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd" podUID="ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:47:11.655651 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:47:11.655535    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:47:11.779626 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:11.779563    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm" podUID="0518f203-0975-43bd-a3fb-53547d8b4846" containerName="main" probeResult="failure" output="Get \"https://10.134.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:47:12.273370 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:12.273305    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2" podUID="72261b04-1609-4f79-9729-f918b643b0df" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 31 00:47:12.608130 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:12.608083    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd" podUID="ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:47:12.610270 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:12.609515    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:47:12.721884 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:12.720796    5946 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm" podUID="0518f203-0975-43bd-a3fb-53547d8b4846" containerName="main" probeResult="failure" output="Get \"https://10.134.0.62:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:47:12.805799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:12.785444    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm" podUID="0518f203-0975-43bd-a3fb-53547d8b4846" containerName="main" probeResult="failure" output="Get \"https://10.134.0.62:8000/ready\": context deadline exceeded"
Oct 31 00:47:12.805799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:12.804368    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:47:13.282600 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:13.277634    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2" podUID="72261b04-1609-4f79-9729-f918b643b0df" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:47:13.335696 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:13.283630    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:47:13.335696 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:13.283680    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm" podUID="294716ae-2b4b-48e2-bec4-e84bcac470b4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:47:13.781555 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:13.781502    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd" podUID="ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:47:13.792113 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:13.791294    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:47:13.792113 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:13.791361    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh" podUID="0324c9b7-a909-4a11-bab2-689600a09b88" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:47:13.812777 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:13.812731    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm" podUID="0518f203-0975-43bd-a3fb-53547d8b4846" containerName="main" probeResult="failure" output="Get \"https://10.134.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:47:14.496270 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:14.494623    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2" podUID="72261b04-1609-4f79-9729-f918b643b0df" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": context deadline exceeded"
Oct 31 00:47:14.810386 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:14.796173    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd" podUID="ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:47:14.941017 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:47:14.940981    5946 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="1.763s"
Oct 31 00:47:14.947178 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:14.941514    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:47:15.000924 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:14.977058    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm" podUID="0518f203-0975-43bd-a3fb-53547d8b4846" containerName="main" probeResult="failure" output="Get \"https://10.134.0.62:8000/ready\": net/http: request canceled (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:47:15.013759 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:15.013731    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:47:15.113179 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:15.113096    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:47:15.113458 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:15.113442    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:47:21.204758 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.204724    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"]
Oct 31 00:47:21.215835 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.215812    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.217512 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.217487    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"]
Oct 31 00:47:21.222747 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.222728    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-5c2a03\"/\"openshift-service-ca.crt\""
Oct 31 00:47:21.223630 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.223606    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w4-5c2a03\"/\"kube-root-ca.crt\""
Oct 31 00:47:21.223767 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.223716    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5c2a03\"/\"default-dockercfg-6cdqc\""
Oct 31 00:47:21.224152 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.224132    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w4-5c2a03\"/\"distinct-2-w4-5c2a03-kserve-self-signed-certs\""
Oct 31 00:47:21.332742 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.332710    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-model-cache\") pod \"distinct-2-w4-5c2a03-kserve-d66d86854-62jfh\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") " pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.332927 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.332845    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6hh2\" (UniqueName: \"kubernetes.io/projected/8e9eecae-26a9-4cba-96c0-6e926d854027-kube-api-access-h6hh2\") pod \"distinct-2-w4-5c2a03-kserve-d66d86854-62jfh\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") " pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.333097 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.333071    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-home\") pod \"distinct-2-w4-5c2a03-kserve-d66d86854-62jfh\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") " pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.333168 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.333109    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-dshm\") pod \"distinct-2-w4-5c2a03-kserve-d66d86854-62jfh\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") " pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.333271 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.333212    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e9eecae-26a9-4cba-96c0-6e926d854027-tls-certs\") pod \"distinct-2-w4-5c2a03-kserve-d66d86854-62jfh\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") " pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.333341 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.333267    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-tmp-dir\") pod \"distinct-2-w4-5c2a03-kserve-d66d86854-62jfh\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") " pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.436056 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.434615    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-model-cache\") pod \"distinct-2-w4-5c2a03-kserve-d66d86854-62jfh\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") " pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.436056 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.434739    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6hh2\" (UniqueName: \"kubernetes.io/projected/8e9eecae-26a9-4cba-96c0-6e926d854027-kube-api-access-h6hh2\") pod \"distinct-2-w4-5c2a03-kserve-d66d86854-62jfh\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") " pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.436056 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.434885    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-home\") pod \"distinct-2-w4-5c2a03-kserve-d66d86854-62jfh\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") " pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.436056 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.434900    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-dshm\") pod \"distinct-2-w4-5c2a03-kserve-d66d86854-62jfh\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") " pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.436056 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.434935    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e9eecae-26a9-4cba-96c0-6e926d854027-tls-certs\") pod \"distinct-2-w4-5c2a03-kserve-d66d86854-62jfh\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") " pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.436056 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.434957    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-tmp-dir\") pod \"distinct-2-w4-5c2a03-kserve-d66d86854-62jfh\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") " pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.436056 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.435337    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-tmp-dir\") pod \"distinct-2-w4-5c2a03-kserve-d66d86854-62jfh\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") " pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.436056 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.435576    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-model-cache\") pod \"distinct-2-w4-5c2a03-kserve-d66d86854-62jfh\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") " pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.436792 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.436767    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-home\") pod \"distinct-2-w4-5c2a03-kserve-d66d86854-62jfh\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") " pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.439317 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.439291    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e9eecae-26a9-4cba-96c0-6e926d854027-tls-certs\") pod \"distinct-2-w4-5c2a03-kserve-d66d86854-62jfh\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") " pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.439967 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.439944    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-dshm\") pod \"distinct-2-w4-5c2a03-kserve-d66d86854-62jfh\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") " pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.443842 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.443815    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6hh2\" (UniqueName: \"kubernetes.io/projected/8e9eecae-26a9-4cba-96c0-6e926d854027-kube-api-access-h6hh2\") pod \"distinct-2-w4-5c2a03-kserve-d66d86854-62jfh\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") " pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.539619 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.539529    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:21.823285 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:21.821515    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"]
Oct 31 00:47:21.823285 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:47:21.822307    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e9eecae_26a9_4cba_96c0_6e926d854027.slice/crio-bdc8d6d391fcae5d9e079b6054b285be477968b1675edc3a09dee68033c84af1 WatchSource:0}: Error finding container bdc8d6d391fcae5d9e079b6054b285be477968b1675edc3a09dee68033c84af1: Status 404 returned error can't find the container with id bdc8d6d391fcae5d9e079b6054b285be477968b1675edc3a09dee68033c84af1
Oct 31 00:47:22.766427 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:22.766393    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh" event={"ID":"8e9eecae-26a9-4cba-96c0-6e926d854027","Type":"ContainerStarted","Data":"06cc986fa64a3dfcc2092a782dda978ef3ed445bbb206d666e703a0e11f47a8c"}
Oct 31 00:47:22.766810 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:22.766438    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh" event={"ID":"8e9eecae-26a9-4cba-96c0-6e926d854027","Type":"ContainerStarted","Data":"bdc8d6d391fcae5d9e079b6054b285be477968b1675edc3a09dee68033c84af1"}
Oct 31 00:47:23.539925 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:23.539891    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:28.203051 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.202993    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh" podStartSLOduration=7.202978876 podStartE2EDuration="7.202978876s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:47:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:47:22.786247212 +0000 UTC m=+783.859287291" watchObservedRunningTime="2026-10-31 00:47:28.202978876 +0000 UTC m=+789.276019011"
Oct 31 00:47:28.204846 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.204820    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"]
Oct 31 00:47:28.209852 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.209830    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.221954 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.221929    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"]
Oct 31 00:47:28.340269 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.340203    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-token\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.340444 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.340372    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnmvb\" (UniqueName: \"kubernetes.io/projected/26b5a389-67d4-4e8c-8353-a16770fe838c-kube-api-access-cnmvb\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.340506 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.340494    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-workload-socket\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.340566 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.340548    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-podinfo\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.340620 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.340605    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26b5a389-67d4-4e8c-8353-a16770fe838c-istiod-ca-cert\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.340672 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.340658    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-workload-certs\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.340795 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.340781    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-data\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.340831 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.340816    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-envoy\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.340874 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.340859    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-credential-socket\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.442330 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.442297    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-workload-socket\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.442524 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.442338    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-podinfo\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.442524 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.442440    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26b5a389-67d4-4e8c-8353-a16770fe838c-istiod-ca-cert\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.442524 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.442486    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-workload-certs\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.442696 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.442636    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-data\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.442696 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.442679    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-envoy\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.442797 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.442741    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-credential-socket\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.442797 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.442764    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-workload-socket\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.442912 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.442840    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-token\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.442912 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.442859    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-workload-certs\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.443000 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.442925    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnmvb\" (UniqueName: \"kubernetes.io/projected/26b5a389-67d4-4e8c-8353-a16770fe838c-kube-api-access-cnmvb\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.443000 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.442956    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-data\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.443089 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.443014    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-credential-socket\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.443561 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.443539    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26b5a389-67d4-4e8c-8353-a16770fe838c-istiod-ca-cert\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.445118 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.445098    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-envoy\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.445353 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.445333    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-podinfo\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.451096 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.451070    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-token\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.451253 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.451203    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnmvb\" (UniqueName: \"kubernetes.io/projected/26b5a389-67d4-4e8c-8353-a16770fe838c-kube-api-access-cnmvb\") pod \"e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") " pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.529126 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.526838    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:28.822205 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.822171    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"]
Oct 31 00:47:28.823102 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:47:28.823077    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26b5a389_67d4_4e8c_8353_a16770fe838c.slice/crio-bcb83082d1705897ccb6bfda16d21f38fefad07dcefa22fe8422d6d6151ed9c1 WatchSource:0}: Error finding container bcb83082d1705897ccb6bfda16d21f38fefad07dcefa22fe8422d6d6151ed9c1: Status 404 returned error can't find the container with id bcb83082d1705897ccb6bfda16d21f38fefad07dcefa22fe8422d6d6151ed9c1
Oct 31 00:47:28.825608 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.825575    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:47:28.825678 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.825637    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:47:28.825678 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:28.825665    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:47:29.819633 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:29.819597    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp" event={"ID":"26b5a389-67d4-4e8c-8353-a16770fe838c","Type":"ContainerStarted","Data":"3885c4f9ccaf5a6b9e1cd1edc4d7443024e0f6a733a12e68c2eedd390a3983e4"}
Oct 31 00:47:29.820128 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:29.819666    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp" event={"ID":"26b5a389-67d4-4e8c-8353-a16770fe838c","Type":"ContainerStarted","Data":"bcb83082d1705897ccb6bfda16d21f38fefad07dcefa22fe8422d6d6151ed9c1"}
Oct 31 00:47:29.859239 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:29.857928    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp" podStartSLOduration=1.8579083939999999 podStartE2EDuration="1.857908394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:47:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:47:29.856176395 +0000 UTC m=+790.929216476" watchObservedRunningTime="2026-10-31 00:47:29.857908394 +0000 UTC m=+790.930948475"
Oct 31 00:47:30.527598 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:30.527566    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:30.529800 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:30.529771    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 31 00:47:30.529968 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:30.529825    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp" podUID="26b5a389-67d4-4e8c-8353-a16770fe838c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 31 00:47:31.527707 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:31.527676    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 31 00:47:31.528089 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:31.527722    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp" podUID="26b5a389-67d4-4e8c-8353-a16770fe838c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 31 00:47:31.557242 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:31.557060    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:31.570653 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:31.570630    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:31.874957 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:31.874922    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:47:32.527700 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:32.527665    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 31 00:47:32.528198 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:32.527732    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp" podUID="26b5a389-67d4-4e8c-8353-a16770fe838c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 31 00:47:33.527816 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:33.527781    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 31 00:47:33.528212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:33.527833    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp" podUID="26b5a389-67d4-4e8c-8353-a16770fe838c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 31 00:47:34.527618 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:34.527578    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 31 00:47:34.527816 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:34.527640    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp" podUID="26b5a389-67d4-4e8c-8353-a16770fe838c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 31 00:47:35.527619 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:35.527587    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused" start-of-body=
Oct 31 00:47:35.528154 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:35.527649    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp" podUID="26b5a389-67d4-4e8c-8353-a16770fe838c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.77:15021/healthz/ready\": dial tcp 10.134.0.77:15021: connect: connection refused"
Oct 31 00:47:36.532876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:36.532847    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:36.533280 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:36.533250    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:36.534002 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:36.533964    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:47:40.890016 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:40.889978    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:47:41.382577 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:47:41.382542    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:47:53.642478 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:53.642442    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"]
Oct 31 00:47:53.647505 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:53.647478    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"]
Oct 31 00:47:58.361378 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.361337    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"]
Oct 31 00:47:58.388860 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.388824    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:58.391608 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.391582    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"]
Oct 31 00:47:58.758291 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.731532    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjgxw\" (UniqueName: \"kubernetes.io/projected/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-kube-api-access-xjgxw\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:58.758291 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.731607    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-envoy\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:58.758291 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.731779    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istiod-ca-cert\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:58.758291 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.731898    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-token\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:58.758291 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.732011    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-podinfo\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:58.758291 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.732126    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-workload-certs\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:58.802295 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.777368    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-workload-socket\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:58.802295 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.777446    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-credential-socket\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:58.802295 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.777564    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-data\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:58.940302 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.938379    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-podinfo\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:58.940302 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.938456    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-workload-certs\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:58.940302 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.938737    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-workload-socket\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:58.940302 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.938794    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-credential-socket\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:58.940302 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.938826    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-data\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:58.940302 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.939049    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjgxw\" (UniqueName: \"kubernetes.io/projected/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-kube-api-access-xjgxw\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:58.940302 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.939105    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-envoy\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:58.940302 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.939206    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istiod-ca-cert\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:58.940302 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:58.939480    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-token\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:59.072254 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:59.070998    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-data\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:59.072254 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:59.072073    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-workload-certs\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:59.072547 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:59.072410    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-workload-socket\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:59.072820 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:59.072792    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-credential-socket\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:59.268065 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:59.268025    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istiod-ca-cert\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:59.318242 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:59.272884    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-podinfo\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:59.556530 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:59.556496    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-envoy\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:47:59.894328 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:47:59.893447    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd" podUID="ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": context deadline exceeded"
Oct 31 00:48:00.065249 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:00.064846    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-token\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:48:00.073245 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:00.066551    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjgxw\" (UniqueName: \"kubernetes.io/projected/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-kube-api-access-xjgxw\") pod \"e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") " pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:48:00.073245 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:00.067664    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:48:00.080599 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:00.077597    5946 prober.go:122] "Probe failed" probeType="Liveness" pod="opendatahub/model-serving-api-75bd89fdfc-xznzv" podUID="eaa04487-3728-4fec-8172-db47ecdabb6a" containerName="server" probeResult="failure" output="Get \"https://10.134.0.33:8443/healthz\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:48:00.127070 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:00.107100    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh" podUID="8e9eecae-26a9-4cba-96c0-6e926d854027" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:48:00.127070 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:00.116307    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm" podUID="0518f203-0975-43bd-a3fb-53547d8b4846" containerName="main" probeResult="failure" output="Get \"https://10.134.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:48:00.759341 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:00.759296    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2" podUID="72261b04-1609-4f79-9729-f918b643b0df" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:48:01.274529 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:48:01.274494    5946 kubelet.go:2711] "Housekeeping took longer than expected" err="housekeeping took too long" expected="1s" actual="2.095s"
Oct 31 00:48:01.274833 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:01.274796    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf"]
Oct 31 00:48:01.871848 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:01.871757    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"]
Oct 31 00:48:01.882947 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:48:01.882914    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8594dbaf_9e69_4e69_a7f9_a8e699cabb9e.slice/crio-6f7b45c27bd451aac732ca58577db7d2214e8b67fc2f52f734c762948281ecbd WatchSource:0}: Error finding container 6f7b45c27bd451aac732ca58577db7d2214e8b67fc2f52f734c762948281ecbd: Status 404 returned error can't find the container with id 6f7b45c27bd451aac732ca58577db7d2214e8b67fc2f52f734c762948281ecbd
Oct 31 00:48:01.886540 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:01.885971    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:48:01.886540 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:01.886053    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:48:01.886540 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:01.886096    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:48:01.926288 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:01.926207    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k" event={"ID":"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e","Type":"ContainerStarted","Data":"6f7b45c27bd451aac732ca58577db7d2214e8b67fc2f52f734c762948281ecbd"}
Oct 31 00:48:02.959367 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:02.959326    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k" event={"ID":"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e","Type":"ContainerStarted","Data":"9e425a7badde2e081277d512acbf61654216f0bbe4a003ae560c657dbc938f69"}
Oct 31 00:48:02.986146 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:02.986090    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k" podStartSLOduration=4.98607305 podStartE2EDuration="4.98607305s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:47:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:48:02.982832317 +0000 UTC m=+824.055872393" watchObservedRunningTime="2026-10-31 00:48:02.98607305 +0000 UTC m=+824.059113133"
Oct 31 00:48:03.081745 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:03.081715    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:48:03.083524 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:03.083498    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 31 00:48:03.083646 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:03.083545    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k" podUID="8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 31 00:48:04.083276 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:04.082617    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 31 00:48:04.083276 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:04.082673    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k" podUID="8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 31 00:48:05.081843 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:05.081816    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 31 00:48:05.082359 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:05.082332    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k" podUID="8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 31 00:48:06.082039 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:06.082005    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 31 00:48:06.082544 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:06.082070    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k" podUID="8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 31 00:48:06.285241 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:06.284552    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf" podUID="30197b12-e066-43b4-b920-c1757b9516ce" containerName="payload-pre-processing" containerID="cri-o://241b5a59980fffdac4e0fed21bf31dec936876360eaeaf25548e4b5596adae57" gracePeriod=25
Oct 31 00:48:07.082015 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:07.081978    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 31 00:48:07.082237 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:07.082038    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k" podUID="8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 31 00:48:08.081821 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:08.081782    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused" start-of-body=
Oct 31 00:48:08.082060 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:08.082034    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k" podUID="8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.78:15021/healthz/ready\": dial tcp 10.134.0.78:15021: connect: connection refused"
Oct 31 00:48:08.671086 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:08.671028    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm" podUID="0518f203-0975-43bd-a3fb-53547d8b4846" containerName="main" containerID="cri-o://d8f84680d06bc6db4ec70f7c5712493555dd7561736893be700bc3650520e348" gracePeriod=45
Oct 31 00:48:08.685757 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:08.685724    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2" podUID="72261b04-1609-4f79-9729-f918b643b0df" containerName="main" containerID="cri-o://9504a75200c28ef01914e872cc5c1e6cfdee26a6befbdfd49012df87dfbdd64a" gracePeriod=45
Oct 31 00:48:08.965129 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:08.965080    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"]
Oct 31 00:48:09.023288 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.023123    5946 generic.go:356] "Generic (PLEG): container finished" podID="0518f203-0975-43bd-a3fb-53547d8b4846" containerID="d8f84680d06bc6db4ec70f7c5712493555dd7561736893be700bc3650520e348" exitCode=0
Oct 31 00:48:09.023658 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.023561    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm" event={"ID":"0518f203-0975-43bd-a3fb-53547d8b4846","Type":"ContainerDied","Data":"d8f84680d06bc6db4ec70f7c5712493555dd7561736893be700bc3650520e348"}
Oct 31 00:48:09.023658 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.023612    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm" event={"ID":"0518f203-0975-43bd-a3fb-53547d8b4846","Type":"ContainerDied","Data":"3a6fde423c7f58e2e882e6026985d89c7f247154792f1e48018b7475d07c134c"}
Oct 31 00:48:09.023658 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.023632    5946 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a6fde423c7f58e2e882e6026985d89c7f247154792f1e48018b7475d07c134c"
Oct 31 00:48:09.026251 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.026098    5946 generic.go:356] "Generic (PLEG): container finished" podID="72261b04-1609-4f79-9729-f918b643b0df" containerID="9504a75200c28ef01914e872cc5c1e6cfdee26a6befbdfd49012df87dfbdd64a" exitCode=0
Oct 31 00:48:09.026419 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.026234    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2" event={"ID":"72261b04-1609-4f79-9729-f918b643b0df","Type":"ContainerDied","Data":"9504a75200c28ef01914e872cc5c1e6cfdee26a6befbdfd49012df87dfbdd64a"}
Oct 31 00:48:09.043258 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.043232    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:48:09.055008 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.054987    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:48:09.227212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.223158    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-model-cache\") pod \"72261b04-1609-4f79-9729-f918b643b0df\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") "
Oct 31 00:48:09.227212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.223210    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-dshm\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-dshm\") pod \"0518f203-0975-43bd-a3fb-53547d8b4846\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") "
Oct 31 00:48:09.227212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.223257    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/0518f203-0975-43bd-a3fb-53547d8b4846-tls-certs\" (UniqueName: \"kubernetes.io/secret/0518f203-0975-43bd-a3fb-53547d8b4846-tls-certs\") pod \"0518f203-0975-43bd-a3fb-53547d8b4846\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") "
Oct 31 00:48:09.227212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.223352    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0518f203-0975-43bd-a3fb-53547d8b4846-kube-api-access-wsmdm\" (UniqueName: \"kubernetes.io/projected/0518f203-0975-43bd-a3fb-53547d8b4846-kube-api-access-wsmdm\") pod \"0518f203-0975-43bd-a3fb-53547d8b4846\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") "
Oct 31 00:48:09.227212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.223396    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-home\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-home\") pod \"72261b04-1609-4f79-9729-f918b643b0df\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") "
Oct 31 00:48:09.227212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.223440    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-dshm\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-dshm\") pod \"72261b04-1609-4f79-9729-f918b643b0df\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") "
Oct 31 00:48:09.227212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.223470    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-tmp-dir\") pod \"72261b04-1609-4f79-9729-f918b643b0df\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") "
Oct 31 00:48:09.227212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.223501    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/72261b04-1609-4f79-9729-f918b643b0df-kube-api-access-njmqx\" (UniqueName: \"kubernetes.io/projected/72261b04-1609-4f79-9729-f918b643b0df-kube-api-access-njmqx\") pod \"72261b04-1609-4f79-9729-f918b643b0df\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") "
Oct 31 00:48:09.227212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.223589    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-home\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-home\") pod \"0518f203-0975-43bd-a3fb-53547d8b4846\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") "
Oct 31 00:48:09.227212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.223796    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-model-cache\") pod \"0518f203-0975-43bd-a3fb-53547d8b4846\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") "
Oct 31 00:48:09.227212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.223868    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-tmp-dir\") pod \"0518f203-0975-43bd-a3fb-53547d8b4846\" (UID: \"0518f203-0975-43bd-a3fb-53547d8b4846\") "
Oct 31 00:48:09.227212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.223940    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/72261b04-1609-4f79-9729-f918b643b0df-tls-certs\" (UniqueName: \"kubernetes.io/secret/72261b04-1609-4f79-9729-f918b643b0df-tls-certs\") pod \"72261b04-1609-4f79-9729-f918b643b0df\" (UID: \"72261b04-1609-4f79-9729-f918b643b0df\") "
Oct 31 00:48:09.227212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.226676    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-tmp-dir" pod "72261b04-1609-4f79-9729-f918b643b0df" (UID: "72261b04-1609-4f79-9729-f918b643b0df"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:09.228016 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.227433    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-model-cache" pod "72261b04-1609-4f79-9729-f918b643b0df" (UID: "72261b04-1609-4f79-9729-f918b643b0df"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:09.229921 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.229893    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-model-cache" pod "0518f203-0975-43bd-a3fb-53547d8b4846" (UID: "0518f203-0975-43bd-a3fb-53547d8b4846"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:09.230103 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.230080    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-home" pod "0518f203-0975-43bd-a3fb-53547d8b4846" (UID: "0518f203-0975-43bd-a3fb-53547d8b4846"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:09.230489 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.230464    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-tmp-dir" pod "0518f203-0975-43bd-a3fb-53547d8b4846" (UID: "0518f203-0975-43bd-a3fb-53547d8b4846"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:09.230676 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.230655    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-home" pod "72261b04-1609-4f79-9729-f918b643b0df" (UID: "72261b04-1609-4f79-9729-f918b643b0df"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:09.243041 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.242998    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72261b04-1609-4f79-9729-f918b643b0df-tls-certs" pod "72261b04-1609-4f79-9729-f918b643b0df" (UID: "72261b04-1609-4f79-9729-f918b643b0df"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:48:09.243387 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.243342    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72261b04-1609-4f79-9729-f918b643b0df-kube-api-access-njmqx" pod "72261b04-1609-4f79-9729-f918b643b0df" (UID: "72261b04-1609-4f79-9729-f918b643b0df"). InnerVolumeSpecName "kube-api-access-njmqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:09.243387 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.243357    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-dshm" pod "72261b04-1609-4f79-9729-f918b643b0df" (UID: "72261b04-1609-4f79-9729-f918b643b0df"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:09.243387 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.243352    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0518f203-0975-43bd-a3fb-53547d8b4846-tls-certs" pod "0518f203-0975-43bd-a3fb-53547d8b4846" (UID: "0518f203-0975-43bd-a3fb-53547d8b4846"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:48:09.243611 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.243454    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-dshm" pod "0518f203-0975-43bd-a3fb-53547d8b4846" (UID: "0518f203-0975-43bd-a3fb-53547d8b4846"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:09.262887 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.262835    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0518f203-0975-43bd-a3fb-53547d8b4846-kube-api-access-wsmdm" pod "0518f203-0975-43bd-a3fb-53547d8b4846" (UID: "0518f203-0975-43bd-a3fb-53547d8b4846"). InnerVolumeSpecName "kube-api-access-wsmdm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:09.326850 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.326818    5946 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-model-cache\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:09.326850 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.326847    5946 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-tmp-dir\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:09.326850 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.326857    5946 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/72261b04-1609-4f79-9729-f918b643b0df-tls-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:09.327132 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.326865    5946 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-model-cache\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:09.327132 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.326874    5946 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-dshm\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:09.327132 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.326882    5946 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0518f203-0975-43bd-a3fb-53547d8b4846-tls-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:09.327132 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.326892    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wsmdm\" (UniqueName: \"kubernetes.io/projected/0518f203-0975-43bd-a3fb-53547d8b4846-kube-api-access-wsmdm\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:09.327132 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.326904    5946 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-home\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:09.327132 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.326911    5946 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-dshm\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:09.327132 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.326919    5946 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72261b04-1609-4f79-9729-f918b643b0df-tmp-dir\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:09.327132 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.326927    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njmqx\" (UniqueName: \"kubernetes.io/projected/72261b04-1609-4f79-9729-f918b643b0df-kube-api-access-njmqx\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:09.327132 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.326934    5946 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0518f203-0975-43bd-a3fb-53547d8b4846-home\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:09.369955 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.369920    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:48:09.372198 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.371711    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:48:09.374139 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:09.373439    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:48:10.006787 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:10.006693    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm" podUID="0518f203-0975-43bd-a3fb-53547d8b4846" containerName="main" probeResult="failure" output="Get \"https://10.134.0.62:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:48:10.014627 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:10.014595    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2" podUID="72261b04-1609-4f79-9729-f918b643b0df" containerName="main" probeResult="failure" output="Get \"https://10.134.0.57:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:48:10.034366 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:10.034339    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"
Oct 31 00:48:10.034523 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:10.034367    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2" event={"ID":"72261b04-1609-4f79-9729-f918b643b0df","Type":"ContainerDied","Data":"75ea64b10d52877f10ef074844bc6ef9007ef7c040b049df558e1a3250f51a49"}
Oct 31 00:48:10.034523 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:10.034433    5946 scope.go:122] "RemoveContainer" containerID="9504a75200c28ef01914e872cc5c1e6cfdee26a6befbdfd49012df87dfbdd64a"
Oct 31 00:48:10.034653 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:10.034628    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"
Oct 31 00:48:10.064770 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:10.064742    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"]
Oct 31 00:48:10.068556 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:10.068535    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-47f370/distinct-w6-47f370-kserve-bf8d9b64b-tfchm"]
Oct 31 00:48:10.077455 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:10.077425    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"]
Oct 31 00:48:10.081678 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:10.081656    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w6-47f370/premium-w6-47f370-kserve-765b8c7947-v4db2"]
Oct 31 00:48:11.057416 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:11.057374    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0518f203-0975-43bd-a3fb-53547d8b4846" path="/var/lib/kubelet/pods/0518f203-0975-43bd-a3fb-53547d8b4846/volumes"
Oct 31 00:48:11.057866 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:11.057845    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="72261b04-1609-4f79-9729-f918b643b0df" path="/var/lib/kubelet/pods/72261b04-1609-4f79-9729-f918b643b0df/volumes"
Oct 31 00:48:11.383134 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:48:11.382231    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:48:12.489560 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:12.489522    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"]
Oct 31 00:48:12.490505 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:12.489782    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t" podUID="bed92ef5-059c-49d2-832f-f0af407f26f6" containerName="maas-api" containerID="cri-o://50e5da50e1b5950def20e2530e168b7f47b43947da0c321a98a9ecd3259980e7" gracePeriod=30
Oct 31 00:48:12.741342 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:12.728293    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf" podUID="30197b12-e066-43b4-b920-c1757b9516ce" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:48:13.261587 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.261550    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"]
Oct 31 00:48:13.262246 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.262232    5946 cpu_manager.go:414] "containerMap: removing container" podUID="72261b04-1609-4f79-9729-f918b643b0df" containerName="main"
Oct 31 00:48:13.262289 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.262247    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="72261b04-1609-4f79-9729-f918b643b0df" containerName="main"
Oct 31 00:48:13.262289 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.262282    5946 cpu_manager.go:414] "containerMap: removing container" podUID="0518f203-0975-43bd-a3fb-53547d8b4846" containerName="main"
Oct 31 00:48:13.262289 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.262287    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0518f203-0975-43bd-a3fb-53547d8b4846" containerName="main"
Oct 31 00:48:13.262383 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.262373    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="72261b04-1609-4f79-9729-f918b643b0df" containerName="main"
Oct 31 00:48:13.262421 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.262387    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="0518f203-0975-43bd-a3fb-53547d8b4846" containerName="main"
Oct 31 00:48:13.271239 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.271175    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.280833 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.280803    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"]
Oct 31 00:48:13.301742 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.301663    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-data\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.301972 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.301829    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-podinfo\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.301972 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.301886    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istiod-ca-cert\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.301972 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.301945    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-workload-socket\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.302162 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.301978    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-workload-certs\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.302162 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.302081    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-token\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.302162 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.302127    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-credential-socket\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.302433 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.302164    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x7cb\" (UniqueName: \"kubernetes.io/projected/188b4a57-26c1-44ef-bf79-6e2897f45e2a-kube-api-access-6x7cb\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.302433 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.302205    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-envoy\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.403618 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.403583    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-data\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.403837 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.403772    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-podinfo\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.403837 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.403833    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istiod-ca-cert\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.403968 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.403897    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-workload-socket\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.403968 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.403932    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-workload-certs\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.404066 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.404012    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-data\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.404066 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.404039    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-token\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.404170 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.404094    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-credential-socket\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.404170 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.404131    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x7cb\" (UniqueName: \"kubernetes.io/projected/188b4a57-26c1-44ef-bf79-6e2897f45e2a-kube-api-access-6x7cb\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.404170 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.404174    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-envoy\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.404398 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.404278    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-workload-socket\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.404821 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.404749    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-credential-socket\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.404821 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.404782    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istiod-ca-cert\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.404975 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.404933    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-workload-certs\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.407051 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.407021    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-envoy\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.407259 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.407208    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-podinfo\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.411991 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.411968    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x7cb\" (UniqueName: \"kubernetes.io/projected/188b4a57-26c1-44ef-bf79-6e2897f45e2a-kube-api-access-6x7cb\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.412083 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.412062    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-token\") pod \"e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") " pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.599746 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.599714    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:13.826729 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.826700    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"
Oct 31 00:48:13.888096 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.888022    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"]
Oct 31 00:48:13.894468 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:48:13.894436    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod188b4a57_26c1_44ef_bf79_6e2897f45e2a.slice/crio-3c6fb0dd5c1802466369055ca8fe193644e851050cdc52f7ad3adc7c496eacce WatchSource:0}: Error finding container 3c6fb0dd5c1802466369055ca8fe193644e851050cdc52f7ad3adc7c496eacce: Status 404 returned error can't find the container with id 3c6fb0dd5c1802466369055ca8fe193644e851050cdc52f7ad3adc7c496eacce
Oct 31 00:48:13.898021 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.897984    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:48:13.898234 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.898198    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:48:13.898354 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.898268    5946 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236068Ki","pods":"250"}
Oct 31 00:48:13.914466 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.914446    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/bed92ef5-059c-49d2-832f-f0af407f26f6-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bed92ef5-059c-49d2-832f-f0af407f26f6-openshift-service-ca\") pod \"bed92ef5-059c-49d2-832f-f0af407f26f6\" (UID: \"bed92ef5-059c-49d2-832f-f0af407f26f6\") "
Oct 31 00:48:13.914574 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.914532    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bed92ef5-059c-49d2-832f-f0af407f26f6-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bed92ef5-059c-49d2-832f-f0af407f26f6-maas-api-tls\") pod \"bed92ef5-059c-49d2-832f-f0af407f26f6\" (UID: \"bed92ef5-059c-49d2-832f-f0af407f26f6\") "
Oct 31 00:48:13.914574 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.914570    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/bed92ef5-059c-49d2-832f-f0af407f26f6-metrics-certs\" (UniqueName: \"kubernetes.io/secret/bed92ef5-059c-49d2-832f-f0af407f26f6-metrics-certs\") pod \"bed92ef5-059c-49d2-832f-f0af407f26f6\" (UID: \"bed92ef5-059c-49d2-832f-f0af407f26f6\") "
Oct 31 00:48:13.914642 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.914627    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/bed92ef5-059c-49d2-832f-f0af407f26f6-kube-api-access-fkdjj\" (UniqueName: \"kubernetes.io/projected/bed92ef5-059c-49d2-832f-f0af407f26f6-kube-api-access-fkdjj\") pod \"bed92ef5-059c-49d2-832f-f0af407f26f6\" (UID: \"bed92ef5-059c-49d2-832f-f0af407f26f6\") "
Oct 31 00:48:13.914792 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.914766    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bed92ef5-059c-49d2-832f-f0af407f26f6-openshift-service-ca" pod "bed92ef5-059c-49d2-832f-f0af407f26f6" (UID: "bed92ef5-059c-49d2-832f-f0af407f26f6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:13.915205 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.915184    5946 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bed92ef5-059c-49d2-832f-f0af407f26f6-openshift-service-ca\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:13.917023 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.916997    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bed92ef5-059c-49d2-832f-f0af407f26f6-kube-api-access-fkdjj" pod "bed92ef5-059c-49d2-832f-f0af407f26f6" (UID: "bed92ef5-059c-49d2-832f-f0af407f26f6"). InnerVolumeSpecName "kube-api-access-fkdjj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:13.917147 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.917128    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bed92ef5-059c-49d2-832f-f0af407f26f6-maas-api-tls" pod "bed92ef5-059c-49d2-832f-f0af407f26f6" (UID: "bed92ef5-059c-49d2-832f-f0af407f26f6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:48:13.917198 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:13.917155    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bed92ef5-059c-49d2-832f-f0af407f26f6-metrics-certs" pod "bed92ef5-059c-49d2-832f-f0af407f26f6" (UID: "bed92ef5-059c-49d2-832f-f0af407f26f6"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:48:14.018133 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:14.018092    5946 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bed92ef5-059c-49d2-832f-f0af407f26f6-metrics-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:14.018133 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:14.018134    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fkdjj\" (UniqueName: \"kubernetes.io/projected/bed92ef5-059c-49d2-832f-f0af407f26f6-kube-api-access-fkdjj\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:14.018417 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:14.018149    5946 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bed92ef5-059c-49d2-832f-f0af407f26f6-maas-api-tls\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:14.079009 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:14.078946    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2" event={"ID":"188b4a57-26c1-44ef-bf79-6e2897f45e2a","Type":"ContainerStarted","Data":"66a4ab003afc60fa76026582f8d6df33c24d61266d11c8e2888c754237a10452"}
Oct 31 00:48:14.079313 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:14.079022    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2" event={"ID":"188b4a57-26c1-44ef-bf79-6e2897f45e2a","Type":"ContainerStarted","Data":"3c6fb0dd5c1802466369055ca8fe193644e851050cdc52f7ad3adc7c496eacce"}
Oct 31 00:48:14.081051 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:14.081013    5946 generic.go:356] "Generic (PLEG): container finished" podID="bed92ef5-059c-49d2-832f-f0af407f26f6" containerID="50e5da50e1b5950def20e2530e168b7f47b43947da0c321a98a9ecd3259980e7" exitCode=0
Oct 31 00:48:14.081177 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:14.081053    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"
Oct 31 00:48:14.081177 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:14.081096    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t" event={"ID":"bed92ef5-059c-49d2-832f-f0af407f26f6","Type":"ContainerDied","Data":"50e5da50e1b5950def20e2530e168b7f47b43947da0c321a98a9ecd3259980e7"}
Oct 31 00:48:14.081177 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:14.081162    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t" event={"ID":"bed92ef5-059c-49d2-832f-f0af407f26f6","Type":"ContainerDied","Data":"27f9ed6aac38bf6cb33dc920b484776d708366365f28263d9fdb4721f4175fca"}
Oct 31 00:48:14.081423 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:14.081191    5946 scope.go:122] "RemoveContainer" containerID="50e5da50e1b5950def20e2530e168b7f47b43947da0c321a98a9ecd3259980e7"
Oct 31 00:48:14.098290 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:14.098265    5946 scope.go:122] "RemoveContainer" containerID="50e5da50e1b5950def20e2530e168b7f47b43947da0c321a98a9ecd3259980e7"
Oct 31 00:48:14.098716 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:48:14.098685    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"50e5da50e1b5950def20e2530e168b7f47b43947da0c321a98a9ecd3259980e7\": container with ID starting with 50e5da50e1b5950def20e2530e168b7f47b43947da0c321a98a9ecd3259980e7 not found: ID does not exist" containerID="50e5da50e1b5950def20e2530e168b7f47b43947da0c321a98a9ecd3259980e7"
Oct 31 00:48:14.098818 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:14.098727    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"50e5da50e1b5950def20e2530e168b7f47b43947da0c321a98a9ecd3259980e7"} err="failed to get container status \"50e5da50e1b5950def20e2530e168b7f47b43947da0c321a98a9ecd3259980e7\": rpc error: code = NotFound desc = could not find container \"50e5da50e1b5950def20e2530e168b7f47b43947da0c321a98a9ecd3259980e7\": container with ID starting with 50e5da50e1b5950def20e2530e168b7f47b43947da0c321a98a9ecd3259980e7 not found: ID does not exist"
Oct 31 00:48:14.106403 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:14.106351    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2" podStartSLOduration=1.106333281 podStartE2EDuration="1.106333281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:48:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:48:14.099665072 +0000 UTC m=+835.172705177" watchObservedRunningTime="2026-10-31 00:48:14.106333281 +0000 UTC m=+835.179373433"
Oct 31 00:48:14.133801 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:14.133768    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"]
Oct 31 00:48:14.133959 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:14.133820    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w6-47f370-7c6df568c8-6vq4t"]
Oct 31 00:48:14.602000 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:14.601968    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:14.602563 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:14.602515    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 31 00:48:14.602792 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:14.602760    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2" podUID="188b4a57-26c1-44ef-bf79-6e2897f45e2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 31 00:48:15.075085 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:15.075051    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bed92ef5-059c-49d2-832f-f0af407f26f6" path="/var/lib/kubelet/pods/bed92ef5-059c-49d2-832f-f0af407f26f6/volumes"
Oct 31 00:48:15.601081 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:15.601042    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 31 00:48:15.601256 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:15.601090    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2" podUID="188b4a57-26c1-44ef-bf79-6e2897f45e2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 31 00:48:16.502989 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:16.502959    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:48:16.601166 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:16.601132    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 31 00:48:16.601357 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:16.601187    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2" podUID="188b4a57-26c1-44ef-bf79-6e2897f45e2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 31 00:48:17.605243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:17.603599    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 31 00:48:17.605243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:17.603676    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2" podUID="188b4a57-26c1-44ef-bf79-6e2897f45e2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 31 00:48:18.602684 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:18.602644    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 31 00:48:18.604291 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:18.604255    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2" podUID="188b4a57-26c1-44ef-bf79-6e2897f45e2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 31 00:48:19.658411 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:19.658371    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 31 00:48:19.658929 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:19.658437    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2" podUID="188b4a57-26c1-44ef-bf79-6e2897f45e2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 31 00:48:20.623247 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:20.605030    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 31 00:48:20.623247 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:20.605132    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2" podUID="188b4a57-26c1-44ef-bf79-6e2897f45e2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 31 00:48:20.835524 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:20.835478    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh" podUID="8e9eecae-26a9-4cba-96c0-6e926d854027" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:48:20.939300 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:20.931358    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:48:20.939300 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:20.931424    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk" podUID="b097de73-6eef-4c19-88b4-77315c8b84fe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:48:21.867140 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:21.867093    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh" podUID="8e9eecae-26a9-4cba-96c0-6e926d854027" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:48:21.909480 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:21.909443    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 31 00:48:21.909838 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:21.909805    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2" podUID="188b4a57-26c1-44ef-bf79-6e2897f45e2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 31 00:48:21.912004 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:21.911984    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:48:22.040289 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.026963    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd" podUID="ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": context deadline exceeded"
Oct 31 00:48:22.141310 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.119097    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"]
Oct 31 00:48:22.191747 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.191676    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp" podUID="1626bf4d-1329-4475-85a5-3939af3db878" containerName="istio-proxy" containerID="cri-o://45d24f5394c204c0215aff6f56767246e28d2df89c6bed282987b2ed9ac1f8c6" gracePeriod=30
Oct 31 00:48:22.347545 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.347504    5946 patch_prober.go:29] interesting pod/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:48:22.347827 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.347792    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g" podUID="6f1f21c9-c572-4c8c-8368-ff74ff058804" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:48:22.411610 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.410699    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="llm/e2e-trlp-test-simulated-kserve-69b588897d-zc8dd" podUID="3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597" containerName="main" probeResult="failure" output="Get \"https://10.134.0.42:8000/ready\": context deadline exceeded"
Oct 31 00:48:22.422282 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.419766    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:48:22.422282 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.419821    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4" podUID="d477e0c1-fc81-4087-a694-3a2e41433050" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:48:22.449207 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.449177    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"]
Oct 31 00:48:22.455968 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.455905    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk" podUID="b097de73-6eef-4c19-88b4-77315c8b84fe" containerName="istio-proxy" containerID="cri-o://d4eea465542207f8da50edf8407a50b474a159d02b1fad319f88ef743d6285af" gracePeriod=30
Oct 31 00:48:22.490446 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.470306    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"]
Oct 31 00:48:22.490902 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.490869    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542" podUID="afc79d7c-316a-4546-afdb-06f3b6958755" containerName="istio-proxy" containerID="cri-o://a0f5020a7fc34c713fa9555868a7bcdd00b2a128b9497ab8708b104a75326d47" gracePeriod=30
Oct 31 00:48:22.570165 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.564610    5946 prober.go:122] "Probe failed" probeType="Liveness" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh" podUID="8e9eecae-26a9-4cba-96c0-6e926d854027" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/health\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:48:22.626673 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.614312    5946 patch_prober.go:29] interesting pod/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:48:22.626673 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.614388    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77" podUID="b77a849b-33f4-4a27-aaf5-45475b017feb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.75:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:48:22.626673 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.625506    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 31 00:48:22.626673 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.625556    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2" podUID="188b4a57-26c1-44ef-bf79-6e2897f45e2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 31 00:48:22.873205 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.872433    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh" podUID="8e9eecae-26a9-4cba-96c0-6e926d854027" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:48:22.976304 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:22.976259    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf" podUID="30197b12-e066-43b4-b920-c1757b9516ce" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:48:23.044345 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:23.036323    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd" podUID="ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" containerName="main" probeResult="failure" output="Get \"https://10.134.0.70:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:48:23.044345 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:23.036813    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:48:23.380240 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:23.365947    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:48:23.380801 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:23.380498    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:48:23.380801 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:23.380558    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542" podUID="afc79d7c-316a-4546-afdb-06f3b6958755" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:48:23.413642 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:23.413614    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:48:23.600566 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:23.600496    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused" start-of-body=
Oct 31 00:48:23.600914 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:23.600879    5946 prober.go:122] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2" podUID="188b4a57-26c1-44ef-bf79-6e2897f45e2a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.79:15021/healthz/ready\": dial tcp 10.134.0.79:15021: connect: connection refused"
Oct 31 00:48:23.678836 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:23.676989    5946 patch_prober.go:29] interesting pod/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:48:23.678836 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:23.677053    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp" podUID="1626bf4d-1329-4475-85a5-3939af3db878" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:48:24.032257 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.032122    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd" podUID="ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" containerName="main" containerID="cri-o://a64e8db8f4972e53bc5e74a9053b561a12e5e022323247729b359e825f6db42a" gracePeriod=45
Oct 31 00:48:24.358519 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.358487    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:48:24.440804 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.440757    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-home\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-home\") pod \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") "
Oct 31 00:48:24.440994 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.440860    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-dshm\") pod \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") "
Oct 31 00:48:24.440994 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.440936    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-kube-api-access-jxbf2\" (UniqueName: \"kubernetes.io/projected/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-kube-api-access-jxbf2\") pod \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") "
Oct 31 00:48:24.441121 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.441004    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-model-cache\") pod \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") "
Oct 31 00:48:24.441121 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.441058    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-tmp-dir\") pod \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") "
Oct 31 00:48:24.441121 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.441088    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-tls-certs\" (UniqueName: \"kubernetes.io/secret/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-tls-certs\") pod \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\" (UID: \"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc\") "
Oct 31 00:48:24.447170 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.446892    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-home" pod "ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" (UID: "ad5db0b6-de09-4ba1-b5f4-6fe953615ecc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:24.447170 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.447085    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-tmp-dir" pod "ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" (UID: "ad5db0b6-de09-4ba1-b5f4-6fe953615ecc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:24.447170 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.447146    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-model-cache" pod "ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" (UID: "ad5db0b6-de09-4ba1-b5f4-6fe953615ecc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:24.449365 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.449333    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-tls-certs" pod "ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" (UID: "ad5db0b6-de09-4ba1-b5f4-6fe953615ecc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:48:24.461039 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.460960    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-kube-api-access-jxbf2" pod "ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" (UID: "ad5db0b6-de09-4ba1-b5f4-6fe953615ecc"). InnerVolumeSpecName "kube-api-access-jxbf2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:24.461039 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.461017    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-dshm" pod "ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" (UID: "ad5db0b6-de09-4ba1-b5f4-6fe953615ecc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:24.474725 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.474343    5946 generic.go:356] "Generic (PLEG): container finished" podID="ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" containerID="a64e8db8f4972e53bc5e74a9053b561a12e5e022323247729b359e825f6db42a" exitCode=0
Oct 31 00:48:24.475987 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.475950    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd" event={"ID":"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc","Type":"ContainerDied","Data":"a64e8db8f4972e53bc5e74a9053b561a12e5e022323247729b359e825f6db42a"}
Oct 31 00:48:24.476119 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.476011    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd" event={"ID":"ad5db0b6-de09-4ba1-b5f4-6fe953615ecc","Type":"ContainerDied","Data":"6e2476f642588de1bbc4b789f2ec1eb898fa80bfde3ece4396dbe7232b93fa80"}
Oct 31 00:48:24.480473 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.477091    5946 scope.go:122] "RemoveContainer" containerID="a64e8db8f4972e53bc5e74a9053b561a12e5e022323247729b359e825f6db42a"
Oct 31 00:48:24.481272 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.480667    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"
Oct 31 00:48:24.504079 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.503979    5946 scope.go:122] "RemoveContainer" containerID="a64e8db8f4972e53bc5e74a9053b561a12e5e022323247729b359e825f6db42a"
Oct 31 00:48:24.504467 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:48:24.504376    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a64e8db8f4972e53bc5e74a9053b561a12e5e022323247729b359e825f6db42a\": container with ID starting with a64e8db8f4972e53bc5e74a9053b561a12e5e022323247729b359e825f6db42a not found: ID does not exist" containerID="a64e8db8f4972e53bc5e74a9053b561a12e5e022323247729b359e825f6db42a"
Oct 31 00:48:24.504467 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.504418    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a64e8db8f4972e53bc5e74a9053b561a12e5e022323247729b359e825f6db42a"} err="failed to get container status \"a64e8db8f4972e53bc5e74a9053b561a12e5e022323247729b359e825f6db42a\": rpc error: code = NotFound desc = could not find container \"a64e8db8f4972e53bc5e74a9053b561a12e5e022323247729b359e825f6db42a\": container with ID starting with a64e8db8f4972e53bc5e74a9053b561a12e5e022323247729b359e825f6db42a not found: ID does not exist"
Oct 31 00:48:24.537688 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.537655    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"]
Oct 31 00:48:24.543291 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.543258    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxbf2\" (UniqueName: \"kubernetes.io/projected/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-kube-api-access-jxbf2\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:24.543291 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.543290    5946 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-model-cache\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:24.543471 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.543306    5946 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-tmp-dir\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:24.543471 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.543318    5946 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-tls-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:24.543471 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.543330    5946 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-home\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:24.543471 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.543342    5946 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc-dshm\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:24.545506 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:24.545481    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w1-7f1496/distinct-2-w1-7f1496-kserve-55d8b56f8d-h25wd"]
Oct 31 00:48:25.064391 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:25.064354    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" path="/var/lib/kubelet/pods/ad5db0b6-de09-4ba1-b5f4-6fe953615ecc/volumes"
Oct 31 00:48:25.223457 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:25.223425    5946 kubelet.go:2727] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:25.225116 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:25.225089    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:25.225926 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:25.225904    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:48:26.497243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:26.497146    5946 generic.go:356] "Generic (PLEG): container finished" podID="30197b12-e066-43b4-b920-c1757b9516ce" containerID="241b5a59980fffdac4e0fed21bf31dec936876360eaeaf25548e4b5596adae57" exitCode=0
Oct 31 00:48:26.503313 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:26.498203    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf" event={"ID":"30197b12-e066-43b4-b920-c1757b9516ce","Type":"ContainerDied","Data":"241b5a59980fffdac4e0fed21bf31dec936876360eaeaf25548e4b5596adae57"}
Oct 31 00:48:26.547635 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:26.547607    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf"
Oct 31 00:48:26.686194 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:26.685703    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/30197b12-e066-43b4-b920-c1757b9516ce-kube-api-access-2mm69\" (UniqueName: \"kubernetes.io/projected/30197b12-e066-43b4-b920-c1757b9516ce-kube-api-access-2mm69\") pod \"30197b12-e066-43b4-b920-c1757b9516ce\" (UID: \"30197b12-e066-43b4-b920-c1757b9516ce\") "
Oct 31 00:48:26.686194 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:26.685979    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/30197b12-e066-43b4-b920-c1757b9516ce-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30197b12-e066-43b4-b920-c1757b9516ce-plugins-config-volume\") pod \"30197b12-e066-43b4-b920-c1757b9516ce\" (UID: \"30197b12-e066-43b4-b920-c1757b9516ce\") "
Oct 31 00:48:26.690248 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:26.689601    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30197b12-e066-43b4-b920-c1757b9516ce-plugins-config-volume" pod "30197b12-e066-43b4-b920-c1757b9516ce" (UID: "30197b12-e066-43b4-b920-c1757b9516ce"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:26.692971 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:26.692938    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30197b12-e066-43b4-b920-c1757b9516ce-kube-api-access-2mm69" pod "30197b12-e066-43b4-b920-c1757b9516ce" (UID: "30197b12-e066-43b4-b920-c1757b9516ce"). InnerVolumeSpecName "kube-api-access-2mm69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:26.788706 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:26.788673    5946 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30197b12-e066-43b4-b920-c1757b9516ce-plugins-config-volume\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:26.788706 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:26.788702    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mm69\" (UniqueName: \"kubernetes.io/projected/30197b12-e066-43b4-b920-c1757b9516ce-kube-api-access-2mm69\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:27.109504 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.109462    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"]
Oct 31 00:48:27.109801 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.109771    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v" podUID="53825390-1f0f-4b49-9e59-b224c39aaf62" containerName="maas-api" containerID="cri-o://b7768b3387c9a38ad19fe664438ec76a89b12ccf5c41f6ce577840ea341ba44a" gracePeriod=30
Oct 31 00:48:27.307732 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.307706    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"]
Oct 31 00:48:27.308088 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.308060    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt" podUID="c6595fa5-8566-4e13-8d16-d818383d84d0" containerName="maas-api" containerID="cri-o://dcbad80e34184cef5d368fee9187eb12c55eeb96cda7a67633819cc8b83a0996" gracePeriod=30
Oct 31 00:48:27.460256 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.455232    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"
Oct 31 00:48:27.506919 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.506167    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/53825390-1f0f-4b49-9e59-b224c39aaf62-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53825390-1f0f-4b49-9e59-b224c39aaf62-openshift-service-ca\") pod \"53825390-1f0f-4b49-9e59-b224c39aaf62\" (UID: \"53825390-1f0f-4b49-9e59-b224c39aaf62\") "
Oct 31 00:48:27.506919 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.506203    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/53825390-1f0f-4b49-9e59-b224c39aaf62-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53825390-1f0f-4b49-9e59-b224c39aaf62-maas-api-tls\") pod \"53825390-1f0f-4b49-9e59-b224c39aaf62\" (UID: \"53825390-1f0f-4b49-9e59-b224c39aaf62\") "
Oct 31 00:48:27.506919 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.506454    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/53825390-1f0f-4b49-9e59-b224c39aaf62-kube-api-access-xffh7\" (UniqueName: \"kubernetes.io/projected/53825390-1f0f-4b49-9e59-b224c39aaf62-kube-api-access-xffh7\") pod \"53825390-1f0f-4b49-9e59-b224c39aaf62\" (UID: \"53825390-1f0f-4b49-9e59-b224c39aaf62\") "
Oct 31 00:48:27.506919 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.506497    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/53825390-1f0f-4b49-9e59-b224c39aaf62-metrics-certs\" (UniqueName: \"kubernetes.io/secret/53825390-1f0f-4b49-9e59-b224c39aaf62-metrics-certs\") pod \"53825390-1f0f-4b49-9e59-b224c39aaf62\" (UID: \"53825390-1f0f-4b49-9e59-b224c39aaf62\") "
Oct 31 00:48:27.506919 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.506651    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53825390-1f0f-4b49-9e59-b224c39aaf62-openshift-service-ca" pod "53825390-1f0f-4b49-9e59-b224c39aaf62" (UID: "53825390-1f0f-4b49-9e59-b224c39aaf62"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:27.507457 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.507071    5946 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53825390-1f0f-4b49-9e59-b224c39aaf62-openshift-service-ca\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:27.520100 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.518439    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53825390-1f0f-4b49-9e59-b224c39aaf62-kube-api-access-xffh7" pod "53825390-1f0f-4b49-9e59-b224c39aaf62" (UID: "53825390-1f0f-4b49-9e59-b224c39aaf62"). InnerVolumeSpecName "kube-api-access-xffh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:27.520100 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.518546    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53825390-1f0f-4b49-9e59-b224c39aaf62-maas-api-tls" pod "53825390-1f0f-4b49-9e59-b224c39aaf62" (UID: "53825390-1f0f-4b49-9e59-b224c39aaf62"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:48:27.520100 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.518628    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53825390-1f0f-4b49-9e59-b224c39aaf62-metrics-certs" pod "53825390-1f0f-4b49-9e59-b224c39aaf62" (UID: "53825390-1f0f-4b49-9e59-b224c39aaf62"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:48:27.553638 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.550521    5946 generic.go:356] "Generic (PLEG): container finished" podID="1626bf4d-1329-4475-85a5-3939af3db878" containerID="45d24f5394c204c0215aff6f56767246e28d2df89c6bed282987b2ed9ac1f8c6" exitCode=0
Oct 31 00:48:27.553638 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.550654    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp" event={"ID":"1626bf4d-1329-4475-85a5-3939af3db878","Type":"ContainerDied","Data":"45d24f5394c204c0215aff6f56767246e28d2df89c6bed282987b2ed9ac1f8c6"}
Oct 31 00:48:27.553638 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.553516    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf"
Oct 31 00:48:27.554050 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.553691    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf" event={"ID":"30197b12-e066-43b4-b920-c1757b9516ce","Type":"ContainerDied","Data":"0a3b784a3b66a841b9a73791ed4710ca04707d8a5f2aeb498852bba051083c1d"}
Oct 31 00:48:27.554050 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.553770    5946 scope.go:122] "RemoveContainer" containerID="241b5a59980fffdac4e0fed21bf31dec936876360eaeaf25548e4b5596adae57"
Oct 31 00:48:27.557422 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.557358    5946 generic.go:356] "Generic (PLEG): container finished" podID="c6595fa5-8566-4e13-8d16-d818383d84d0" containerID="dcbad80e34184cef5d368fee9187eb12c55eeb96cda7a67633819cc8b83a0996" exitCode=0
Oct 31 00:48:27.557530 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.557418    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt" event={"ID":"c6595fa5-8566-4e13-8d16-d818383d84d0","Type":"ContainerDied","Data":"dcbad80e34184cef5d368fee9187eb12c55eeb96cda7a67633819cc8b83a0996"}
Oct 31 00:48:27.562571 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.562547    5946 generic.go:356] "Generic (PLEG): container finished" podID="53825390-1f0f-4b49-9e59-b224c39aaf62" containerID="b7768b3387c9a38ad19fe664438ec76a89b12ccf5c41f6ce577840ea341ba44a" exitCode=0
Oct 31 00:48:27.562675 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.562587    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v" event={"ID":"53825390-1f0f-4b49-9e59-b224c39aaf62","Type":"ContainerDied","Data":"b7768b3387c9a38ad19fe664438ec76a89b12ccf5c41f6ce577840ea341ba44a"}
Oct 31 00:48:27.562675 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.562617    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v" event={"ID":"53825390-1f0f-4b49-9e59-b224c39aaf62","Type":"ContainerDied","Data":"c26540d0b0c6205eccfb26f6a2ee3461d86379ddd66ad8a500c131e8820676ad"}
Oct 31 00:48:27.562744 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.562678    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"
Oct 31 00:48:27.627932 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.627889    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xffh7\" (UniqueName: \"kubernetes.io/projected/53825390-1f0f-4b49-9e59-b224c39aaf62-kube-api-access-xffh7\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:27.628162 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.628133    5946 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53825390-1f0f-4b49-9e59-b224c39aaf62-metrics-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:27.628276 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.628265    5946 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53825390-1f0f-4b49-9e59-b224c39aaf62-maas-api-tls\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:27.684255 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.679481    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"]
Oct 31 00:48:27.741719 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.741688    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w3-1d4a7e-8547dbc684-2hz4v"]
Oct 31 00:48:27.747110 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.747081    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf"]
Oct 31 00:48:27.752447 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.752398    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w6-47f370-6d78d7fd67-lfwgf"]
Oct 31 00:48:27.825202 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.825175    5946 scope.go:122] "RemoveContainer" containerID="b7768b3387c9a38ad19fe664438ec76a89b12ccf5c41f6ce577840ea341ba44a"
Oct 31 00:48:27.841103 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.839512    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:48:27.841103 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.840537    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-credential-socket\") pod \"1626bf4d-1329-4475-85a5-3939af3db878\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") "
Oct 31 00:48:27.841103 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.840585    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-istio-envoy\") pod \"1626bf4d-1329-4475-85a5-3939af3db878\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") "
Oct 31 00:48:27.841103 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.840605    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-istio-data\") pod \"1626bf4d-1329-4475-85a5-3939af3db878\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") "
Oct 31 00:48:27.841103 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.840663    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-workload-certs\") pod \"1626bf4d-1329-4475-85a5-3939af3db878\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") "
Oct 31 00:48:27.841103 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.840692    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1626bf4d-1329-4475-85a5-3939af3db878-istio-token\" (UniqueName: \"kubernetes.io/projected/1626bf4d-1329-4475-85a5-3939af3db878-istio-token\") pod \"1626bf4d-1329-4475-85a5-3939af3db878\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") "
Oct 31 00:48:27.841103 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.840759    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/1626bf4d-1329-4475-85a5-3939af3db878-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1626bf4d-1329-4475-85a5-3939af3db878-istio-podinfo\") pod \"1626bf4d-1329-4475-85a5-3939af3db878\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") "
Oct 31 00:48:27.841103 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.840840    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-workload-socket\") pod \"1626bf4d-1329-4475-85a5-3939af3db878\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") "
Oct 31 00:48:27.841103 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.840880    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/1626bf4d-1329-4475-85a5-3939af3db878-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1626bf4d-1329-4475-85a5-3939af3db878-istiod-ca-cert\") pod \"1626bf4d-1329-4475-85a5-3939af3db878\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") "
Oct 31 00:48:27.841103 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.840947    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/1626bf4d-1329-4475-85a5-3939af3db878-kube-api-access-4tf2p\" (UniqueName: \"kubernetes.io/projected/1626bf4d-1329-4475-85a5-3939af3db878-kube-api-access-4tf2p\") pod \"1626bf4d-1329-4475-85a5-3939af3db878\" (UID: \"1626bf4d-1329-4475-85a5-3939af3db878\") "
Oct 31 00:48:27.841765 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.841117    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-workload-certs" pod "1626bf4d-1329-4475-85a5-3939af3db878" (UID: "1626bf4d-1329-4475-85a5-3939af3db878"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:27.841765 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.841382    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-credential-socket" pod "1626bf4d-1329-4475-85a5-3939af3db878" (UID: "1626bf4d-1329-4475-85a5-3939af3db878"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:27.842505 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.842489    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:27.842632 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.842619    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:27.844077 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.843626    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-workload-socket" pod "1626bf4d-1329-4475-85a5-3939af3db878" (UID: "1626bf4d-1329-4475-85a5-3939af3db878"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:27.844077 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.843821    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-istio-data" pod "1626bf4d-1329-4475-85a5-3939af3db878" (UID: "1626bf4d-1329-4475-85a5-3939af3db878"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:27.844077 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.843975    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1626bf4d-1329-4475-85a5-3939af3db878-istiod-ca-cert" pod "1626bf4d-1329-4475-85a5-3939af3db878" (UID: "1626bf4d-1329-4475-85a5-3939af3db878"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:27.845233 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.845149    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-istio-envoy" pod "1626bf4d-1329-4475-85a5-3939af3db878" (UID: "1626bf4d-1329-4475-85a5-3939af3db878"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:27.851827 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.851790    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1626bf4d-1329-4475-85a5-3939af3db878-istio-token" pod "1626bf4d-1329-4475-85a5-3939af3db878" (UID: "1626bf4d-1329-4475-85a5-3939af3db878"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:27.852494 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.852462    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1626bf4d-1329-4475-85a5-3939af3db878-kube-api-access-4tf2p" pod "1626bf4d-1329-4475-85a5-3939af3db878" (UID: "1626bf4d-1329-4475-85a5-3939af3db878"). InnerVolumeSpecName "kube-api-access-4tf2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:27.860611 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.860542    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1626bf4d-1329-4475-85a5-3939af3db878-istio-podinfo" pod "1626bf4d-1329-4475-85a5-3939af3db878" (UID: "1626bf4d-1329-4475-85a5-3939af3db878"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:48:27.867480 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.867393    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"
Oct 31 00:48:27.901184 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.901148    5946 scope.go:122] "RemoveContainer" containerID="b7768b3387c9a38ad19fe664438ec76a89b12ccf5c41f6ce577840ea341ba44a"
Oct 31 00:48:27.902643 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:48:27.902612    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7768b3387c9a38ad19fe664438ec76a89b12ccf5c41f6ce577840ea341ba44a\": container with ID starting with b7768b3387c9a38ad19fe664438ec76a89b12ccf5c41f6ce577840ea341ba44a not found: ID does not exist" containerID="b7768b3387c9a38ad19fe664438ec76a89b12ccf5c41f6ce577840ea341ba44a"
Oct 31 00:48:27.902763 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.902657    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7768b3387c9a38ad19fe664438ec76a89b12ccf5c41f6ce577840ea341ba44a"} err="failed to get container status \"b7768b3387c9a38ad19fe664438ec76a89b12ccf5c41f6ce577840ea341ba44a\": rpc error: code = NotFound desc = could not find container \"b7768b3387c9a38ad19fe664438ec76a89b12ccf5c41f6ce577840ea341ba44a\": container with ID starting with b7768b3387c9a38ad19fe664438ec76a89b12ccf5c41f6ce577840ea341ba44a not found: ID does not exist"
Oct 31 00:48:27.944142 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.944109    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c6595fa5-8566-4e13-8d16-d818383d84d0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6595fa5-8566-4e13-8d16-d818383d84d0-metrics-certs\") pod \"c6595fa5-8566-4e13-8d16-d818383d84d0\" (UID: \"c6595fa5-8566-4e13-8d16-d818383d84d0\") "
Oct 31 00:48:27.944394 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.944378    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/c6595fa5-8566-4e13-8d16-d818383d84d0-kube-api-access-6l9jj\" (UniqueName: \"kubernetes.io/projected/c6595fa5-8566-4e13-8d16-d818383d84d0-kube-api-access-6l9jj\") pod \"c6595fa5-8566-4e13-8d16-d818383d84d0\" (UID: \"c6595fa5-8566-4e13-8d16-d818383d84d0\") "
Oct 31 00:48:27.944564 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.944549    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/c6595fa5-8566-4e13-8d16-d818383d84d0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6595fa5-8566-4e13-8d16-d818383d84d0-openshift-service-ca\") pod \"c6595fa5-8566-4e13-8d16-d818383d84d0\" (UID: \"c6595fa5-8566-4e13-8d16-d818383d84d0\") "
Oct 31 00:48:27.944674 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.944660    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/c6595fa5-8566-4e13-8d16-d818383d84d0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6595fa5-8566-4e13-8d16-d818383d84d0-maas-api-tls\") pod \"c6595fa5-8566-4e13-8d16-d818383d84d0\" (UID: \"c6595fa5-8566-4e13-8d16-d818383d84d0\") "
Oct 31 00:48:27.945482 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.945459    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:27.945599 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.945587    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:27.945689 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.945677    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1626bf4d-1329-4475-85a5-3939af3db878-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:27.945776 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.945764    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1626bf4d-1329-4475-85a5-3939af3db878-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:27.945857 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.945845    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1626bf4d-1329-4475-85a5-3939af3db878-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:27.945940 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.945930    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1626bf4d-1329-4475-85a5-3939af3db878-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:27.946010 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.946001    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tf2p\" (UniqueName: \"kubernetes.io/projected/1626bf4d-1329-4475-85a5-3939af3db878-kube-api-access-4tf2p\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:27.946213 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.946189    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6595fa5-8566-4e13-8d16-d818383d84d0-openshift-service-ca" pod "c6595fa5-8566-4e13-8d16-d818383d84d0" (UID: "c6595fa5-8566-4e13-8d16-d818383d84d0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:27.947105 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.947082    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6595fa5-8566-4e13-8d16-d818383d84d0-maas-api-tls" pod "c6595fa5-8566-4e13-8d16-d818383d84d0" (UID: "c6595fa5-8566-4e13-8d16-d818383d84d0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:48:27.948711 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.948681    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c6595fa5-8566-4e13-8d16-d818383d84d0-metrics-certs" pod "c6595fa5-8566-4e13-8d16-d818383d84d0" (UID: "c6595fa5-8566-4e13-8d16-d818383d84d0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:48:27.949200 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:27.949182    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c6595fa5-8566-4e13-8d16-d818383d84d0-kube-api-access-6l9jj" pod "c6595fa5-8566-4e13-8d16-d818383d84d0" (UID: "c6595fa5-8566-4e13-8d16-d818383d84d0"). InnerVolumeSpecName "kube-api-access-6l9jj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:28.048009 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.047975    5946 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c6595fa5-8566-4e13-8d16-d818383d84d0-metrics-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.048187 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.048042    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6l9jj\" (UniqueName: \"kubernetes.io/projected/c6595fa5-8566-4e13-8d16-d818383d84d0-kube-api-access-6l9jj\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.048187 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.048058    5946 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6595fa5-8566-4e13-8d16-d818383d84d0-openshift-service-ca\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.048187 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.048071    5946 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c6595fa5-8566-4e13-8d16-d818383d84d0-maas-api-tls\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.099583 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.099495    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:48:28.148830 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.148788    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/afc79d7c-316a-4546-afdb-06f3b6958755-istio-token\" (UniqueName: \"kubernetes.io/projected/afc79d7c-316a-4546-afdb-06f3b6958755-istio-token\") pod \"afc79d7c-316a-4546-afdb-06f3b6958755\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") "
Oct 31 00:48:28.149508 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.149487    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/afc79d7c-316a-4546-afdb-06f3b6958755-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afc79d7c-316a-4546-afdb-06f3b6958755-istiod-ca-cert\") pod \"afc79d7c-316a-4546-afdb-06f3b6958755\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") "
Oct 31 00:48:28.150171 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.150144    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/afc79d7c-316a-4546-afdb-06f3b6958755-kube-api-access-c8g99\" (UniqueName: \"kubernetes.io/projected/afc79d7c-316a-4546-afdb-06f3b6958755-kube-api-access-c8g99\") pod \"afc79d7c-316a-4546-afdb-06f3b6958755\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") "
Oct 31 00:48:28.150390 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.150003    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/afc79d7c-316a-4546-afdb-06f3b6958755-istiod-ca-cert" pod "afc79d7c-316a-4546-afdb-06f3b6958755" (UID: "afc79d7c-316a-4546-afdb-06f3b6958755"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:28.150610 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.150591    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/afc79d7c-316a-4546-afdb-06f3b6958755-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afc79d7c-316a-4546-afdb-06f3b6958755-istio-podinfo\") pod \"afc79d7c-316a-4546-afdb-06f3b6958755\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") "
Oct 31 00:48:28.150771 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.150756    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-istio-data\") pod \"afc79d7c-316a-4546-afdb-06f3b6958755\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") "
Oct 31 00:48:28.151260 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.151129    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-istio-data" pod "afc79d7c-316a-4546-afdb-06f3b6958755" (UID: "afc79d7c-316a-4546-afdb-06f3b6958755"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:28.151414 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.151399    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-istio-envoy\") pod \"afc79d7c-316a-4546-afdb-06f3b6958755\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") "
Oct 31 00:48:28.151837 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.151818    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-workload-socket\") pod \"afc79d7c-316a-4546-afdb-06f3b6958755\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") "
Oct 31 00:48:28.152486 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.152467    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-workload-certs\") pod \"afc79d7c-316a-4546-afdb-06f3b6958755\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") "
Oct 31 00:48:28.152726 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.152707    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-credential-socket\") pod \"afc79d7c-316a-4546-afdb-06f3b6958755\" (UID: \"afc79d7c-316a-4546-afdb-06f3b6958755\") "
Oct 31 00:48:28.154426 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.152257    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-workload-socket" pod "afc79d7c-316a-4546-afdb-06f3b6958755" (UID: "afc79d7c-316a-4546-afdb-06f3b6958755"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:28.154526 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.152345    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afc79d7c-316a-4546-afdb-06f3b6958755-istio-token" pod "afc79d7c-316a-4546-afdb-06f3b6958755" (UID: "afc79d7c-316a-4546-afdb-06f3b6958755"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:28.154526 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.153792    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-istio-envoy" pod "afc79d7c-316a-4546-afdb-06f3b6958755" (UID: "afc79d7c-316a-4546-afdb-06f3b6958755"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:28.154526 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.153923    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-workload-certs" pod "afc79d7c-316a-4546-afdb-06f3b6958755" (UID: "afc79d7c-316a-4546-afdb-06f3b6958755"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:28.154526 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.154397    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-credential-socket" pod "afc79d7c-316a-4546-afdb-06f3b6958755" (UID: "afc79d7c-316a-4546-afdb-06f3b6958755"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:28.155110 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.155089    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.155194 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.155112    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.155194 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.155127    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/afc79d7c-316a-4546-afdb-06f3b6958755-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.155194 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.155141    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/afc79d7c-316a-4546-afdb-06f3b6958755-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.155194 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.155158    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.155194 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.155171    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.155194 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.155184    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/afc79d7c-316a-4546-afdb-06f3b6958755-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.160992 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.160945    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/afc79d7c-316a-4546-afdb-06f3b6958755-kube-api-access-c8g99" pod "afc79d7c-316a-4546-afdb-06f3b6958755" (UID: "afc79d7c-316a-4546-afdb-06f3b6958755"). InnerVolumeSpecName "kube-api-access-c8g99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:28.165348 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.164584    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/afc79d7c-316a-4546-afdb-06f3b6958755-istio-podinfo" pod "afc79d7c-316a-4546-afdb-06f3b6958755" (UID: "afc79d7c-316a-4546-afdb-06f3b6958755"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:48:28.181294 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.181264    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:48:28.257829 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.257343    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b097de73-6eef-4c19-88b4-77315c8b84fe-kube-api-access-lgwlf\" (UniqueName: \"kubernetes.io/projected/b097de73-6eef-4c19-88b4-77315c8b84fe-kube-api-access-lgwlf\") pod \"b097de73-6eef-4c19-88b4-77315c8b84fe\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") "
Oct 31 00:48:28.257829 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.257391    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-podinfo\") pod \"b097de73-6eef-4c19-88b4-77315c8b84fe\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") "
Oct 31 00:48:28.257829 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.257434    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-envoy\") pod \"b097de73-6eef-4c19-88b4-77315c8b84fe\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") "
Oct 31 00:48:28.257829 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.257577    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-data\") pod \"b097de73-6eef-4c19-88b4-77315c8b84fe\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") "
Oct 31 00:48:28.257829 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.257617    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-workload-socket\") pod \"b097de73-6eef-4c19-88b4-77315c8b84fe\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") "
Oct 31 00:48:28.257829 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.257670    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-credential-socket\") pod \"b097de73-6eef-4c19-88b4-77315c8b84fe\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") "
Oct 31 00:48:28.257829 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.257718    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b097de73-6eef-4c19-88b4-77315c8b84fe-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b097de73-6eef-4c19-88b4-77315c8b84fe-istiod-ca-cert\") pod \"b097de73-6eef-4c19-88b4-77315c8b84fe\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") "
Oct 31 00:48:28.258372 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.258351    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-workload-certs\") pod \"b097de73-6eef-4c19-88b4-77315c8b84fe\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") "
Oct 31 00:48:28.258526 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.258413    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-token\" (UniqueName: \"kubernetes.io/projected/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-token\") pod \"b097de73-6eef-4c19-88b4-77315c8b84fe\" (UID: \"b097de73-6eef-4c19-88b4-77315c8b84fe\") "
Oct 31 00:48:28.258928 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.258911    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c8g99\" (UniqueName: \"kubernetes.io/projected/afc79d7c-316a-4546-afdb-06f3b6958755-kube-api-access-c8g99\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.259020 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.258933    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/afc79d7c-316a-4546-afdb-06f3b6958755-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.260581 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.260160    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-data" pod "b097de73-6eef-4c19-88b4-77315c8b84fe" (UID: "b097de73-6eef-4c19-88b4-77315c8b84fe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:28.260581 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.260324    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-workload-certs" pod "b097de73-6eef-4c19-88b4-77315c8b84fe" (UID: "b097de73-6eef-4c19-88b4-77315c8b84fe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:28.260581 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.260547    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-credential-socket" pod "b097de73-6eef-4c19-88b4-77315c8b84fe" (UID: "b097de73-6eef-4c19-88b4-77315c8b84fe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:28.260581 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.260565    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b097de73-6eef-4c19-88b4-77315c8b84fe-istiod-ca-cert" pod "b097de73-6eef-4c19-88b4-77315c8b84fe" (UID: "b097de73-6eef-4c19-88b4-77315c8b84fe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:28.260798 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.260620    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-workload-socket" pod "b097de73-6eef-4c19-88b4-77315c8b84fe" (UID: "b097de73-6eef-4c19-88b4-77315c8b84fe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:28.261643 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.261623    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-token" pod "b097de73-6eef-4c19-88b4-77315c8b84fe" (UID: "b097de73-6eef-4c19-88b4-77315c8b84fe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:28.262643 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.262613    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b097de73-6eef-4c19-88b4-77315c8b84fe-kube-api-access-lgwlf" pod "b097de73-6eef-4c19-88b4-77315c8b84fe" (UID: "b097de73-6eef-4c19-88b4-77315c8b84fe"). InnerVolumeSpecName "kube-api-access-lgwlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:28.263125 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.263104    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-envoy" pod "b097de73-6eef-4c19-88b4-77315c8b84fe" (UID: "b097de73-6eef-4c19-88b4-77315c8b84fe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:28.263826 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.263810    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-podinfo" pod "b097de73-6eef-4c19-88b4-77315c8b84fe" (UID: "b097de73-6eef-4c19-88b4-77315c8b84fe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:48:28.360111 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.360043    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.360111 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.360070    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.360111 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.360081    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgwlf\" (UniqueName: \"kubernetes.io/projected/b097de73-6eef-4c19-88b4-77315c8b84fe-kube-api-access-lgwlf\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.360111 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.360090    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.360111 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.360100    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.360111 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.360108    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.360480 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.360117    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.360480 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.360125    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b097de73-6eef-4c19-88b4-77315c8b84fe-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.360480 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.360134    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b097de73-6eef-4c19-88b4-77315c8b84fe-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:28.571054 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.571022    5946 generic.go:356] "Generic (PLEG): container finished" podID="afc79d7c-316a-4546-afdb-06f3b6958755" containerID="a0f5020a7fc34c713fa9555868a7bcdd00b2a128b9497ab8708b104a75326d47" exitCode=0
Oct 31 00:48:28.571531 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.571073    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"
Oct 31 00:48:28.571531 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.571114    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542" event={"ID":"afc79d7c-316a-4546-afdb-06f3b6958755","Type":"ContainerDied","Data":"a0f5020a7fc34c713fa9555868a7bcdd00b2a128b9497ab8708b104a75326d47"}
Oct 31 00:48:28.571531 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.571183    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542" event={"ID":"afc79d7c-316a-4546-afdb-06f3b6958755","Type":"ContainerDied","Data":"d86b5b6c53f0d2ab11c8f23109820bfccd77802da1ad0de20a661773b678a247"}
Oct 31 00:48:28.571531 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.571253    5946 scope.go:122] "RemoveContainer" containerID="a0f5020a7fc34c713fa9555868a7bcdd00b2a128b9497ab8708b104a75326d47"
Oct 31 00:48:28.573328 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.573307    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"
Oct 31 00:48:28.574653 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.574448    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt" event={"ID":"c6595fa5-8566-4e13-8d16-d818383d84d0","Type":"ContainerDied","Data":"f729301f8958ed51993d3b4269fc903f687271c9483e5d4f04ca7fef468b943d"}
Oct 31 00:48:28.577196 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.576474    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"
Oct 31 00:48:28.577196 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.576496    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp" event={"ID":"1626bf4d-1329-4475-85a5-3939af3db878","Type":"ContainerDied","Data":"ef15ab45da5b47b706490a2429a032db4dfeb05d63cca051d3ff77d3ebfef39d"}
Oct 31 00:48:28.584210 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.584145    5946 generic.go:356] "Generic (PLEG): container finished" podID="b097de73-6eef-4c19-88b4-77315c8b84fe" containerID="d4eea465542207f8da50edf8407a50b474a159d02b1fad319f88ef743d6285af" exitCode=0
Oct 31 00:48:28.584210 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.584180    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk" event={"ID":"b097de73-6eef-4c19-88b4-77315c8b84fe","Type":"ContainerDied","Data":"d4eea465542207f8da50edf8407a50b474a159d02b1fad319f88ef743d6285af"}
Oct 31 00:48:28.584210 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.584256    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk" event={"ID":"b097de73-6eef-4c19-88b4-77315c8b84fe","Type":"ContainerDied","Data":"68dabb908f692bf307add105f13851d2c1d498a2ba7805227388ef0df3837a74"}
Oct 31 00:48:28.584720 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.584326    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"
Oct 31 00:48:28.586982 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.586923    5946 scope.go:122] "RemoveContainer" containerID="a0f5020a7fc34c713fa9555868a7bcdd00b2a128b9497ab8708b104a75326d47"
Oct 31 00:48:28.587332 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:48:28.587246    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0f5020a7fc34c713fa9555868a7bcdd00b2a128b9497ab8708b104a75326d47\": container with ID starting with a0f5020a7fc34c713fa9555868a7bcdd00b2a128b9497ab8708b104a75326d47 not found: ID does not exist" containerID="a0f5020a7fc34c713fa9555868a7bcdd00b2a128b9497ab8708b104a75326d47"
Oct 31 00:48:28.587332 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.587279    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0f5020a7fc34c713fa9555868a7bcdd00b2a128b9497ab8708b104a75326d47"} err="failed to get container status \"a0f5020a7fc34c713fa9555868a7bcdd00b2a128b9497ab8708b104a75326d47\": rpc error: code = NotFound desc = could not find container \"a0f5020a7fc34c713fa9555868a7bcdd00b2a128b9497ab8708b104a75326d47\": container with ID starting with a0f5020a7fc34c713fa9555868a7bcdd00b2a128b9497ab8708b104a75326d47 not found: ID does not exist"
Oct 31 00:48:28.587332 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.587295    5946 scope.go:122] "RemoveContainer" containerID="dcbad80e34184cef5d368fee9187eb12c55eeb96cda7a67633819cc8b83a0996"
Oct 31 00:48:28.602020 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.601999    5946 scope.go:122] "RemoveContainer" containerID="45d24f5394c204c0215aff6f56767246e28d2df89c6bed282987b2ed9ac1f8c6"
Oct 31 00:48:28.615738 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.615682    5946 scope.go:122] "RemoveContainer" containerID="d4eea465542207f8da50edf8407a50b474a159d02b1fad319f88ef743d6285af"
Oct 31 00:48:28.617162 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.617141    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"]
Oct 31 00:48:28.622393 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.622370    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-z7542"]
Oct 31 00:48:28.630386 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.630368    5946 scope.go:122] "RemoveContainer" containerID="d4eea465542207f8da50edf8407a50b474a159d02b1fad319f88ef743d6285af"
Oct 31 00:48:28.630529 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.630502    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"]
Oct 31 00:48:28.630895 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:48:28.630873    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d4eea465542207f8da50edf8407a50b474a159d02b1fad319f88ef743d6285af\": container with ID starting with d4eea465542207f8da50edf8407a50b474a159d02b1fad319f88ef743d6285af not found: ID does not exist" containerID="d4eea465542207f8da50edf8407a50b474a159d02b1fad319f88ef743d6285af"
Oct 31 00:48:28.630998 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.630903    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d4eea465542207f8da50edf8407a50b474a159d02b1fad319f88ef743d6285af"} err="failed to get container status \"d4eea465542207f8da50edf8407a50b474a159d02b1fad319f88ef743d6285af\": rpc error: code = NotFound desc = could not find container \"d4eea465542207f8da50edf8407a50b474a159d02b1fad319f88ef743d6285af\": container with ID starting with d4eea465542207f8da50edf8407a50b474a159d02b1fad319f88ef743d6285af not found: ID does not exist"
Oct 31 00:48:28.634259 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.634232    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-xxcmk"]
Oct 31 00:48:28.652400 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.652372    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"]
Oct 31 00:48:28.654754 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.654736    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w6-47f370-openshift-default-6dc8794f9-tgvlp"]
Oct 31 00:48:28.662682 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.662663    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"]
Oct 31 00:48:28.669838 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:28.669816    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w5-44bc67-8544fd4b48-cj2jt"]
Oct 31 00:48:29.074626 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:29.074593    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="1626bf4d-1329-4475-85a5-3939af3db878" path="/var/lib/kubelet/pods/1626bf4d-1329-4475-85a5-3939af3db878/volumes"
Oct 31 00:48:29.075450 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:29.075421    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="30197b12-e066-43b4-b920-c1757b9516ce" path="/var/lib/kubelet/pods/30197b12-e066-43b4-b920-c1757b9516ce/volumes"
Oct 31 00:48:29.075898 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:29.075879    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="53825390-1f0f-4b49-9e59-b224c39aaf62" path="/var/lib/kubelet/pods/53825390-1f0f-4b49-9e59-b224c39aaf62/volumes"
Oct 31 00:48:29.076867 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:29.076846    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="afc79d7c-316a-4546-afdb-06f3b6958755" path="/var/lib/kubelet/pods/afc79d7c-316a-4546-afdb-06f3b6958755/volumes"
Oct 31 00:48:29.077355 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:29.077333    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b097de73-6eef-4c19-88b4-77315c8b84fe" path="/var/lib/kubelet/pods/b097de73-6eef-4c19-88b4-77315c8b84fe/volumes"
Oct 31 00:48:29.077786 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:29.077772    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="c6595fa5-8566-4e13-8d16-d818383d84d0" path="/var/lib/kubelet/pods/c6595fa5-8566-4e13-8d16-d818383d84d0/volumes"
Oct 31 00:48:35.515761 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:35.515725    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"]
Oct 31 00:48:35.517054 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:35.516994    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km" podUID="fafaee93-015a-4a0b-bee3-115fc381d2e8" containerName="istio-proxy" containerID="cri-o://b9a5e8793578da590fc30f213581907708737d419356264f586eea61a6e727aa" gracePeriod=30
Oct 31 00:48:35.519811 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:35.519789    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"]
Oct 31 00:48:35.520108 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:35.520073    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77" podUID="b77a849b-33f4-4a27-aaf5-45475b017feb" containerName="istio-proxy" containerID="cri-o://2632713fcd89a96bb0fbe14c007b21bf4878ee00554fecc55febd1d8c7afb29a" gracePeriod=30
Oct 31 00:48:35.652703 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:35.652674    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"]
Oct 31 00:48:35.653169 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:35.653122    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs" podUID="50175a7b-1e0d-4398-bacb-afffae46b712" containerName="istio-proxy" containerID="cri-o://adfc225513da3a0cb85a05a9b660a9885284e31bfaafc8bcf64bf9b1d13b54a5" gracePeriod=30
Oct 31 00:48:35.654672 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:35.654638    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"]
Oct 31 00:48:35.655071 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:35.655028    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh" podUID="daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" containerName="istio-proxy" containerID="cri-o://8823350bfd525dccd2b1a9c38e93977613f6536775ac078f9e4df50d8f1c233c" gracePeriod=30
Oct 31 00:48:35.660989 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:35.660967    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"]
Oct 31 00:48:35.661315 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:35.661293    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg" podUID="fc8f1228-2303-4afe-a4cc-831825f95a18" containerName="istio-proxy" containerID="cri-o://22bf527a018d1251e033e9c23c20277999449820abba0a1847bde10fdb6c20de" gracePeriod=30
Oct 31 00:48:36.570547 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:36.570509    5946 patch_prober.go:29] interesting pod/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:48:36.570932 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:36.570571    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77" podUID="b77a849b-33f4-4a27-aaf5-45475b017feb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:48:38.246753 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:38.246718    5946 patch_prober.go:29] interesting pod/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:48:38.247238 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:38.246781    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh" podUID="daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:48:39.915575 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:39.915543    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"]
Oct 31 00:48:39.918140 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:39.915738    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg" podUID="a1fecfeb-15bf-4365-a76f-915eda6b56a0" containerName="maas-api" containerID="cri-o://6f789875da1d7e55213ee9e68b5caaf4a335f26994b1dfdf0a3e2b61f1d7ab2a" gracePeriod=30
Oct 31 00:48:40.721051 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:40.721017    5946 generic.go:356] "Generic (PLEG): container finished" podID="fafaee93-015a-4a0b-bee3-115fc381d2e8" containerID="b9a5e8793578da590fc30f213581907708737d419356264f586eea61a6e727aa" exitCode=0
Oct 31 00:48:40.721164 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:40.721098    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km" event={"ID":"fafaee93-015a-4a0b-bee3-115fc381d2e8","Type":"ContainerDied","Data":"b9a5e8793578da590fc30f213581907708737d419356264f586eea61a6e727aa"}
Oct 31 00:48:40.723158 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:40.723133    5946 generic.go:356] "Generic (PLEG): container finished" podID="b77a849b-33f4-4a27-aaf5-45475b017feb" containerID="2632713fcd89a96bb0fbe14c007b21bf4878ee00554fecc55febd1d8c7afb29a" exitCode=0
Oct 31 00:48:40.723410 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:40.723202    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77" event={"ID":"b77a849b-33f4-4a27-aaf5-45475b017feb","Type":"ContainerDied","Data":"2632713fcd89a96bb0fbe14c007b21bf4878ee00554fecc55febd1d8c7afb29a"}
Oct 31 00:48:40.896705 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:40.896410    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:48:40.925172 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:40.925150    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:48:41.014777 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.014093    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-workload-socket\") pod \"fafaee93-015a-4a0b-bee3-115fc381d2e8\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") "
Oct 31 00:48:41.014777 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.014156    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-credential-socket\") pod \"fafaee93-015a-4a0b-bee3-115fc381d2e8\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") "
Oct 31 00:48:41.014777 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.014209    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-workload-certs\") pod \"fafaee93-015a-4a0b-bee3-115fc381d2e8\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") "
Oct 31 00:48:41.014777 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.014320    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-data\") pod \"fafaee93-015a-4a0b-bee3-115fc381d2e8\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") "
Oct 31 00:48:41.014777 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.014447    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-token\" (UniqueName: \"kubernetes.io/projected/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-token\") pod \"fafaee93-015a-4a0b-bee3-115fc381d2e8\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") "
Oct 31 00:48:41.014777 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.014449    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-workload-socket" pod "fafaee93-015a-4a0b-bee3-115fc381d2e8" (UID: "fafaee93-015a-4a0b-bee3-115fc381d2e8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.014777 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.014492    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-podinfo\") pod \"fafaee93-015a-4a0b-bee3-115fc381d2e8\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") "
Oct 31 00:48:41.014777 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.014615    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fafaee93-015a-4a0b-bee3-115fc381d2e8-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fafaee93-015a-4a0b-bee3-115fc381d2e8-istiod-ca-cert\") pod \"fafaee93-015a-4a0b-bee3-115fc381d2e8\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") "
Oct 31 00:48:41.014777 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.014677    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fafaee93-015a-4a0b-bee3-115fc381d2e8-kube-api-access-ssxsc\" (UniqueName: \"kubernetes.io/projected/fafaee93-015a-4a0b-bee3-115fc381d2e8-kube-api-access-ssxsc\") pod \"fafaee93-015a-4a0b-bee3-115fc381d2e8\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") "
Oct 31 00:48:41.014777 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.014732    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-workload-certs" pod "fafaee93-015a-4a0b-bee3-115fc381d2e8" (UID: "fafaee93-015a-4a0b-bee3-115fc381d2e8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.016055 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.014948    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-credential-socket" pod "fafaee93-015a-4a0b-bee3-115fc381d2e8" (UID: "fafaee93-015a-4a0b-bee3-115fc381d2e8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.016055 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.015166    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-data" pod "fafaee93-015a-4a0b-bee3-115fc381d2e8" (UID: "fafaee93-015a-4a0b-bee3-115fc381d2e8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.016055 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.015528    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fafaee93-015a-4a0b-bee3-115fc381d2e8-istiod-ca-cert" pod "fafaee93-015a-4a0b-bee3-115fc381d2e8" (UID: "fafaee93-015a-4a0b-bee3-115fc381d2e8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:41.016750 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.016482    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-envoy\") pod \"fafaee93-015a-4a0b-bee3-115fc381d2e8\" (UID: \"fafaee93-015a-4a0b-bee3-115fc381d2e8\") "
Oct 31 00:48:41.017166 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.017143    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.017292 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.017168    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.017292 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.017185    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.017292 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.017198    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.017292 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.017212    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fafaee93-015a-4a0b-bee3-115fc381d2e8-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.024264 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.023192    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-envoy" pod "fafaee93-015a-4a0b-bee3-115fc381d2e8" (UID: "fafaee93-015a-4a0b-bee3-115fc381d2e8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.024596 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.024560    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-token" pod "fafaee93-015a-4a0b-bee3-115fc381d2e8" (UID: "fafaee93-015a-4a0b-bee3-115fc381d2e8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:41.026438 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.026415    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-podinfo" pod "fafaee93-015a-4a0b-bee3-115fc381d2e8" (UID: "fafaee93-015a-4a0b-bee3-115fc381d2e8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:48:41.031055 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.031031    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fafaee93-015a-4a0b-bee3-115fc381d2e8-kube-api-access-ssxsc" pod "fafaee93-015a-4a0b-bee3-115fc381d2e8" (UID: "fafaee93-015a-4a0b-bee3-115fc381d2e8"). InnerVolumeSpecName "kube-api-access-ssxsc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:41.039006 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.038982    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:48:41.118334 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.118304    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-workload-certs\") pod \"b77a849b-33f4-4a27-aaf5-45475b017feb\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") "
Oct 31 00:48:41.118536 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.118396    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-podinfo\") pod \"b77a849b-33f4-4a27-aaf5-45475b017feb\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") "
Oct 31 00:48:41.118536 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.118430    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-envoy\") pod \"b77a849b-33f4-4a27-aaf5-45475b017feb\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") "
Oct 31 00:48:41.118737 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.118618    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/b77a849b-33f4-4a27-aaf5-45475b017feb-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b77a849b-33f4-4a27-aaf5-45475b017feb-istiod-ca-cert\") pod \"b77a849b-33f4-4a27-aaf5-45475b017feb\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") "
Oct 31 00:48:41.118737 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.118640    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-workload-certs" pod "b77a849b-33f4-4a27-aaf5-45475b017feb" (UID: "b77a849b-33f4-4a27-aaf5-45475b017feb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.118737 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.118665    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-token\" (UniqueName: \"kubernetes.io/projected/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-token\") pod \"b77a849b-33f4-4a27-aaf5-45475b017feb\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") "
Oct 31 00:48:41.118737 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.118723    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-data\") pod \"b77a849b-33f4-4a27-aaf5-45475b017feb\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") "
Oct 31 00:48:41.119036 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.118806    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-workload-socket\") pod \"b77a849b-33f4-4a27-aaf5-45475b017feb\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") "
Oct 31 00:48:41.119036 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.118873    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-credential-socket\") pod \"b77a849b-33f4-4a27-aaf5-45475b017feb\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") "
Oct 31 00:48:41.119036 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.118904    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/b77a849b-33f4-4a27-aaf5-45475b017feb-kube-api-access-rvx4t\" (UniqueName: \"kubernetes.io/projected/b77a849b-33f4-4a27-aaf5-45475b017feb-kube-api-access-rvx4t\") pod \"b77a849b-33f4-4a27-aaf5-45475b017feb\" (UID: \"b77a849b-33f4-4a27-aaf5-45475b017feb\") "
Oct 31 00:48:41.119201 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.119165    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-data" pod "b77a849b-33f4-4a27-aaf5-45475b017feb" (UID: "b77a849b-33f4-4a27-aaf5-45475b017feb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.119976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.119634    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.119976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.119664    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.119976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.119679    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.119976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.119858    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-workload-socket" pod "b77a849b-33f4-4a27-aaf5-45475b017feb" (UID: "b77a849b-33f4-4a27-aaf5-45475b017feb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.119976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.119947    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-credential-socket" pod "b77a849b-33f4-4a27-aaf5-45475b017feb" (UID: "b77a849b-33f4-4a27-aaf5-45475b017feb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.119976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.119951    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b77a849b-33f4-4a27-aaf5-45475b017feb-istiod-ca-cert" pod "b77a849b-33f4-4a27-aaf5-45475b017feb" (UID: "b77a849b-33f4-4a27-aaf5-45475b017feb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:41.120652 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.120568    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ssxsc\" (UniqueName: \"kubernetes.io/projected/fafaee93-015a-4a0b-bee3-115fc381d2e8-kube-api-access-ssxsc\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.120652 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.120596    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fafaee93-015a-4a0b-bee3-115fc381d2e8-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.120652 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.120615    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.121426 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.121396    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-envoy" pod "b77a849b-33f4-4a27-aaf5-45475b017feb" (UID: "b77a849b-33f4-4a27-aaf5-45475b017feb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.121538 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.121504    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-podinfo" pod "b77a849b-33f4-4a27-aaf5-45475b017feb" (UID: "b77a849b-33f4-4a27-aaf5-45475b017feb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:48:41.122280 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.122251    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b77a849b-33f4-4a27-aaf5-45475b017feb-kube-api-access-rvx4t" pod "b77a849b-33f4-4a27-aaf5-45475b017feb" (UID: "b77a849b-33f4-4a27-aaf5-45475b017feb"). InnerVolumeSpecName "kube-api-access-rvx4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:41.123001 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.122977    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-token" pod "b77a849b-33f4-4a27-aaf5-45475b017feb" (UID: "b77a849b-33f4-4a27-aaf5-45475b017feb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:41.138898 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.138874    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:48:41.142667 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.142605    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:48:41.229339 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.229296    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-token\" (UniqueName: \"kubernetes.io/projected/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-token\") pod \"fc8f1228-2303-4afe-a4cc-831825f95a18\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") "
Oct 31 00:48:41.229584 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.229550    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-credential-socket\") pod \"50175a7b-1e0d-4398-bacb-afffae46b712\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") "
Oct 31 00:48:41.229785 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.229768    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-istio-envoy\") pod \"50175a7b-1e0d-4398-bacb-afffae46b712\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") "
Oct 31 00:48:41.229985 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.229969    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-istio-data\") pod \"50175a7b-1e0d-4398-bacb-afffae46b712\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") "
Oct 31 00:48:41.230142 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.230128    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-workload-certs\") pod \"fc8f1228-2303-4afe-a4cc-831825f95a18\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") "
Oct 31 00:48:41.230324 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.230308    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-data\") pod \"fc8f1228-2303-4afe-a4cc-831825f95a18\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") "
Oct 31 00:48:41.230469 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.230456    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-workload-socket\") pod \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") "
Oct 31 00:48:41.230609 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.230577    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-workload-certs\") pod \"50175a7b-1e0d-4398-bacb-afffae46b712\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") "
Oct 31 00:48:41.230733 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.230719    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-token\" (UniqueName: \"kubernetes.io/projected/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-token\") pod \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") "
Oct 31 00:48:41.230954 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.230936    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/fc8f1228-2303-4afe-a4cc-831825f95a18-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc8f1228-2303-4afe-a4cc-831825f95a18-istiod-ca-cert\") pod \"fc8f1228-2303-4afe-a4cc-831825f95a18\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") "
Oct 31 00:48:41.231115 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.231098    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/50175a7b-1e0d-4398-bacb-afffae46b712-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50175a7b-1e0d-4398-bacb-afffae46b712-istiod-ca-cert\") pod \"50175a7b-1e0d-4398-bacb-afffae46b712\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") "
Oct 31 00:48:41.231322 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.231290    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-podinfo\") pod \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") "
Oct 31 00:48:41.231486 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.231456    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-workload-certs\") pod \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") "
Oct 31 00:48:41.231641 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.231611    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-podinfo\") pod \"fc8f1228-2303-4afe-a4cc-831825f95a18\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") "
Oct 31 00:48:41.231799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.231769    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/fc8f1228-2303-4afe-a4cc-831825f95a18-kube-api-access-fv98f\" (UniqueName: \"kubernetes.io/projected/fc8f1228-2303-4afe-a4cc-831825f95a18-kube-api-access-fv98f\") pod \"fc8f1228-2303-4afe-a4cc-831825f95a18\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") "
Oct 31 00:48:41.231956 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.231927    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istiod-ca-cert\") pod \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") "
Oct 31 00:48:41.232072 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.232062    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/50175a7b-1e0d-4398-bacb-afffae46b712-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50175a7b-1e0d-4398-bacb-afffae46b712-istio-podinfo\") pod \"50175a7b-1e0d-4398-bacb-afffae46b712\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") "
Oct 31 00:48:41.232206 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.232196    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-credential-socket\") pod \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") "
Oct 31 00:48:41.232591 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.232571    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50175a7b-1e0d-4398-bacb-afffae46b712-kube-api-access-nlkvg\" (UniqueName: \"kubernetes.io/projected/50175a7b-1e0d-4398-bacb-afffae46b712-kube-api-access-nlkvg\") pod \"50175a7b-1e0d-4398-bacb-afffae46b712\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") "
Oct 31 00:48:41.232855 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.232836    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-workload-socket\") pod \"50175a7b-1e0d-4398-bacb-afffae46b712\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") "
Oct 31 00:48:41.233376 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.233334    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-kube-api-access-2wsp5\" (UniqueName: \"kubernetes.io/projected/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-kube-api-access-2wsp5\") pod \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") "
Oct 31 00:48:41.233376 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.233370    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-credential-socket\") pod \"fc8f1228-2303-4afe-a4cc-831825f95a18\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") "
Oct 31 00:48:41.233558 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.233419    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-workload-socket\") pod \"fc8f1228-2303-4afe-a4cc-831825f95a18\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") "
Oct 31 00:48:41.233558 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.233461    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/50175a7b-1e0d-4398-bacb-afffae46b712-istio-token\" (UniqueName: \"kubernetes.io/projected/50175a7b-1e0d-4398-bacb-afffae46b712-istio-token\") pod \"50175a7b-1e0d-4398-bacb-afffae46b712\" (UID: \"50175a7b-1e0d-4398-bacb-afffae46b712\") "
Oct 31 00:48:41.233558 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.233509    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-envoy\") pod \"fc8f1228-2303-4afe-a4cc-831825f95a18\" (UID: \"fc8f1228-2303-4afe-a4cc-831825f95a18\") "
Oct 31 00:48:41.233558 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.233534    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-envoy\") pod \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") "
Oct 31 00:48:41.233780 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.233569    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-data\") pod \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\" (UID: \"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c\") "
Oct 31 00:48:41.233836 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.233789    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-istio-data" pod "50175a7b-1e0d-4398-bacb-afffae46b712" (UID: "50175a7b-1e0d-4398-bacb-afffae46b712"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.233836 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.233798    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-workload-certs" pod "fc8f1228-2303-4afe-a4cc-831825f95a18" (UID: "fc8f1228-2303-4afe-a4cc-831825f95a18"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.234273 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234073    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc8f1228-2303-4afe-a4cc-831825f95a18-istiod-ca-cert" pod "fc8f1228-2303-4afe-a4cc-831825f95a18" (UID: "fc8f1228-2303-4afe-a4cc-831825f95a18"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:41.234367 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234281    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-credential-socket" pod "50175a7b-1e0d-4398-bacb-afffae46b712" (UID: "50175a7b-1e0d-4398-bacb-afffae46b712"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.234367 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234324    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-workload-certs" pod "daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" (UID: "daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.234367 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234348    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-workload-socket" pod "50175a7b-1e0d-4398-bacb-afffae46b712" (UID: "50175a7b-1e0d-4398-bacb-afffae46b712"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.234737 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234576    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istiod-ca-cert" pod "daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" (UID: "daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:41.234737 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234635    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-data" pod "fc8f1228-2303-4afe-a4cc-831825f95a18" (UID: "fc8f1228-2303-4afe-a4cc-831825f95a18"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.234893 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234794    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.234893 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234815    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.234893 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234831    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.234893 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234845    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.234893 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234860    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.234893 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234876    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvx4t\" (UniqueName: \"kubernetes.io/projected/b77a849b-33f4-4a27-aaf5-45475b017feb-kube-api-access-rvx4t\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.234893 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234890    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc8f1228-2303-4afe-a4cc-831825f95a18-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.235256 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234904    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.235256 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234917    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.235256 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234932    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.235256 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234945    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.235256 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234958    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.235256 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234973    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b77a849b-33f4-4a27-aaf5-45475b017feb-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.235256 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234987    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b77a849b-33f4-4a27-aaf5-45475b017feb-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.235256 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.235000    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.235256 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.234799    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-workload-certs" pod "50175a7b-1e0d-4398-bacb-afffae46b712" (UID: "50175a7b-1e0d-4398-bacb-afffae46b712"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.235798 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.235403    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-credential-socket" pod "fc8f1228-2303-4afe-a4cc-831825f95a18" (UID: "fc8f1228-2303-4afe-a4cc-831825f95a18"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.237566 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.237016    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-workload-socket" pod "daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" (UID: "daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.237566 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.237185    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-data" pod "daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" (UID: "daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.237566 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.237340    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/50175a7b-1e0d-4398-bacb-afffae46b712-istiod-ca-cert" pod "50175a7b-1e0d-4398-bacb-afffae46b712" (UID: "50175a7b-1e0d-4398-bacb-afffae46b712"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:41.237807 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.237786    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-credential-socket" pod "daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" (UID: "daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.240620 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.240582    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-token" pod "daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" (UID: "daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:41.241726 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.241566    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-token" pod "fc8f1228-2303-4afe-a4cc-831825f95a18" (UID: "fc8f1228-2303-4afe-a4cc-831825f95a18"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:41.241726 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.241630    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/50175a7b-1e0d-4398-bacb-afffae46b712-istio-podinfo" pod "50175a7b-1e0d-4398-bacb-afffae46b712" (UID: "50175a7b-1e0d-4398-bacb-afffae46b712"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:48:41.241726 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.241685    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50175a7b-1e0d-4398-bacb-afffae46b712-istio-token" pod "50175a7b-1e0d-4398-bacb-afffae46b712" (UID: "50175a7b-1e0d-4398-bacb-afffae46b712"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:41.241726 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.241690    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-kube-api-access-2wsp5" pod "daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" (UID: "daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c"). InnerVolumeSpecName "kube-api-access-2wsp5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:41.242125 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.242087    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-podinfo" pod "fc8f1228-2303-4afe-a4cc-831825f95a18" (UID: "fc8f1228-2303-4afe-a4cc-831825f95a18"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:48:41.242315 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.242287    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc8f1228-2303-4afe-a4cc-831825f95a18-kube-api-access-fv98f" pod "fc8f1228-2303-4afe-a4cc-831825f95a18" (UID: "fc8f1228-2303-4afe-a4cc-831825f95a18"). InnerVolumeSpecName "kube-api-access-fv98f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:41.242315 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.242313    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-workload-socket" pod "fc8f1228-2303-4afe-a4cc-831825f95a18" (UID: "fc8f1228-2303-4afe-a4cc-831825f95a18"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.243169 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.243125    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50175a7b-1e0d-4398-bacb-afffae46b712-kube-api-access-nlkvg" pod "50175a7b-1e0d-4398-bacb-afffae46b712" (UID: "50175a7b-1e0d-4398-bacb-afffae46b712"). InnerVolumeSpecName "kube-api-access-nlkvg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:41.243322 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.243267    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-podinfo" pod "daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" (UID: "daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:48:41.244113 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.244091    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-envoy" pod "daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" (UID: "daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.244190 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.244136    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-istio-envoy" pod "50175a7b-1e0d-4398-bacb-afffae46b712" (UID: "50175a7b-1e0d-4398-bacb-afffae46b712"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.244557 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.244537    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-envoy" pod "fc8f1228-2303-4afe-a4cc-831825f95a18" (UID: "fc8f1228-2303-4afe-a4cc-831825f95a18"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:41.336092 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336059    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.336267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336095    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlkvg\" (UniqueName: \"kubernetes.io/projected/50175a7b-1e0d-4398-bacb-afffae46b712-kube-api-access-nlkvg\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.336267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336111    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wsp5\" (UniqueName: \"kubernetes.io/projected/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-kube-api-access-2wsp5\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.336267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336124    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.336267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336136    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.336267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336152    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/50175a7b-1e0d-4398-bacb-afffae46b712-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.336267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336164    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.336267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336176    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.336267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336190    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.336267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336203    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.336267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336257    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.336876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336272    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.336876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336285    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/50175a7b-1e0d-4398-bacb-afffae46b712-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.336876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336299    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.336876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336312    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/50175a7b-1e0d-4398-bacb-afffae46b712-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.336876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336325    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.336876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336340    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc8f1228-2303-4afe-a4cc-831825f95a18-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.336876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336353    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fv98f\" (UniqueName: \"kubernetes.io/projected/fc8f1228-2303-4afe-a4cc-831825f95a18-kube-api-access-fv98f\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.336876 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.336367    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/50175a7b-1e0d-4398-bacb-afffae46b712-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.347878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.347814    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"
Oct 31 00:48:41.398169 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:48:41.398117    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:48:41.436900 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.436868    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/a1fecfeb-15bf-4365-a76f-915eda6b56a0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1fecfeb-15bf-4365-a76f-915eda6b56a0-openshift-service-ca\") pod \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\" (UID: \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\") "
Oct 31 00:48:41.437090 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.436931    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a1fecfeb-15bf-4365-a76f-915eda6b56a0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1fecfeb-15bf-4365-a76f-915eda6b56a0-metrics-certs\") pod \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\" (UID: \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\") "
Oct 31 00:48:41.437090 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.437033    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/a1fecfeb-15bf-4365-a76f-915eda6b56a0-kube-api-access-t7bb2\" (UniqueName: \"kubernetes.io/projected/a1fecfeb-15bf-4365-a76f-915eda6b56a0-kube-api-access-t7bb2\") pod \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\" (UID: \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\") "
Oct 31 00:48:41.437172 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.437116    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/a1fecfeb-15bf-4365-a76f-915eda6b56a0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1fecfeb-15bf-4365-a76f-915eda6b56a0-maas-api-tls\") pod \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\" (UID: \"a1fecfeb-15bf-4365-a76f-915eda6b56a0\") "
Oct 31 00:48:41.437298 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.437273    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1fecfeb-15bf-4365-a76f-915eda6b56a0-openshift-service-ca" pod "a1fecfeb-15bf-4365-a76f-915eda6b56a0" (UID: "a1fecfeb-15bf-4365-a76f-915eda6b56a0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:41.437740 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.437717    5946 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a1fecfeb-15bf-4365-a76f-915eda6b56a0-openshift-service-ca\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.439100 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.439075    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1fecfeb-15bf-4365-a76f-915eda6b56a0-metrics-certs" pod "a1fecfeb-15bf-4365-a76f-915eda6b56a0" (UID: "a1fecfeb-15bf-4365-a76f-915eda6b56a0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:48:41.439188 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.439172    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a1fecfeb-15bf-4365-a76f-915eda6b56a0-maas-api-tls" pod "a1fecfeb-15bf-4365-a76f-915eda6b56a0" (UID: "a1fecfeb-15bf-4365-a76f-915eda6b56a0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:48:41.439286 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.439230    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1fecfeb-15bf-4365-a76f-915eda6b56a0-kube-api-access-t7bb2" pod "a1fecfeb-15bf-4365-a76f-915eda6b56a0" (UID: "a1fecfeb-15bf-4365-a76f-915eda6b56a0"). InnerVolumeSpecName "kube-api-access-t7bb2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:41.539801 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.539762    5946 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a1fecfeb-15bf-4365-a76f-915eda6b56a0-metrics-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.539801 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.539804    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7bb2\" (UniqueName: \"kubernetes.io/projected/a1fecfeb-15bf-4365-a76f-915eda6b56a0-kube-api-access-t7bb2\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.540002 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.539820    5946 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a1fecfeb-15bf-4365-a76f-915eda6b56a0-maas-api-tls\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:41.733285 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.733169    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"
Oct 31 00:48:41.733285 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.733188    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km" event={"ID":"fafaee93-015a-4a0b-bee3-115fc381d2e8","Type":"ContainerDied","Data":"9993f661078b41883a9d70d0e01ed228eed03ff8796b230912b84de6e412b0f5"}
Oct 31 00:48:41.733506 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.733303    5946 scope.go:122] "RemoveContainer" containerID="b9a5e8793578da590fc30f213581907708737d419356264f586eea61a6e727aa"
Oct 31 00:48:41.734793 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.734770    5946 generic.go:356] "Generic (PLEG): container finished" podID="daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" containerID="8823350bfd525dccd2b1a9c38e93977613f6536775ac078f9e4df50d8f1c233c" exitCode=0
Oct 31 00:48:41.734922 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.734842    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh" event={"ID":"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c","Type":"ContainerDied","Data":"8823350bfd525dccd2b1a9c38e93977613f6536775ac078f9e4df50d8f1c233c"}
Oct 31 00:48:41.734922 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.734882    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh" event={"ID":"daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c","Type":"ContainerDied","Data":"75681f47e4fbe7cc729aeb3f322c2e34f86ab6136807241927a8a74184b72f9a"}
Oct 31 00:48:41.734922 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.734845    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"
Oct 31 00:48:41.737375 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.737338    5946 generic.go:356] "Generic (PLEG): container finished" podID="fc8f1228-2303-4afe-a4cc-831825f95a18" containerID="22bf527a018d1251e033e9c23c20277999449820abba0a1847bde10fdb6c20de" exitCode=0
Oct 31 00:48:41.737523 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.737370    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg" event={"ID":"fc8f1228-2303-4afe-a4cc-831825f95a18","Type":"ContainerDied","Data":"22bf527a018d1251e033e9c23c20277999449820abba0a1847bde10fdb6c20de"}
Oct 31 00:48:41.737523 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.737428    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"
Oct 31 00:48:41.737523 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.737442    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg" event={"ID":"fc8f1228-2303-4afe-a4cc-831825f95a18","Type":"ContainerDied","Data":"18f3afbba2a64170ebdfcc0367e2dddcfcedb9f56fb9eaf291fd3084d88b7bc7"}
Oct 31 00:48:41.738990 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.738967    5946 generic.go:356] "Generic (PLEG): container finished" podID="50175a7b-1e0d-4398-bacb-afffae46b712" containerID="adfc225513da3a0cb85a05a9b660a9885284e31bfaafc8bcf64bf9b1d13b54a5" exitCode=0
Oct 31 00:48:41.739086 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.739069    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs" event={"ID":"50175a7b-1e0d-4398-bacb-afffae46b712","Type":"ContainerDied","Data":"adfc225513da3a0cb85a05a9b660a9885284e31bfaafc8bcf64bf9b1d13b54a5"}
Oct 31 00:48:41.739154 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.739103    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs" event={"ID":"50175a7b-1e0d-4398-bacb-afffae46b712","Type":"ContainerDied","Data":"3da41ded324d1b1349b37d35f78b18afa2d0a52e7bff9c875b42e91db4a765e1"}
Oct 31 00:48:41.739212 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.739166    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"
Oct 31 00:48:41.743264 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.742538    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77" event={"ID":"b77a849b-33f4-4a27-aaf5-45475b017feb","Type":"ContainerDied","Data":"ed67f1c3c34220d25957049ec7e0b265f5ebe963802960a38902d5535ad09d1b"}
Oct 31 00:48:41.743264 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.742627    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"
Oct 31 00:48:41.746150 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.744311    5946 generic.go:356] "Generic (PLEG): container finished" podID="a1fecfeb-15bf-4365-a76f-915eda6b56a0" containerID="6f789875da1d7e55213ee9e68b5caaf4a335f26994b1dfdf0a3e2b61f1d7ab2a" exitCode=0
Oct 31 00:48:41.746150 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.744370    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg" event={"ID":"a1fecfeb-15bf-4365-a76f-915eda6b56a0","Type":"ContainerDied","Data":"6f789875da1d7e55213ee9e68b5caaf4a335f26994b1dfdf0a3e2b61f1d7ab2a"}
Oct 31 00:48:41.746150 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.744412    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg" event={"ID":"a1fecfeb-15bf-4365-a76f-915eda6b56a0","Type":"ContainerDied","Data":"014e1dbe730bf387609429c1d5fc9c27b9f5967acca9e71ec734bbc2f0ccd55d"}
Oct 31 00:48:41.746150 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.744632    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"
Oct 31 00:48:41.747168 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.747147    5946 scope.go:122] "RemoveContainer" containerID="8823350bfd525dccd2b1a9c38e93977613f6536775ac078f9e4df50d8f1c233c"
Oct 31 00:48:41.760201 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.760182    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"]
Oct 31 00:48:41.762288 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.762121    5946 scope.go:122] "RemoveContainer" containerID="8823350bfd525dccd2b1a9c38e93977613f6536775ac078f9e4df50d8f1c233c"
Oct 31 00:48:41.762617 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:48:41.762586    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8823350bfd525dccd2b1a9c38e93977613f6536775ac078f9e4df50d8f1c233c\": container with ID starting with 8823350bfd525dccd2b1a9c38e93977613f6536775ac078f9e4df50d8f1c233c not found: ID does not exist" containerID="8823350bfd525dccd2b1a9c38e93977613f6536775ac078f9e4df50d8f1c233c"
Oct 31 00:48:41.762705 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.762629    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8823350bfd525dccd2b1a9c38e93977613f6536775ac078f9e4df50d8f1c233c"} err="failed to get container status \"8823350bfd525dccd2b1a9c38e93977613f6536775ac078f9e4df50d8f1c233c\": rpc error: code = NotFound desc = could not find container \"8823350bfd525dccd2b1a9c38e93977613f6536775ac078f9e4df50d8f1c233c\": container with ID starting with 8823350bfd525dccd2b1a9c38e93977613f6536775ac078f9e4df50d8f1c233c not found: ID does not exist"
Oct 31 00:48:41.762705 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.762697    5946 scope.go:122] "RemoveContainer" containerID="22bf527a018d1251e033e9c23c20277999449820abba0a1847bde10fdb6c20de"
Oct 31 00:48:41.763445 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.763427    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-mm4km"]
Oct 31 00:48:41.773359 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.773339    5946 scope.go:122] "RemoveContainer" containerID="fe0f7ab6cf3e10f7e6db3c44cf3db3c47bcd218197688fa0f555ca6717c0cf68"
Oct 31 00:48:41.785570 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.785547    5946 scope.go:122] "RemoveContainer" containerID="22bf527a018d1251e033e9c23c20277999449820abba0a1847bde10fdb6c20de"
Oct 31 00:48:41.785783 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.785762    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"]
Oct 31 00:48:41.785907 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:48:41.785890    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22bf527a018d1251e033e9c23c20277999449820abba0a1847bde10fdb6c20de\": container with ID starting with 22bf527a018d1251e033e9c23c20277999449820abba0a1847bde10fdb6c20de not found: ID does not exist" containerID="22bf527a018d1251e033e9c23c20277999449820abba0a1847bde10fdb6c20de"
Oct 31 00:48:41.785946 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.785918    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22bf527a018d1251e033e9c23c20277999449820abba0a1847bde10fdb6c20de"} err="failed to get container status \"22bf527a018d1251e033e9c23c20277999449820abba0a1847bde10fdb6c20de\": rpc error: code = NotFound desc = could not find container \"22bf527a018d1251e033e9c23c20277999449820abba0a1847bde10fdb6c20de\": container with ID starting with 22bf527a018d1251e033e9c23c20277999449820abba0a1847bde10fdb6c20de not found: ID does not exist"
Oct 31 00:48:41.785946 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.785938    5946 scope.go:122] "RemoveContainer" containerID="fe0f7ab6cf3e10f7e6db3c44cf3db3c47bcd218197688fa0f555ca6717c0cf68"
Oct 31 00:48:41.786187 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:48:41.786173    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe0f7ab6cf3e10f7e6db3c44cf3db3c47bcd218197688fa0f555ca6717c0cf68\": container with ID starting with fe0f7ab6cf3e10f7e6db3c44cf3db3c47bcd218197688fa0f555ca6717c0cf68 not found: ID does not exist" containerID="fe0f7ab6cf3e10f7e6db3c44cf3db3c47bcd218197688fa0f555ca6717c0cf68"
Oct 31 00:48:41.786277 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.786190    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe0f7ab6cf3e10f7e6db3c44cf3db3c47bcd218197688fa0f555ca6717c0cf68"} err="failed to get container status \"fe0f7ab6cf3e10f7e6db3c44cf3db3c47bcd218197688fa0f555ca6717c0cf68\": rpc error: code = NotFound desc = could not find container \"fe0f7ab6cf3e10f7e6db3c44cf3db3c47bcd218197688fa0f555ca6717c0cf68\": container with ID starting with fe0f7ab6cf3e10f7e6db3c44cf3db3c47bcd218197688fa0f555ca6717c0cf68 not found: ID does not exist"
Oct 31 00:48:41.786277 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.786203    5946 scope.go:122] "RemoveContainer" containerID="adfc225513da3a0cb85a05a9b660a9885284e31bfaafc8bcf64bf9b1d13b54a5"
Oct 31 00:48:41.793372 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.793346    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-xw6rh"]
Oct 31 00:48:41.799319 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.799300    5946 scope.go:122] "RemoveContainer" containerID="adfc225513da3a0cb85a05a9b660a9885284e31bfaafc8bcf64bf9b1d13b54a5"
Oct 31 00:48:41.799655 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:48:41.799637    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"adfc225513da3a0cb85a05a9b660a9885284e31bfaafc8bcf64bf9b1d13b54a5\": container with ID starting with adfc225513da3a0cb85a05a9b660a9885284e31bfaafc8bcf64bf9b1d13b54a5 not found: ID does not exist" containerID="adfc225513da3a0cb85a05a9b660a9885284e31bfaafc8bcf64bf9b1d13b54a5"
Oct 31 00:48:41.799708 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.799664    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"adfc225513da3a0cb85a05a9b660a9885284e31bfaafc8bcf64bf9b1d13b54a5"} err="failed to get container status \"adfc225513da3a0cb85a05a9b660a9885284e31bfaafc8bcf64bf9b1d13b54a5\": rpc error: code = NotFound desc = could not find container \"adfc225513da3a0cb85a05a9b660a9885284e31bfaafc8bcf64bf9b1d13b54a5\": container with ID starting with adfc225513da3a0cb85a05a9b660a9885284e31bfaafc8bcf64bf9b1d13b54a5 not found: ID does not exist"
Oct 31 00:48:41.799708 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.799684    5946 scope.go:122] "RemoveContainer" containerID="2632713fcd89a96bb0fbe14c007b21bf4878ee00554fecc55febd1d8c7afb29a"
Oct 31 00:48:41.806449 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.806426    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"]
Oct 31 00:48:41.811536 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.811512    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w3-1d4a7e-openshift-default-559b45695f-jdl77"]
Oct 31 00:48:41.813002 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.812984    5946 scope.go:122] "RemoveContainer" containerID="6f789875da1d7e55213ee9e68b5caaf4a335f26994b1dfdf0a3e2b61f1d7ab2a"
Oct 31 00:48:41.823797 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.823770    5946 scope.go:122] "RemoveContainer" containerID="6f789875da1d7e55213ee9e68b5caaf4a335f26994b1dfdf0a3e2b61f1d7ab2a"
Oct 31 00:48:41.824159 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:48:41.824129    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f789875da1d7e55213ee9e68b5caaf4a335f26994b1dfdf0a3e2b61f1d7ab2a\": container with ID starting with 6f789875da1d7e55213ee9e68b5caaf4a335f26994b1dfdf0a3e2b61f1d7ab2a not found: ID does not exist" containerID="6f789875da1d7e55213ee9e68b5caaf4a335f26994b1dfdf0a3e2b61f1d7ab2a"
Oct 31 00:48:41.824263 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.824168    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f789875da1d7e55213ee9e68b5caaf4a335f26994b1dfdf0a3e2b61f1d7ab2a"} err="failed to get container status \"6f789875da1d7e55213ee9e68b5caaf4a335f26994b1dfdf0a3e2b61f1d7ab2a\": rpc error: code = NotFound desc = could not find container \"6f789875da1d7e55213ee9e68b5caaf4a335f26994b1dfdf0a3e2b61f1d7ab2a\": container with ID starting with 6f789875da1d7e55213ee9e68b5caaf4a335f26994b1dfdf0a3e2b61f1d7ab2a not found: ID does not exist"
Oct 31 00:48:41.824263 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.824212    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"]
Oct 31 00:48:41.826796 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.826775    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-dc4jg"]
Oct 31 00:48:41.840994 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.840970    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"]
Oct 31 00:48:41.847916 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.847894    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w5-44bc67-openshift-default-5b7c5d8f6c-rz4rs"]
Oct 31 00:48:41.879598 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.879552    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"]
Oct 31 00:48:41.882044 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:41.882015    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w1-7f1496-7c54d48f99-vjrcg"]
Oct 31 00:48:42.632433 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:42.632393    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"]
Oct 31 00:48:43.059152 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:43.059120    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="50175a7b-1e0d-4398-bacb-afffae46b712" path="/var/lib/kubelet/pods/50175a7b-1e0d-4398-bacb-afffae46b712/volumes"
Oct 31 00:48:43.059619 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:43.059602    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="a1fecfeb-15bf-4365-a76f-915eda6b56a0" path="/var/lib/kubelet/pods/a1fecfeb-15bf-4365-a76f-915eda6b56a0/volumes"
Oct 31 00:48:43.060462 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:43.060029    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="b77a849b-33f4-4a27-aaf5-45475b017feb" path="/var/lib/kubelet/pods/b77a849b-33f4-4a27-aaf5-45475b017feb/volumes"
Oct 31 00:48:43.060995 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:43.060969    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" path="/var/lib/kubelet/pods/daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c/volumes"
Oct 31 00:48:43.061632 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:43.061613    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fafaee93-015a-4a0b-bee3-115fc381d2e8" path="/var/lib/kubelet/pods/fafaee93-015a-4a0b-bee3-115fc381d2e8/volumes"
Oct 31 00:48:43.062306 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:43.062287    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="fc8f1228-2303-4afe-a4cc-831825f95a18" path="/var/lib/kubelet/pods/fc8f1228-2303-4afe-a4cc-831825f95a18/volumes"
Oct 31 00:48:48.000745 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:48.000714    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb"]
Oct 31 00:48:48.126922 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:48.126888    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"]
Oct 31 00:48:48.127135 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:48.127106    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp" podUID="26b5a389-67d4-4e8c-8353-a16770fe838c" containerName="istio-proxy" containerID="cri-o://3885c4f9ccaf5a6b9e1cd1edc4d7443024e0f6a733a12e68c2eedd390a3983e4" gracePeriod=30
Oct 31 00:48:48.148028 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:48.143754    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"]
Oct 31 00:48:48.148028 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:48.144083    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m" podUID="6990c602-9395-451f-ae35-8a351c5aacf7" containerName="istio-proxy" containerID="cri-o://ea44a86b2c07bb290dbeb148c7fb19617764d9fb36037e9d9c1fe7b51da65d59" gracePeriod=30
Oct 31 00:48:48.163460 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:48.163432    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"]
Oct 31 00:48:48.163959 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:48.163907    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs" podUID="411306d4-6572-4b06-950c-2f9fdf30a713" containerName="istio-proxy" containerID="cri-o://57192fe04d43f9319bac34e9978500ecaf10da10b946627b182e9d537d228565" gracePeriod=30
Oct 31 00:48:51.535653 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:51.535617    5946 patch_prober.go:29] interesting pod/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:48:51.536058 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:51.535719    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp" podUID="26b5a389-67d4-4e8c-8353-a16770fe838c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:48:53.001412 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.001366    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb" podUID="f284a1af-11d1-42bf-b051-a534bed8b400" containerName="payload-pre-processing" containerID="cri-o://0aec0d5c8dd185d14de5a8f7566f910d3db242487018e2d38707b1f7ae8c6c77" gracePeriod=25
Oct 31 00:48:53.619061 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.619035    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:48:53.622426 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.622402    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:48:53.627096 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.627079    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:48:53.675573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.675537    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-token\" (UniqueName: \"kubernetes.io/projected/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-token\") pod \"26b5a389-67d4-4e8c-8353-a16770fe838c\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") "
Oct 31 00:48:53.675747 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.675590    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-workload-certs\") pod \"6990c602-9395-451f-ae35-8a351c5aacf7\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") "
Oct 31 00:48:53.675747 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.675647    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-credential-socket\") pod \"411306d4-6572-4b06-950c-2f9fdf30a713\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") "
Oct 31 00:48:53.675747 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.675685    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-data\") pod \"26b5a389-67d4-4e8c-8353-a16770fe838c\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") "
Oct 31 00:48:53.675747 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.675727    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-credential-socket\") pod \"26b5a389-67d4-4e8c-8353-a16770fe838c\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") "
Oct 31 00:48:53.675969 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.675762    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-workload-socket\") pod \"26b5a389-67d4-4e8c-8353-a16770fe838c\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") "
Oct 31 00:48:53.675969 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.675793    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-envoy\") pod \"26b5a389-67d4-4e8c-8353-a16770fe838c\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") "
Oct 31 00:48:53.675969 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.675822    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-podinfo\") pod \"26b5a389-67d4-4e8c-8353-a16770fe838c\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") "
Oct 31 00:48:53.675969 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.675852    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6990c602-9395-451f-ae35-8a351c5aacf7-istio-token\" (UniqueName: \"kubernetes.io/projected/6990c602-9395-451f-ae35-8a351c5aacf7-istio-token\") pod \"6990c602-9395-451f-ae35-8a351c5aacf7\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") "
Oct 31 00:48:53.675969 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.675886    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-istio-data\") pod \"411306d4-6572-4b06-950c-2f9fdf30a713\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") "
Oct 31 00:48:53.675969 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.675892    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-workload-certs" pod "6990c602-9395-451f-ae35-8a351c5aacf7" (UID: "6990c602-9395-451f-ae35-8a351c5aacf7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.675969 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.675938    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-credential-socket" pod "411306d4-6572-4b06-950c-2f9fdf30a713" (UID: "411306d4-6572-4b06-950c-2f9fdf30a713"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.675969 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.675955    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6990c602-9395-451f-ae35-8a351c5aacf7-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6990c602-9395-451f-ae35-8a351c5aacf7-istio-podinfo\") pod \"6990c602-9395-451f-ae35-8a351c5aacf7\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") "
Oct 31 00:48:53.676432 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.675984    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-workload-certs\") pod \"411306d4-6572-4b06-950c-2f9fdf30a713\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") "
Oct 31 00:48:53.676432 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676022    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-istio-envoy\") pod \"411306d4-6572-4b06-950c-2f9fdf30a713\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") "
Oct 31 00:48:53.676432 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676056    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/26b5a389-67d4-4e8c-8353-a16770fe838c-kube-api-access-cnmvb\" (UniqueName: \"kubernetes.io/projected/26b5a389-67d4-4e8c-8353-a16770fe838c-kube-api-access-cnmvb\") pod \"26b5a389-67d4-4e8c-8353-a16770fe838c\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") "
Oct 31 00:48:53.676432 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676107    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-credential-socket\") pod \"6990c602-9395-451f-ae35-8a351c5aacf7\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") "
Oct 31 00:48:53.676432 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676154    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6990c602-9395-451f-ae35-8a351c5aacf7-kube-api-access-v28r4\" (UniqueName: \"kubernetes.io/projected/6990c602-9395-451f-ae35-8a351c5aacf7-kube-api-access-v28r4\") pod \"6990c602-9395-451f-ae35-8a351c5aacf7\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") "
Oct 31 00:48:53.676432 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676235    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-workload-socket\") pod \"6990c602-9395-451f-ae35-8a351c5aacf7\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") "
Oct 31 00:48:53.676432 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676275    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/411306d4-6572-4b06-950c-2f9fdf30a713-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/411306d4-6572-4b06-950c-2f9fdf30a713-istio-podinfo\") pod \"411306d4-6572-4b06-950c-2f9fdf30a713\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") "
Oct 31 00:48:53.676432 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676302    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/411306d4-6572-4b06-950c-2f9fdf30a713-istio-token\" (UniqueName: \"kubernetes.io/projected/411306d4-6572-4b06-950c-2f9fdf30a713-istio-token\") pod \"411306d4-6572-4b06-950c-2f9fdf30a713\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") "
Oct 31 00:48:53.676432 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676352    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/411306d4-6572-4b06-950c-2f9fdf30a713-kube-api-access-k58tw\" (UniqueName: \"kubernetes.io/projected/411306d4-6572-4b06-950c-2f9fdf30a713-kube-api-access-k58tw\") pod \"411306d4-6572-4b06-950c-2f9fdf30a713\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") "
Oct 31 00:48:53.676432 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676398    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/26b5a389-67d4-4e8c-8353-a16770fe838c-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26b5a389-67d4-4e8c-8353-a16770fe838c-istiod-ca-cert\") pod \"26b5a389-67d4-4e8c-8353-a16770fe838c\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") "
Oct 31 00:48:53.676931 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676520    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-istio-data\") pod \"6990c602-9395-451f-ae35-8a351c5aacf7\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") "
Oct 31 00:48:53.676931 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676549    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-istio-envoy\") pod \"6990c602-9395-451f-ae35-8a351c5aacf7\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") "
Oct 31 00:48:53.676931 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676599    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6990c602-9395-451f-ae35-8a351c5aacf7-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6990c602-9395-451f-ae35-8a351c5aacf7-istiod-ca-cert\") pod \"6990c602-9395-451f-ae35-8a351c5aacf7\" (UID: \"6990c602-9395-451f-ae35-8a351c5aacf7\") "
Oct 31 00:48:53.676931 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676722    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-workload-certs\") pod \"26b5a389-67d4-4e8c-8353-a16770fe838c\" (UID: \"26b5a389-67d4-4e8c-8353-a16770fe838c\") "
Oct 31 00:48:53.676931 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676755    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-workload-socket\") pod \"411306d4-6572-4b06-950c-2f9fdf30a713\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") "
Oct 31 00:48:53.676931 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676818    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/411306d4-6572-4b06-950c-2f9fdf30a713-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/411306d4-6572-4b06-950c-2f9fdf30a713-istiod-ca-cert\") pod \"411306d4-6572-4b06-950c-2f9fdf30a713\" (UID: \"411306d4-6572-4b06-950c-2f9fdf30a713\") "
Oct 31 00:48:53.679605 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.679578    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.679726 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.679609    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.681913 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676151    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-workload-socket" pod "26b5a389-67d4-4e8c-8353-a16770fe838c" (UID: "26b5a389-67d4-4e8c-8353-a16770fe838c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.682014 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676209    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-data" pod "26b5a389-67d4-4e8c-8353-a16770fe838c" (UID: "26b5a389-67d4-4e8c-8353-a16770fe838c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.682014 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676398    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-credential-socket" pod "26b5a389-67d4-4e8c-8353-a16770fe838c" (UID: "26b5a389-67d4-4e8c-8353-a16770fe838c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.682014 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.676616    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-credential-socket" pod "6990c602-9395-451f-ae35-8a351c5aacf7" (UID: "6990c602-9395-451f-ae35-8a351c5aacf7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.682014 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.677653    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-workload-certs" pod "411306d4-6572-4b06-950c-2f9fdf30a713" (UID: "411306d4-6572-4b06-950c-2f9fdf30a713"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.682014 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.677830    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-istio-data" pod "411306d4-6572-4b06-950c-2f9fdf30a713" (UID: "411306d4-6572-4b06-950c-2f9fdf30a713"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.682014 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.678320    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-workload-socket" pod "6990c602-9395-451f-ae35-8a351c5aacf7" (UID: "6990c602-9395-451f-ae35-8a351c5aacf7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.682014 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.679426    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26b5a389-67d4-4e8c-8353-a16770fe838c-istiod-ca-cert" pod "26b5a389-67d4-4e8c-8353-a16770fe838c" (UID: "26b5a389-67d4-4e8c-8353-a16770fe838c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:53.682014 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.679474    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6990c602-9395-451f-ae35-8a351c5aacf7-istio-token" pod "6990c602-9395-451f-ae35-8a351c5aacf7" (UID: "6990c602-9395-451f-ae35-8a351c5aacf7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:53.682014 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.679670    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-istio-data" pod "6990c602-9395-451f-ae35-8a351c5aacf7" (UID: "6990c602-9395-451f-ae35-8a351c5aacf7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.682014 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.681617    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-workload-certs" pod "26b5a389-67d4-4e8c-8353-a16770fe838c" (UID: "26b5a389-67d4-4e8c-8353-a16770fe838c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.682014 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.681700    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-envoy" pod "26b5a389-67d4-4e8c-8353-a16770fe838c" (UID: "26b5a389-67d4-4e8c-8353-a16770fe838c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.682014 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.681913    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-workload-socket" pod "411306d4-6572-4b06-950c-2f9fdf30a713" (UID: "411306d4-6572-4b06-950c-2f9fdf30a713"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.683260 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.682981    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-istio-envoy" pod "6990c602-9395-451f-ae35-8a351c5aacf7" (UID: "6990c602-9395-451f-ae35-8a351c5aacf7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.683260 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.683053    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-istio-envoy" pod "411306d4-6572-4b06-950c-2f9fdf30a713" (UID: "411306d4-6572-4b06-950c-2f9fdf30a713"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:53.683260 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.683107    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-podinfo" pod "26b5a389-67d4-4e8c-8353-a16770fe838c" (UID: "26b5a389-67d4-4e8c-8353-a16770fe838c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:48:53.683260 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.683155    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6990c602-9395-451f-ae35-8a351c5aacf7-istio-podinfo" pod "6990c602-9395-451f-ae35-8a351c5aacf7" (UID: "6990c602-9395-451f-ae35-8a351c5aacf7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:48:53.683522 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.683405    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/411306d4-6572-4b06-950c-2f9fdf30a713-istiod-ca-cert" pod "411306d4-6572-4b06-950c-2f9fdf30a713" (UID: "411306d4-6572-4b06-950c-2f9fdf30a713"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:53.683522 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.683473    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-token" pod "26b5a389-67d4-4e8c-8353-a16770fe838c" (UID: "26b5a389-67d4-4e8c-8353-a16770fe838c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:53.683633 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.683525    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6990c602-9395-451f-ae35-8a351c5aacf7-istiod-ca-cert" pod "6990c602-9395-451f-ae35-8a351c5aacf7" (UID: "6990c602-9395-451f-ae35-8a351c5aacf7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:48:53.683749 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.683727    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/411306d4-6572-4b06-950c-2f9fdf30a713-kube-api-access-k58tw" pod "411306d4-6572-4b06-950c-2f9fdf30a713" (UID: "411306d4-6572-4b06-950c-2f9fdf30a713"). InnerVolumeSpecName "kube-api-access-k58tw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:53.683845 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.683827    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26b5a389-67d4-4e8c-8353-a16770fe838c-kube-api-access-cnmvb" pod "26b5a389-67d4-4e8c-8353-a16770fe838c" (UID: "26b5a389-67d4-4e8c-8353-a16770fe838c"). InnerVolumeSpecName "kube-api-access-cnmvb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:53.684033 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.684010    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6990c602-9395-451f-ae35-8a351c5aacf7-kube-api-access-v28r4" pod "6990c602-9395-451f-ae35-8a351c5aacf7" (UID: "6990c602-9395-451f-ae35-8a351c5aacf7"). InnerVolumeSpecName "kube-api-access-v28r4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:53.684386 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.684362    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/411306d4-6572-4b06-950c-2f9fdf30a713-istio-podinfo" pod "411306d4-6572-4b06-950c-2f9fdf30a713" (UID: "411306d4-6572-4b06-950c-2f9fdf30a713"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:48:53.685841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.685817    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/411306d4-6572-4b06-950c-2f9fdf30a713-istio-token" pod "411306d4-6572-4b06-950c-2f9fdf30a713" (UID: "411306d4-6572-4b06-950c-2f9fdf30a713"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:53.781054 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781024    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781054 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781050    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6990c602-9395-451f-ae35-8a351c5aacf7-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781054 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781060    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781068    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781077    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cnmvb\" (UniqueName: \"kubernetes.io/projected/26b5a389-67d4-4e8c-8353-a16770fe838c-kube-api-access-cnmvb\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781087    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781095    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v28r4\" (UniqueName: \"kubernetes.io/projected/6990c602-9395-451f-ae35-8a351c5aacf7-kube-api-access-v28r4\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781103    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781112    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/411306d4-6572-4b06-950c-2f9fdf30a713-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781120    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/411306d4-6572-4b06-950c-2f9fdf30a713-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781128    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k58tw\" (UniqueName: \"kubernetes.io/projected/411306d4-6572-4b06-950c-2f9fdf30a713-kube-api-access-k58tw\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781136    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/26b5a389-67d4-4e8c-8353-a16770fe838c-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781144    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781151    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6990c602-9395-451f-ae35-8a351c5aacf7-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781159    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6990c602-9395-451f-ae35-8a351c5aacf7-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781168    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781177    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/411306d4-6572-4b06-950c-2f9fdf30a713-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781186    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/411306d4-6572-4b06-950c-2f9fdf30a713-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781195    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781205    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781213    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781240    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781249    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781258    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/26b5a389-67d4-4e8c-8353-a16770fe838c-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.781396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.781268    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6990c602-9395-451f-ae35-8a351c5aacf7-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:53.836362 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.836283    5946 generic.go:356] "Generic (PLEG): container finished" podID="26b5a389-67d4-4e8c-8353-a16770fe838c" containerID="3885c4f9ccaf5a6b9e1cd1edc4d7443024e0f6a733a12e68c2eedd390a3983e4" exitCode=0
Oct 31 00:48:53.836362 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.836322    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp" event={"ID":"26b5a389-67d4-4e8c-8353-a16770fe838c","Type":"ContainerDied","Data":"3885c4f9ccaf5a6b9e1cd1edc4d7443024e0f6a733a12e68c2eedd390a3983e4"}
Oct 31 00:48:53.836362 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.836356    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"
Oct 31 00:48:53.836647 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.836432    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp" event={"ID":"26b5a389-67d4-4e8c-8353-a16770fe838c","Type":"ContainerDied","Data":"bcb83082d1705897ccb6bfda16d21f38fefad07dcefa22fe8422d6d6151ed9c1"}
Oct 31 00:48:53.836647 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.836464    5946 scope.go:122] "RemoveContainer" containerID="3885c4f9ccaf5a6b9e1cd1edc4d7443024e0f6a733a12e68c2eedd390a3983e4"
Oct 31 00:48:53.838305 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.838258    5946 generic.go:356] "Generic (PLEG): container finished" podID="6990c602-9395-451f-ae35-8a351c5aacf7" containerID="ea44a86b2c07bb290dbeb148c7fb19617764d9fb36037e9d9c1fe7b51da65d59" exitCode=0
Oct 31 00:48:53.838433 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.838309    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"
Oct 31 00:48:53.838433 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.838341    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m" event={"ID":"6990c602-9395-451f-ae35-8a351c5aacf7","Type":"ContainerDied","Data":"ea44a86b2c07bb290dbeb148c7fb19617764d9fb36037e9d9c1fe7b51da65d59"}
Oct 31 00:48:53.838433 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.838399    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m" event={"ID":"6990c602-9395-451f-ae35-8a351c5aacf7","Type":"ContainerDied","Data":"28be893a65ab9070e682aed78f4684c7c927a1d4e4977cebe6fc17735f0018d3"}
Oct 31 00:48:53.840147 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.840124    5946 generic.go:356] "Generic (PLEG): container finished" podID="411306d4-6572-4b06-950c-2f9fdf30a713" containerID="57192fe04d43f9319bac34e9978500ecaf10da10b946627b182e9d537d228565" exitCode=0
Oct 31 00:48:53.840280 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.840181    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs" event={"ID":"411306d4-6572-4b06-950c-2f9fdf30a713","Type":"ContainerDied","Data":"57192fe04d43f9319bac34e9978500ecaf10da10b946627b182e9d537d228565"}
Oct 31 00:48:53.840280 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.840208    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs" event={"ID":"411306d4-6572-4b06-950c-2f9fdf30a713","Type":"ContainerDied","Data":"dda3212fc2422babcb479406ed9a9c57ced0804e67529db40686e4dece20a9d4"}
Oct 31 00:48:53.840399 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.840280    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"
Oct 31 00:48:53.850376 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.850356    5946 scope.go:122] "RemoveContainer" containerID="3885c4f9ccaf5a6b9e1cd1edc4d7443024e0f6a733a12e68c2eedd390a3983e4"
Oct 31 00:48:53.850677 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:48:53.850640    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3885c4f9ccaf5a6b9e1cd1edc4d7443024e0f6a733a12e68c2eedd390a3983e4\": container with ID starting with 3885c4f9ccaf5a6b9e1cd1edc4d7443024e0f6a733a12e68c2eedd390a3983e4 not found: ID does not exist" containerID="3885c4f9ccaf5a6b9e1cd1edc4d7443024e0f6a733a12e68c2eedd390a3983e4"
Oct 31 00:48:53.850783 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.850678    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3885c4f9ccaf5a6b9e1cd1edc4d7443024e0f6a733a12e68c2eedd390a3983e4"} err="failed to get container status \"3885c4f9ccaf5a6b9e1cd1edc4d7443024e0f6a733a12e68c2eedd390a3983e4\": rpc error: code = NotFound desc = could not find container \"3885c4f9ccaf5a6b9e1cd1edc4d7443024e0f6a733a12e68c2eedd390a3983e4\": container with ID starting with 3885c4f9ccaf5a6b9e1cd1edc4d7443024e0f6a733a12e68c2eedd390a3983e4 not found: ID does not exist"
Oct 31 00:48:53.850783 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.850696    5946 scope.go:122] "RemoveContainer" containerID="ea44a86b2c07bb290dbeb148c7fb19617764d9fb36037e9d9c1fe7b51da65d59"
Oct 31 00:48:53.862297 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.862275    5946 scope.go:122] "RemoveContainer" containerID="0e44cdabb93cf120d5932387bdd5de6e1323abcabd26043ccd7f9a2f286d3d9e"
Oct 31 00:48:53.872028 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.872006    5946 scope.go:122] "RemoveContainer" containerID="ea44a86b2c07bb290dbeb148c7fb19617764d9fb36037e9d9c1fe7b51da65d59"
Oct 31 00:48:53.872337 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:48:53.872318    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea44a86b2c07bb290dbeb148c7fb19617764d9fb36037e9d9c1fe7b51da65d59\": container with ID starting with ea44a86b2c07bb290dbeb148c7fb19617764d9fb36037e9d9c1fe7b51da65d59 not found: ID does not exist" containerID="ea44a86b2c07bb290dbeb148c7fb19617764d9fb36037e9d9c1fe7b51da65d59"
Oct 31 00:48:53.872405 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.872346    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea44a86b2c07bb290dbeb148c7fb19617764d9fb36037e9d9c1fe7b51da65d59"} err="failed to get container status \"ea44a86b2c07bb290dbeb148c7fb19617764d9fb36037e9d9c1fe7b51da65d59\": rpc error: code = NotFound desc = could not find container \"ea44a86b2c07bb290dbeb148c7fb19617764d9fb36037e9d9c1fe7b51da65d59\": container with ID starting with ea44a86b2c07bb290dbeb148c7fb19617764d9fb36037e9d9c1fe7b51da65d59 not found: ID does not exist"
Oct 31 00:48:53.872405 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.872363    5946 scope.go:122] "RemoveContainer" containerID="0e44cdabb93cf120d5932387bdd5de6e1323abcabd26043ccd7f9a2f286d3d9e"
Oct 31 00:48:53.872630 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:48:53.872614    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e44cdabb93cf120d5932387bdd5de6e1323abcabd26043ccd7f9a2f286d3d9e\": container with ID starting with 0e44cdabb93cf120d5932387bdd5de6e1323abcabd26043ccd7f9a2f286d3d9e not found: ID does not exist" containerID="0e44cdabb93cf120d5932387bdd5de6e1323abcabd26043ccd7f9a2f286d3d9e"
Oct 31 00:48:53.872689 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.872638    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e44cdabb93cf120d5932387bdd5de6e1323abcabd26043ccd7f9a2f286d3d9e"} err="failed to get container status \"0e44cdabb93cf120d5932387bdd5de6e1323abcabd26043ccd7f9a2f286d3d9e\": rpc error: code = NotFound desc = could not find container \"0e44cdabb93cf120d5932387bdd5de6e1323abcabd26043ccd7f9a2f286d3d9e\": container with ID starting with 0e44cdabb93cf120d5932387bdd5de6e1323abcabd26043ccd7f9a2f286d3d9e not found: ID does not exist"
Oct 31 00:48:53.872689 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.872656    5946 scope.go:122] "RemoveContainer" containerID="57192fe04d43f9319bac34e9978500ecaf10da10b946627b182e9d537d228565"
Oct 31 00:48:53.882764 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.882746    5946 scope.go:122] "RemoveContainer" containerID="57192fe04d43f9319bac34e9978500ecaf10da10b946627b182e9d537d228565"
Oct 31 00:48:53.883107 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:48:53.883081    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"57192fe04d43f9319bac34e9978500ecaf10da10b946627b182e9d537d228565\": container with ID starting with 57192fe04d43f9319bac34e9978500ecaf10da10b946627b182e9d537d228565 not found: ID does not exist" containerID="57192fe04d43f9319bac34e9978500ecaf10da10b946627b182e9d537d228565"
Oct 31 00:48:53.883204 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.883114    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"57192fe04d43f9319bac34e9978500ecaf10da10b946627b182e9d537d228565"} err="failed to get container status \"57192fe04d43f9319bac34e9978500ecaf10da10b946627b182e9d537d228565\": rpc error: code = NotFound desc = could not find container \"57192fe04d43f9319bac34e9978500ecaf10da10b946627b182e9d537d228565\": container with ID starting with 57192fe04d43f9319bac34e9978500ecaf10da10b946627b182e9d537d228565 not found: ID does not exist"
Oct 31 00:48:53.884026 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.884005    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"]
Oct 31 00:48:53.899084 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.899055    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-8p42m"]
Oct 31 00:48:53.917840 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.917818    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"]
Oct 31 00:48:53.933115 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.933089    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-nkcwp"]
Oct 31 00:48:53.956578 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.956551    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"]
Oct 31 00:48:53.964466 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:53.964441    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w1-7f1496-openshift-default-8665bf5969-6rxvs"]
Oct 31 00:48:55.065706 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:55.064736    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="26b5a389-67d4-4e8c-8353-a16770fe838c" path="/var/lib/kubelet/pods/26b5a389-67d4-4e8c-8353-a16770fe838c/volumes"
Oct 31 00:48:55.065706 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:55.065494    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="411306d4-6572-4b06-950c-2f9fdf30a713" path="/var/lib/kubelet/pods/411306d4-6572-4b06-950c-2f9fdf30a713/volumes"
Oct 31 00:48:55.067479 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:55.066832    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6990c602-9395-451f-ae35-8a351c5aacf7" path="/var/lib/kubelet/pods/6990c602-9395-451f-ae35-8a351c5aacf7/volumes"
Oct 31 00:48:57.658207 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:57.658169    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh" podUID="8e9eecae-26a9-4cba-96c0-6e926d854027" containerName="main" containerID="cri-o://06cc986fa64a3dfcc2092a782dda978ef3ed445bbb206d666e703a0e11f47a8c" gracePeriod=45
Oct 31 00:48:57.880837 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:57.880805    5946 generic.go:356] "Generic (PLEG): container finished" podID="8e9eecae-26a9-4cba-96c0-6e926d854027" containerID="06cc986fa64a3dfcc2092a782dda978ef3ed445bbb206d666e703a0e11f47a8c" exitCode=0
Oct 31 00:48:57.881004 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:57.880880    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh" event={"ID":"8e9eecae-26a9-4cba-96c0-6e926d854027","Type":"ContainerDied","Data":"06cc986fa64a3dfcc2092a782dda978ef3ed445bbb206d666e703a0e11f47a8c"}
Oct 31 00:48:57.927393 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:57.927369    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:48:58.034940 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.034912    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-home\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-home\") pod \"8e9eecae-26a9-4cba-96c0-6e926d854027\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") "
Oct 31 00:48:58.035104 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.035017    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/8e9eecae-26a9-4cba-96c0-6e926d854027-tls-certs\" (UniqueName: \"kubernetes.io/secret/8e9eecae-26a9-4cba-96c0-6e926d854027-tls-certs\") pod \"8e9eecae-26a9-4cba-96c0-6e926d854027\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") "
Oct 31 00:48:58.035104 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.035042    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-dshm\") pod \"8e9eecae-26a9-4cba-96c0-6e926d854027\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") "
Oct 31 00:48:58.035104 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.035065    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-tmp-dir\") pod \"8e9eecae-26a9-4cba-96c0-6e926d854027\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") "
Oct 31 00:48:58.035104 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.035101    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8e9eecae-26a9-4cba-96c0-6e926d854027-kube-api-access-h6hh2\" (UniqueName: \"kubernetes.io/projected/8e9eecae-26a9-4cba-96c0-6e926d854027-kube-api-access-h6hh2\") pod \"8e9eecae-26a9-4cba-96c0-6e926d854027\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") "
Oct 31 00:48:58.035339 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.035186    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-home" pod "8e9eecae-26a9-4cba-96c0-6e926d854027" (UID: "8e9eecae-26a9-4cba-96c0-6e926d854027"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:58.035339 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.035259    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-model-cache\") pod \"8e9eecae-26a9-4cba-96c0-6e926d854027\" (UID: \"8e9eecae-26a9-4cba-96c0-6e926d854027\") "
Oct 31 00:48:58.035446 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.035394    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-tmp-dir" pod "8e9eecae-26a9-4cba-96c0-6e926d854027" (UID: "8e9eecae-26a9-4cba-96c0-6e926d854027"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:58.035546 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.035522    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-model-cache" pod "8e9eecae-26a9-4cba-96c0-6e926d854027" (UID: "8e9eecae-26a9-4cba-96c0-6e926d854027"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:58.035841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.035816    5946 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-model-cache\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:58.035978 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.035844    5946 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-home\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:58.035978 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.035886    5946 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-tmp-dir\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:58.037261 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.037230    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-dshm" pod "8e9eecae-26a9-4cba-96c0-6e926d854027" (UID: "8e9eecae-26a9-4cba-96c0-6e926d854027"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:48:58.037343 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.037301    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e9eecae-26a9-4cba-96c0-6e926d854027-tls-certs" pod "8e9eecae-26a9-4cba-96c0-6e926d854027" (UID: "8e9eecae-26a9-4cba-96c0-6e926d854027"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:48:58.037343 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.037306    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e9eecae-26a9-4cba-96c0-6e926d854027-kube-api-access-h6hh2" pod "8e9eecae-26a9-4cba-96c0-6e926d854027" (UID: "8e9eecae-26a9-4cba-96c0-6e926d854027"). InnerVolumeSpecName "kube-api-access-h6hh2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:48:58.137378 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.137342    5946 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e9eecae-26a9-4cba-96c0-6e926d854027-tls-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:58.137378 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.137377    5946 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e9eecae-26a9-4cba-96c0-6e926d854027-dshm\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:58.137616 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.137390    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6hh2\" (UniqueName: \"kubernetes.io/projected/8e9eecae-26a9-4cba-96c0-6e926d854027-kube-api-access-h6hh2\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:48:58.873835 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.873792    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh" podUID="8e9eecae-26a9-4cba-96c0-6e926d854027" containerName="main" probeResult="failure" output="Get \"https://10.134.0.76:8000/ready\": net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:48:58.889556 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.889529    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"
Oct 31 00:48:58.889695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.889565    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh" event={"ID":"8e9eecae-26a9-4cba-96c0-6e926d854027","Type":"ContainerDied","Data":"bdc8d6d391fcae5d9e079b6054b285be477968b1675edc3a09dee68033c84af1"}
Oct 31 00:48:58.889695 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.889619    5946 scope.go:122] "RemoveContainer" containerID="06cc986fa64a3dfcc2092a782dda978ef3ed445bbb206d666e703a0e11f47a8c"
Oct 31 00:48:58.913000 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.912976    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"]
Oct 31 00:48:58.921688 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:58.921664    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w4-5c2a03/distinct-2-w4-5c2a03-kserve-d66d86854-62jfh"]
Oct 31 00:48:59.056379 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:48:59.056347    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8e9eecae-26a9-4cba-96c0-6e926d854027" path="/var/lib/kubelet/pods/8e9eecae-26a9-4cba-96c0-6e926d854027/volumes"
Oct 31 00:49:00.522475 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:00.522441    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"]
Oct 31 00:49:00.523625 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:00.523590    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh" podUID="0324c9b7-a909-4a11-bab2-689600a09b88" containerName="istio-proxy" containerID="cri-o://156a82c26cc282bc24001c4def7a947c34b5da3c44fbb87b50310453019412e3" gracePeriod=30
Oct 31 00:49:00.528414 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:00.528384    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"]
Oct 31 00:49:00.528616 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:00.528594    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g" podUID="6f1f21c9-c572-4c8c-8368-ff74ff058804" containerName="istio-proxy" containerID="cri-o://db69b4af81ea7046eae4af262c1dbc6014ffa6d0b5e787d7b5c72ca0128bae79" gracePeriod=30
Oct 31 00:49:00.555977 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:00.555938    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"]
Oct 31 00:49:00.556202 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:00.556172    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l" podUID="d5c3e93a-655f-4a76-85ba-71a904a5dad2" containerName="istio-proxy" containerID="cri-o://dfc71840c203ae3e42bee1d59eb9afbf6c3704942522b3101d229cc317ae6ae5" gracePeriod=30
Oct 31 00:49:01.368689 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:01.368649    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:49:02.771244 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:02.770943    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb" podUID="f284a1af-11d1-42bf-b051-a534bed8b400" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:49:04.310625 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.310586    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"]
Oct 31 00:49:04.311097 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.310824    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx" podUID="95983973-b5ea-4f87-a3f5-62f5c9850747" containerName="maas-api" containerID="cri-o://12e847ab86706da5967dc79d108bf9530f98e5f4e942f0cf62ffa5536b4d6a27" gracePeriod=30
Oct 31 00:49:04.613196 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.613165    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"
Oct 31 00:49:04.690016 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.689977    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/95983973-b5ea-4f87-a3f5-62f5c9850747-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95983973-b5ea-4f87-a3f5-62f5c9850747-maas-api-tls\") pod \"95983973-b5ea-4f87-a3f5-62f5c9850747\" (UID: \"95983973-b5ea-4f87-a3f5-62f5c9850747\") "
Oct 31 00:49:04.690195 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.690049    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/95983973-b5ea-4f87-a3f5-62f5c9850747-kube-api-access-lzjhn\" (UniqueName: \"kubernetes.io/projected/95983973-b5ea-4f87-a3f5-62f5c9850747-kube-api-access-lzjhn\") pod \"95983973-b5ea-4f87-a3f5-62f5c9850747\" (UID: \"95983973-b5ea-4f87-a3f5-62f5c9850747\") "
Oct 31 00:49:04.690195 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.690098    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/95983973-b5ea-4f87-a3f5-62f5c9850747-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95983973-b5ea-4f87-a3f5-62f5c9850747-openshift-service-ca\") pod \"95983973-b5ea-4f87-a3f5-62f5c9850747\" (UID: \"95983973-b5ea-4f87-a3f5-62f5c9850747\") "
Oct 31 00:49:04.690331 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.690255    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/95983973-b5ea-4f87-a3f5-62f5c9850747-metrics-certs\" (UniqueName: \"kubernetes.io/secret/95983973-b5ea-4f87-a3f5-62f5c9850747-metrics-certs\") pod \"95983973-b5ea-4f87-a3f5-62f5c9850747\" (UID: \"95983973-b5ea-4f87-a3f5-62f5c9850747\") "
Oct 31 00:49:04.690542 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.690515    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95983973-b5ea-4f87-a3f5-62f5c9850747-openshift-service-ca" pod "95983973-b5ea-4f87-a3f5-62f5c9850747" (UID: "95983973-b5ea-4f87-a3f5-62f5c9850747"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:49:04.690849 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.690829    5946 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/95983973-b5ea-4f87-a3f5-62f5c9850747-openshift-service-ca\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:04.692120 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.692095    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95983973-b5ea-4f87-a3f5-62f5c9850747-maas-api-tls" pod "95983973-b5ea-4f87-a3f5-62f5c9850747" (UID: "95983973-b5ea-4f87-a3f5-62f5c9850747"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:49:04.692265 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.692248    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95983973-b5ea-4f87-a3f5-62f5c9850747-metrics-certs" pod "95983973-b5ea-4f87-a3f5-62f5c9850747" (UID: "95983973-b5ea-4f87-a3f5-62f5c9850747"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:49:04.692337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.692292    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95983973-b5ea-4f87-a3f5-62f5c9850747-kube-api-access-lzjhn" pod "95983973-b5ea-4f87-a3f5-62f5c9850747" (UID: "95983973-b5ea-4f87-a3f5-62f5c9850747"). InnerVolumeSpecName "kube-api-access-lzjhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:04.797123 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.797086    5946 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/95983973-b5ea-4f87-a3f5-62f5c9850747-maas-api-tls\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:04.797394 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.797376    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lzjhn\" (UniqueName: \"kubernetes.io/projected/95983973-b5ea-4f87-a3f5-62f5c9850747-kube-api-access-lzjhn\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:04.797607 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.797583    5946 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95983973-b5ea-4f87-a3f5-62f5c9850747-metrics-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:04.970871 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.970793    5946 generic.go:356] "Generic (PLEG): container finished" podID="95983973-b5ea-4f87-a3f5-62f5c9850747" containerID="12e847ab86706da5967dc79d108bf9530f98e5f4e942f0cf62ffa5536b4d6a27" exitCode=0
Oct 31 00:49:04.970871 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.970838    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"
Oct 31 00:49:04.971052 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.970880    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx" event={"ID":"95983973-b5ea-4f87-a3f5-62f5c9850747","Type":"ContainerDied","Data":"12e847ab86706da5967dc79d108bf9530f98e5f4e942f0cf62ffa5536b4d6a27"}
Oct 31 00:49:04.971052 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.970933    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx" event={"ID":"95983973-b5ea-4f87-a3f5-62f5c9850747","Type":"ContainerDied","Data":"391f4e78ed9a530506df30ea9d2447cb57f5f65439b7ac4a57044e3fd5acbd28"}
Oct 31 00:49:04.971052 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.970956    5946 scope.go:122] "RemoveContainer" containerID="12e847ab86706da5967dc79d108bf9530f98e5f4e942f0cf62ffa5536b4d6a27"
Oct 31 00:49:04.981435 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.981421    5946 scope.go:122] "RemoveContainer" containerID="12e847ab86706da5967dc79d108bf9530f98e5f4e942f0cf62ffa5536b4d6a27"
Oct 31 00:49:04.981704 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:49:04.981684    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"12e847ab86706da5967dc79d108bf9530f98e5f4e942f0cf62ffa5536b4d6a27\": container with ID starting with 12e847ab86706da5967dc79d108bf9530f98e5f4e942f0cf62ffa5536b4d6a27 not found: ID does not exist" containerID="12e847ab86706da5967dc79d108bf9530f98e5f4e942f0cf62ffa5536b4d6a27"
Oct 31 00:49:04.981769 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:04.981716    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"12e847ab86706da5967dc79d108bf9530f98e5f4e942f0cf62ffa5536b4d6a27"} err="failed to get container status \"12e847ab86706da5967dc79d108bf9530f98e5f4e942f0cf62ffa5536b4d6a27\": rpc error: code = NotFound desc = could not find container \"12e847ab86706da5967dc79d108bf9530f98e5f4e942f0cf62ffa5536b4d6a27\": container with ID starting with 12e847ab86706da5967dc79d108bf9530f98e5f4e942f0cf62ffa5536b4d6a27 not found: ID does not exist"
Oct 31 00:49:05.010166 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.010140    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"]
Oct 31 00:49:05.021014 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.020987    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-w4-5c2a03-75fd9d48fc-89mmx"]
Oct 31 00:49:05.063554 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.063519    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="95983973-b5ea-4f87-a3f5-62f5c9850747" path="/var/lib/kubelet/pods/95983973-b5ea-4f87-a3f5-62f5c9850747/volumes"
Oct 31 00:49:05.844443 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.844412    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:49:05.909042 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.909016    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d5c3e93a-655f-4a76-85ba-71a904a5dad2-kube-api-access-64xmf\" (UniqueName: \"kubernetes.io/projected/d5c3e93a-655f-4a76-85ba-71a904a5dad2-kube-api-access-64xmf\") pod \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") "
Oct 31 00:49:05.909198 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.909056    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-envoy\") pod \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") "
Oct 31 00:49:05.909198 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.909078    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-workload-certs\") pod \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") "
Oct 31 00:49:05.909198 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.909172    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-podinfo\") pod \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") "
Oct 31 00:49:05.909366 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.909198    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-workload-socket\") pod \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") "
Oct 31 00:49:05.909366 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.909235    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-token\" (UniqueName: \"kubernetes.io/projected/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-token\") pod \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") "
Oct 31 00:49:05.909366 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.909296    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istiod-ca-cert\") pod \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") "
Oct 31 00:49:05.909366 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.909334    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-credential-socket\") pod \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") "
Oct 31 00:49:05.909366 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.909361    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-data\") pod \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\" (UID: \"d5c3e93a-655f-4a76-85ba-71a904a5dad2\") "
Oct 31 00:49:05.909663 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.909631    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-credential-socket" pod "d5c3e93a-655f-4a76-85ba-71a904a5dad2" (UID: "d5c3e93a-655f-4a76-85ba-71a904a5dad2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:05.910174 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.909812    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-workload-socket" pod "d5c3e93a-655f-4a76-85ba-71a904a5dad2" (UID: "d5c3e93a-655f-4a76-85ba-71a904a5dad2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:05.910174 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.909838    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-workload-certs" pod "d5c3e93a-655f-4a76-85ba-71a904a5dad2" (UID: "d5c3e93a-655f-4a76-85ba-71a904a5dad2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:05.910174 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.909749    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istiod-ca-cert" pod "d5c3e93a-655f-4a76-85ba-71a904a5dad2" (UID: "d5c3e93a-655f-4a76-85ba-71a904a5dad2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:49:05.910174 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.909965    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-data" pod "d5c3e93a-655f-4a76-85ba-71a904a5dad2" (UID: "d5c3e93a-655f-4a76-85ba-71a904a5dad2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:05.910174 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.910082    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:05.910174 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.910106    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:05.910174 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.910122    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:05.910174 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.910137    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:05.910174 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.910153    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:05.911396 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.911372    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-podinfo" pod "d5c3e93a-655f-4a76-85ba-71a904a5dad2" (UID: "d5c3e93a-655f-4a76-85ba-71a904a5dad2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:49:05.911494 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.911424    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5c3e93a-655f-4a76-85ba-71a904a5dad2-kube-api-access-64xmf" pod "d5c3e93a-655f-4a76-85ba-71a904a5dad2" (UID: "d5c3e93a-655f-4a76-85ba-71a904a5dad2"). InnerVolumeSpecName "kube-api-access-64xmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:05.911600 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.911587    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-envoy" pod "d5c3e93a-655f-4a76-85ba-71a904a5dad2" (UID: "d5c3e93a-655f-4a76-85ba-71a904a5dad2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:05.911889 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.911868    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-token" pod "d5c3e93a-655f-4a76-85ba-71a904a5dad2" (UID: "d5c3e93a-655f-4a76-85ba-71a904a5dad2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:05.981736 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.981702    5946 generic.go:356] "Generic (PLEG): container finished" podID="0324c9b7-a909-4a11-bab2-689600a09b88" containerID="156a82c26cc282bc24001c4def7a947c34b5da3c44fbb87b50310453019412e3" exitCode=0
Oct 31 00:49:05.981884 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.981781    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh" event={"ID":"0324c9b7-a909-4a11-bab2-689600a09b88","Type":"ContainerDied","Data":"156a82c26cc282bc24001c4def7a947c34b5da3c44fbb87b50310453019412e3"}
Oct 31 00:49:05.984739 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.984716    5946 generic.go:356] "Generic (PLEG): container finished" podID="6f1f21c9-c572-4c8c-8368-ff74ff058804" containerID="db69b4af81ea7046eae4af262c1dbc6014ffa6d0b5e787d7b5c72ca0128bae79" exitCode=0
Oct 31 00:49:05.984873 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.984790    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g" event={"ID":"6f1f21c9-c572-4c8c-8368-ff74ff058804","Type":"ContainerDied","Data":"db69b4af81ea7046eae4af262c1dbc6014ffa6d0b5e787d7b5c72ca0128bae79"}
Oct 31 00:49:05.986329 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.986308    5946 generic.go:356] "Generic (PLEG): container finished" podID="d5c3e93a-655f-4a76-85ba-71a904a5dad2" containerID="dfc71840c203ae3e42bee1d59eb9afbf6c3704942522b3101d229cc317ae6ae5" exitCode=0
Oct 31 00:49:05.986438 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.986358    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l" event={"ID":"d5c3e93a-655f-4a76-85ba-71a904a5dad2","Type":"ContainerDied","Data":"dfc71840c203ae3e42bee1d59eb9afbf6c3704942522b3101d229cc317ae6ae5"}
Oct 31 00:49:05.986438 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.986379    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"
Oct 31 00:49:05.986438 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.986392    5946 scope.go:122] "RemoveContainer" containerID="dfc71840c203ae3e42bee1d59eb9afbf6c3704942522b3101d229cc317ae6ae5"
Oct 31 00:49:05.986579 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.986383    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l" event={"ID":"d5c3e93a-655f-4a76-85ba-71a904a5dad2","Type":"ContainerDied","Data":"c0afb974948e33c517334068b24608b2478907032a636bad3a55465d0713fdaa"}
Oct 31 00:49:05.996758 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.996744    5946 scope.go:122] "RemoveContainer" containerID="dfc71840c203ae3e42bee1d59eb9afbf6c3704942522b3101d229cc317ae6ae5"
Oct 31 00:49:05.997020 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:49:05.997003    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfc71840c203ae3e42bee1d59eb9afbf6c3704942522b3101d229cc317ae6ae5\": container with ID starting with dfc71840c203ae3e42bee1d59eb9afbf6c3704942522b3101d229cc317ae6ae5 not found: ID does not exist" containerID="dfc71840c203ae3e42bee1d59eb9afbf6c3704942522b3101d229cc317ae6ae5"
Oct 31 00:49:05.997072 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:05.997032    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfc71840c203ae3e42bee1d59eb9afbf6c3704942522b3101d229cc317ae6ae5"} err="failed to get container status \"dfc71840c203ae3e42bee1d59eb9afbf6c3704942522b3101d229cc317ae6ae5\": rpc error: code = NotFound desc = could not find container \"dfc71840c203ae3e42bee1d59eb9afbf6c3704942522b3101d229cc317ae6ae5\": container with ID starting with dfc71840c203ae3e42bee1d59eb9afbf6c3704942522b3101d229cc317ae6ae5 not found: ID does not exist"
Oct 31 00:49:06.011455 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.011430    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.011455 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.011453    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.011576 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.011462    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d5c3e93a-655f-4a76-85ba-71a904a5dad2-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.011576 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.011471    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-64xmf\" (UniqueName: \"kubernetes.io/projected/d5c3e93a-655f-4a76-85ba-71a904a5dad2-kube-api-access-64xmf\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.015419 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.015281    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"]
Oct 31 00:49:06.017534 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.017496    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-tlp4l"]
Oct 31 00:49:06.221275 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.221247    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:49:06.237402 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.237377    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:49:06.316620 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.316587    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-workload-socket\") pod \"0324c9b7-a909-4a11-bab2-689600a09b88\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") "
Oct 31 00:49:06.316808 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.316640    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-podinfo\") pod \"6f1f21c9-c572-4c8c-8368-ff74ff058804\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") "
Oct 31 00:49:06.316808 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.316694    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0324c9b7-a909-4a11-bab2-689600a09b88-istio-token\" (UniqueName: \"kubernetes.io/projected/0324c9b7-a909-4a11-bab2-689600a09b88-istio-token\") pod \"0324c9b7-a909-4a11-bab2-689600a09b88\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") "
Oct 31 00:49:06.316808 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.316731    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-workload-certs\") pod \"0324c9b7-a909-4a11-bab2-689600a09b88\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") "
Oct 31 00:49:06.316973 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.316903    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-envoy\") pod \"6f1f21c9-c572-4c8c-8368-ff74ff058804\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") "
Oct 31 00:49:06.316973 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.316911    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-workload-socket" pod "0324c9b7-a909-4a11-bab2-689600a09b88" (UID: "0324c9b7-a909-4a11-bab2-689600a09b88"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:06.316973 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.316952    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-credential-socket\") pod \"6f1f21c9-c572-4c8c-8368-ff74ff058804\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") "
Oct 31 00:49:06.317188 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.316996    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-data\") pod \"6f1f21c9-c572-4c8c-8368-ff74ff058804\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") "
Oct 31 00:49:06.317188 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.317055    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f1f21c9-c572-4c8c-8368-ff74ff058804-kube-api-access-pcw99\" (UniqueName: \"kubernetes.io/projected/6f1f21c9-c572-4c8c-8368-ff74ff058804-kube-api-access-pcw99\") pod \"6f1f21c9-c572-4c8c-8368-ff74ff058804\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") "
Oct 31 00:49:06.317188 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.317091    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-istio-data\") pod \"0324c9b7-a909-4a11-bab2-689600a09b88\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") "
Oct 31 00:49:06.317188 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.317126    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-credential-socket\") pod \"0324c9b7-a909-4a11-bab2-689600a09b88\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") "
Oct 31 00:49:06.317418 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.317294    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/0324c9b7-a909-4a11-bab2-689600a09b88-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0324c9b7-a909-4a11-bab2-689600a09b88-istio-podinfo\") pod \"0324c9b7-a909-4a11-bab2-689600a09b88\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") "
Oct 31 00:49:06.317418 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.317325    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/0324c9b7-a909-4a11-bab2-689600a09b88-kube-api-access-b9c96\" (UniqueName: \"kubernetes.io/projected/0324c9b7-a909-4a11-bab2-689600a09b88-kube-api-access-b9c96\") pod \"0324c9b7-a909-4a11-bab2-689600a09b88\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") "
Oct 31 00:49:06.317418 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.317343    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-data" pod "6f1f21c9-c572-4c8c-8368-ff74ff058804" (UID: "6f1f21c9-c572-4c8c-8368-ff74ff058804"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:06.317418 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.317385    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/0324c9b7-a909-4a11-bab2-689600a09b88-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0324c9b7-a909-4a11-bab2-689600a09b88-istiod-ca-cert\") pod \"0324c9b7-a909-4a11-bab2-689600a09b88\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") "
Oct 31 00:49:06.317418 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.317417    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-istio-envoy\") pod \"0324c9b7-a909-4a11-bab2-689600a09b88\" (UID: \"0324c9b7-a909-4a11-bab2-689600a09b88\") "
Oct 31 00:49:06.317684 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.317509    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-workload-certs\") pod \"6f1f21c9-c572-4c8c-8368-ff74ff058804\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") "
Oct 31 00:49:06.317684 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.317534    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-credential-socket" pod "6f1f21c9-c572-4c8c-8368-ff74ff058804" (UID: "6f1f21c9-c572-4c8c-8368-ff74ff058804"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:06.317684 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.317546    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-credential-socket" pod "0324c9b7-a909-4a11-bab2-689600a09b88" (UID: "0324c9b7-a909-4a11-bab2-689600a09b88"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:06.317684 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.317633    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-workload-socket\") pod \"6f1f21c9-c572-4c8c-8368-ff74ff058804\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") "
Oct 31 00:49:06.317885 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.317703    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-token\" (UniqueName: \"kubernetes.io/projected/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-token\") pod \"6f1f21c9-c572-4c8c-8368-ff74ff058804\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") "
Oct 31 00:49:06.317885 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.317735    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/6f1f21c9-c572-4c8c-8368-ff74ff058804-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1f21c9-c572-4c8c-8368-ff74ff058804-istiod-ca-cert\") pod \"6f1f21c9-c572-4c8c-8368-ff74ff058804\" (UID: \"6f1f21c9-c572-4c8c-8368-ff74ff058804\") "
Oct 31 00:49:06.317885 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.317739    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-istio-data" pod "0324c9b7-a909-4a11-bab2-689600a09b88" (UID: "0324c9b7-a909-4a11-bab2-689600a09b88"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:06.317885 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.317750    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-workload-certs" pod "6f1f21c9-c572-4c8c-8368-ff74ff058804" (UID: "6f1f21c9-c572-4c8c-8368-ff74ff058804"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:06.318628 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.318344    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.318628 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.318372    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.318628 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.318390    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.318628 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.318405    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.318628 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.318418    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.318628 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.318431    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.318628 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.318427    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f1f21c9-c572-4c8c-8368-ff74ff058804-istiod-ca-cert" pod "6f1f21c9-c572-4c8c-8368-ff74ff058804" (UID: "6f1f21c9-c572-4c8c-8368-ff74ff058804"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:49:06.319053 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.318725    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-workload-socket" pod "6f1f21c9-c572-4c8c-8368-ff74ff058804" (UID: "6f1f21c9-c572-4c8c-8368-ff74ff058804"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:06.319053 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.318754    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0324c9b7-a909-4a11-bab2-689600a09b88-istiod-ca-cert" pod "0324c9b7-a909-4a11-bab2-689600a09b88" (UID: "0324c9b7-a909-4a11-bab2-689600a09b88"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:49:06.319376 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.319354    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-workload-certs" pod "0324c9b7-a909-4a11-bab2-689600a09b88" (UID: "0324c9b7-a909-4a11-bab2-689600a09b88"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:06.320825 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.320805    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-token" pod "6f1f21c9-c572-4c8c-8368-ff74ff058804" (UID: "6f1f21c9-c572-4c8c-8368-ff74ff058804"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:06.321651 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.321626    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0324c9b7-a909-4a11-bab2-689600a09b88-kube-api-access-b9c96" pod "0324c9b7-a909-4a11-bab2-689600a09b88" (UID: "0324c9b7-a909-4a11-bab2-689600a09b88"). InnerVolumeSpecName "kube-api-access-b9c96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:06.321801 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.321779    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-podinfo" pod "6f1f21c9-c572-4c8c-8368-ff74ff058804" (UID: "6f1f21c9-c572-4c8c-8368-ff74ff058804"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:49:06.322132 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.322109    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f1f21c9-c572-4c8c-8368-ff74ff058804-kube-api-access-pcw99" pod "6f1f21c9-c572-4c8c-8368-ff74ff058804" (UID: "6f1f21c9-c572-4c8c-8368-ff74ff058804"). InnerVolumeSpecName "kube-api-access-pcw99". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:06.322366 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.322341    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0324c9b7-a909-4a11-bab2-689600a09b88-istio-podinfo" pod "0324c9b7-a909-4a11-bab2-689600a09b88" (UID: "0324c9b7-a909-4a11-bab2-689600a09b88"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:49:06.322442 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.322396    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-envoy" pod "6f1f21c9-c572-4c8c-8368-ff74ff058804" (UID: "6f1f21c9-c572-4c8c-8368-ff74ff058804"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:06.322548 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.322533    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-istio-envoy" pod "0324c9b7-a909-4a11-bab2-689600a09b88" (UID: "0324c9b7-a909-4a11-bab2-689600a09b88"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:06.323596 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.323551    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0324c9b7-a909-4a11-bab2-689600a09b88-istio-token" pod "0324c9b7-a909-4a11-bab2-689600a09b88" (UID: "0324c9b7-a909-4a11-bab2-689600a09b88"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:06.419369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.419289    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0324c9b7-a909-4a11-bab2-689600a09b88-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.419369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.419319    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9c96\" (UniqueName: \"kubernetes.io/projected/0324c9b7-a909-4a11-bab2-689600a09b88-kube-api-access-b9c96\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.419369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.419328    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0324c9b7-a909-4a11-bab2-689600a09b88-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.419369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.419336    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.419369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.419346    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.419369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.419355    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.419369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.419362    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6f1f21c9-c572-4c8c-8368-ff74ff058804-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.419369 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.419370    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.419727 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.419380    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0324c9b7-a909-4a11-bab2-689600a09b88-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.419727 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.419388    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0324c9b7-a909-4a11-bab2-689600a09b88-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.419727 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.419396    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6f1f21c9-c572-4c8c-8368-ff74ff058804-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.419727 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.419404    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcw99\" (UniqueName: \"kubernetes.io/projected/6f1f21c9-c572-4c8c-8368-ff74ff058804-kube-api-access-pcw99\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:06.994712 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.994680    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"
Oct 31 00:49:06.994712 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.994698    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh" event={"ID":"0324c9b7-a909-4a11-bab2-689600a09b88","Type":"ContainerDied","Data":"fe17d3f034e2d155ef7bbfcbb762dc4085a1d67e348c3600a0af9932fdcbf856"}
Oct 31 00:49:06.995298 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.994761    5946 scope.go:122] "RemoveContainer" containerID="156a82c26cc282bc24001c4def7a947c34b5da3c44fbb87b50310453019412e3"
Oct 31 00:49:06.995983 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.995962    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g" event={"ID":"6f1f21c9-c572-4c8c-8368-ff74ff058804","Type":"ContainerDied","Data":"4ce86b484132b6905a2385bee2794db676645f030766f0a12463800d8122826e"}
Oct 31 00:49:06.996033 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:06.996009    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"
Oct 31 00:49:07.004763 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:07.004745    5946 scope.go:122] "RemoveContainer" containerID="db69b4af81ea7046eae4af262c1dbc6014ffa6d0b5e787d7b5c72ca0128bae79"
Oct 31 00:49:07.023526 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:07.023497    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"]
Oct 31 00:49:07.033923 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:07.033890    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-g6trh"]
Oct 31 00:49:07.044851 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:07.044826    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"]
Oct 31 00:49:07.055127 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:07.055097    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="0324c9b7-a909-4a11-bab2-689600a09b88" path="/var/lib/kubelet/pods/0324c9b7-a909-4a11-bab2-689600a09b88/volumes"
Oct 31 00:49:07.055615 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:07.055599    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d5c3e93a-655f-4a76-85ba-71a904a5dad2" path="/var/lib/kubelet/pods/d5c3e93a-655f-4a76-85ba-71a904a5dad2/volumes"
Oct 31 00:49:07.055931 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:07.055918    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-f99ac0-openshift-default-84bc7fcc97-kmp9g"]
Oct 31 00:49:09.055573 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:09.055538    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="6f1f21c9-c572-4c8c-8368-ff74ff058804" path="/var/lib/kubelet/pods/6f1f21c9-c572-4c8c-8368-ff74ff058804/volumes"
Oct 31 00:49:11.383249 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:49:11.383197    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:49:11.882505 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:11.880116    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"]
Oct 31 00:49:11.882505 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:11.880378    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k" podUID="8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" containerName="istio-proxy" containerID="cri-o://9e425a7badde2e081277d512acbf61654216f0bbe4a003ae560c657dbc938f69" gracePeriod=30
Oct 31 00:49:11.884750 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:11.884724    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"]
Oct 31 00:49:11.885161 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:11.885138    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm" podUID="294716ae-2b4b-48e2-bec4-e84bcac470b4" containerName="istio-proxy" containerID="cri-o://bf48909405741b26bbb8fcdffb6ebb73422ae1cb4aaf8584f7dbc97b6ad8f93d" gracePeriod=30
Oct 31 00:49:11.894002 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:11.893967    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"]
Oct 31 00:49:11.894211 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:11.894185    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl" podUID="12052f5b-f4ad-4863-81b5-1b0063786b04" containerName="istio-proxy" containerID="cri-o://f47872931c70ce7dc283e1a56b02a33896695f4211f805cf592b44b17beb7895" gracePeriod=30
Oct 31 00:49:12.051780 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:12.051741    5946 patch_prober.go:29] interesting pod/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:49:12.051934 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:12.051802    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm" podUID="294716ae-2b4b-48e2-bec4-e84bcac470b4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:49:12.727043 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:12.727004    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb" podUID="f284a1af-11d1-42bf-b051-a534bed8b400" containerName="payload-pre-processing" probeResult="failure" output="service unhealthy (responded with \"NOT_SERVING\")"
Oct 31 00:49:13.265438 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:13.265377    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb"
Oct 31 00:49:13.333678 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:13.333640    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/f284a1af-11d1-42bf-b051-a534bed8b400-kube-api-access-cxstc\" (UniqueName: \"kubernetes.io/projected/f284a1af-11d1-42bf-b051-a534bed8b400-kube-api-access-cxstc\") pod \"f284a1af-11d1-42bf-b051-a534bed8b400\" (UID: \"f284a1af-11d1-42bf-b051-a534bed8b400\") "
Oct 31 00:49:13.334077 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:13.333950    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/f284a1af-11d1-42bf-b051-a534bed8b400-plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f284a1af-11d1-42bf-b051-a534bed8b400-plugins-config-volume\") pod \"f284a1af-11d1-42bf-b051-a534bed8b400\" (UID: \"f284a1af-11d1-42bf-b051-a534bed8b400\") "
Oct 31 00:49:13.336448 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:13.336424    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f284a1af-11d1-42bf-b051-a534bed8b400-plugins-config-volume" pod "f284a1af-11d1-42bf-b051-a534bed8b400" (UID: "f284a1af-11d1-42bf-b051-a534bed8b400"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:49:13.340361 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:13.340310    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f284a1af-11d1-42bf-b051-a534bed8b400-kube-api-access-cxstc" pod "f284a1af-11d1-42bf-b051-a534bed8b400" (UID: "f284a1af-11d1-42bf-b051-a534bed8b400"). InnerVolumeSpecName "kube-api-access-cxstc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:13.436192 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:13.436157    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxstc\" (UniqueName: \"kubernetes.io/projected/f284a1af-11d1-42bf-b051-a534bed8b400-kube-api-access-cxstc\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:13.436192 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:13.436190    5946 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f284a1af-11d1-42bf-b051-a534bed8b400-plugins-config-volume\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:14.057741 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:14.057703    5946 generic.go:356] "Generic (PLEG): container finished" podID="f284a1af-11d1-42bf-b051-a534bed8b400" containerID="0aec0d5c8dd185d14de5a8f7566f910d3db242487018e2d38707b1f7ae8c6c77" exitCode=0
Oct 31 00:49:14.057741 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:14.057741    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb"
Oct 31 00:49:14.058267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:14.057779    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb" event={"ID":"f284a1af-11d1-42bf-b051-a534bed8b400","Type":"ContainerDied","Data":"0aec0d5c8dd185d14de5a8f7566f910d3db242487018e2d38707b1f7ae8c6c77"}
Oct 31 00:49:14.058267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:14.057826    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb" event={"ID":"f284a1af-11d1-42bf-b051-a534bed8b400","Type":"ContainerDied","Data":"758c047e6ce5a9768818cbf6a29fd6180ba0a300d473499dc025002970a5c02b"}
Oct 31 00:49:14.058267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:14.057848    5946 scope.go:122] "RemoveContainer" containerID="0aec0d5c8dd185d14de5a8f7566f910d3db242487018e2d38707b1f7ae8c6c77"
Oct 31 00:49:14.067995 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:14.067971    5946 scope.go:122] "RemoveContainer" containerID="0aec0d5c8dd185d14de5a8f7566f910d3db242487018e2d38707b1f7ae8c6c77"
Oct 31 00:49:14.068303 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:49:14.068277    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0aec0d5c8dd185d14de5a8f7566f910d3db242487018e2d38707b1f7ae8c6c77\": container with ID starting with 0aec0d5c8dd185d14de5a8f7566f910d3db242487018e2d38707b1f7ae8c6c77 not found: ID does not exist" containerID="0aec0d5c8dd185d14de5a8f7566f910d3db242487018e2d38707b1f7ae8c6c77"
Oct 31 00:49:14.068435 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:14.068313    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0aec0d5c8dd185d14de5a8f7566f910d3db242487018e2d38707b1f7ae8c6c77"} err="failed to get container status \"0aec0d5c8dd185d14de5a8f7566f910d3db242487018e2d38707b1f7ae8c6c77\": rpc error: code = NotFound desc = could not find container \"0aec0d5c8dd185d14de5a8f7566f910d3db242487018e2d38707b1f7ae8c6c77\": container with ID starting with 0aec0d5c8dd185d14de5a8f7566f910d3db242487018e2d38707b1f7ae8c6c77 not found: ID does not exist"
Oct 31 00:49:14.079714 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:14.079689    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb"]
Oct 31 00:49:14.085419 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:14.085397    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-5c2a03-8558548955-ztslb"]
Oct 31 00:49:15.055400 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:15.055367    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="f284a1af-11d1-42bf-b051-a534bed8b400" path="/var/lib/kubelet/pods/f284a1af-11d1-42bf-b051-a534bed8b400/volumes"
Oct 31 00:49:17.082088 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.081763    5946 generic.go:356] "Generic (PLEG): container finished" podID="12052f5b-f4ad-4863-81b5-1b0063786b04" containerID="f47872931c70ce7dc283e1a56b02a33896695f4211f805cf592b44b17beb7895" exitCode=0
Oct 31 00:49:17.082088 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.082007    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl" event={"ID":"12052f5b-f4ad-4863-81b5-1b0063786b04","Type":"ContainerDied","Data":"f47872931c70ce7dc283e1a56b02a33896695f4211f805cf592b44b17beb7895"}
Oct 31 00:49:17.085781 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.085727    5946 generic.go:356] "Generic (PLEG): container finished" podID="8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" containerID="9e425a7badde2e081277d512acbf61654216f0bbe4a003ae560c657dbc938f69" exitCode=0
Oct 31 00:49:17.085939 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.085895    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k" event={"ID":"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e","Type":"ContainerDied","Data":"9e425a7badde2e081277d512acbf61654216f0bbe4a003ae560c657dbc938f69"}
Oct 31 00:49:17.088098 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.088071    5946 generic.go:356] "Generic (PLEG): container finished" podID="294716ae-2b4b-48e2-bec4-e84bcac470b4" containerID="bf48909405741b26bbb8fcdffb6ebb73422ae1cb4aaf8584f7dbc97b6ad8f93d" exitCode=0
Oct 31 00:49:17.088207 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.088114    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm" event={"ID":"294716ae-2b4b-48e2-bec4-e84bcac470b4","Type":"ContainerDied","Data":"bf48909405741b26bbb8fcdffb6ebb73422ae1cb4aaf8584f7dbc97b6ad8f93d"}
Oct 31 00:49:17.088207 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.088158    5946 scope.go:122] "RemoveContainer" containerID="06de6cd8b0f1ee69cbfd1def8f44cc3bca7c462308d1f5d7eabc2b296df250de"
Oct 31 00:49:17.161352 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.161296    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:49:17.188691 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.188652    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:49:17.288115 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288078    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-workload-socket\") pod \"12052f5b-f4ad-4863-81b5-1b0063786b04\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") "
Oct 31 00:49:17.288318 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288121    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-credential-socket\") pod \"12052f5b-f4ad-4863-81b5-1b0063786b04\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") "
Oct 31 00:49:17.288318 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288170    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/294716ae-2b4b-48e2-bec4-e84bcac470b4-kube-api-access-22hqr\" (UniqueName: \"kubernetes.io/projected/294716ae-2b4b-48e2-bec4-e84bcac470b4-kube-api-access-22hqr\") pod \"294716ae-2b4b-48e2-bec4-e84bcac470b4\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") "
Oct 31 00:49:17.288318 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288233    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-workload-certs\") pod \"294716ae-2b4b-48e2-bec4-e84bcac470b4\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") "
Oct 31 00:49:17.288318 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288270    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-workload-socket\") pod \"294716ae-2b4b-48e2-bec4-e84bcac470b4\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") "
Oct 31 00:49:17.288542 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288379    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/12052f5b-f4ad-4863-81b5-1b0063786b04-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12052f5b-f4ad-4863-81b5-1b0063786b04-istiod-ca-cert\") pod \"12052f5b-f4ad-4863-81b5-1b0063786b04\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") "
Oct 31 00:49:17.288542 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288396    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-workload-socket" pod "12052f5b-f4ad-4863-81b5-1b0063786b04" (UID: "12052f5b-f4ad-4863-81b5-1b0063786b04"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:17.288542 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288428    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-data\") pod \"12052f5b-f4ad-4863-81b5-1b0063786b04\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") "
Oct 31 00:49:17.288542 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288460    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-workload-certs\") pod \"12052f5b-f4ad-4863-81b5-1b0063786b04\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") "
Oct 31 00:49:17.288542 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288491    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-credential-socket\") pod \"294716ae-2b4b-48e2-bec4-e84bcac470b4\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") "
Oct 31 00:49:17.288786 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288547    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/294716ae-2b4b-48e2-bec4-e84bcac470b4-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/294716ae-2b4b-48e2-bec4-e84bcac470b4-istiod-ca-cert\") pod \"294716ae-2b4b-48e2-bec4-e84bcac470b4\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") "
Oct 31 00:49:17.288786 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288593    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-envoy\") pod \"294716ae-2b4b-48e2-bec4-e84bcac470b4\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") "
Oct 31 00:49:17.288786 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288637    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-podinfo\") pod \"12052f5b-f4ad-4863-81b5-1b0063786b04\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") "
Oct 31 00:49:17.288786 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288675    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-token\" (UniqueName: \"kubernetes.io/projected/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-token\") pod \"12052f5b-f4ad-4863-81b5-1b0063786b04\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") "
Oct 31 00:49:17.288786 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288702    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-envoy\") pod \"12052f5b-f4ad-4863-81b5-1b0063786b04\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") "
Oct 31 00:49:17.288786 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288524    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-credential-socket" pod "12052f5b-f4ad-4863-81b5-1b0063786b04" (UID: "12052f5b-f4ad-4863-81b5-1b0063786b04"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:17.288786 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288753    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-podinfo\") pod \"294716ae-2b4b-48e2-bec4-e84bcac470b4\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") "
Oct 31 00:49:17.288786 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288585    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-workload-certs" pod "294716ae-2b4b-48e2-bec4-e84bcac470b4" (UID: "294716ae-2b4b-48e2-bec4-e84bcac470b4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:17.289182 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288726    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/12052f5b-f4ad-4863-81b5-1b0063786b04-istiod-ca-cert" pod "12052f5b-f4ad-4863-81b5-1b0063786b04" (UID: "12052f5b-f4ad-4863-81b5-1b0063786b04"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:49:17.289182 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288728    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-workload-certs" pod "12052f5b-f4ad-4863-81b5-1b0063786b04" (UID: "12052f5b-f4ad-4863-81b5-1b0063786b04"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:17.289182 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288782    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-data\") pod \"294716ae-2b4b-48e2-bec4-e84bcac470b4\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") "
Oct 31 00:49:17.289182 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288827    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-data" pod "12052f5b-f4ad-4863-81b5-1b0063786b04" (UID: "12052f5b-f4ad-4863-81b5-1b0063786b04"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:17.289182 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288903    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-token\" (UniqueName: \"kubernetes.io/projected/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-token\") pod \"294716ae-2b4b-48e2-bec4-e84bcac470b4\" (UID: \"294716ae-2b4b-48e2-bec4-e84bcac470b4\") "
Oct 31 00:49:17.289182 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288952    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/12052f5b-f4ad-4863-81b5-1b0063786b04-kube-api-access-f965g\" (UniqueName: \"kubernetes.io/projected/12052f5b-f4ad-4863-81b5-1b0063786b04-kube-api-access-f965g\") pod \"12052f5b-f4ad-4863-81b5-1b0063786b04\" (UID: \"12052f5b-f4ad-4863-81b5-1b0063786b04\") "
Oct 31 00:49:17.289182 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.288930    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/294716ae-2b4b-48e2-bec4-e84bcac470b4-istiod-ca-cert" pod "294716ae-2b4b-48e2-bec4-e84bcac470b4" (UID: "294716ae-2b4b-48e2-bec4-e84bcac470b4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:49:17.289182 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.289151    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-credential-socket" pod "294716ae-2b4b-48e2-bec4-e84bcac470b4" (UID: "294716ae-2b4b-48e2-bec4-e84bcac470b4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:17.289602 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.289448    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-data" pod "294716ae-2b4b-48e2-bec4-e84bcac470b4" (UID: "294716ae-2b4b-48e2-bec4-e84bcac470b4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:17.289602 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.289550    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.289602 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.289569    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.289602 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.289584    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.289602 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.289598    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.289861 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.289611    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/12052f5b-f4ad-4863-81b5-1b0063786b04-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.289861 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.289625    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.289861 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.289640    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.289861 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.289654    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.289861 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.289666    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/294716ae-2b4b-48e2-bec4-e84bcac470b4-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.290172 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.290142    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-workload-socket" pod "294716ae-2b4b-48e2-bec4-e84bcac470b4" (UID: "294716ae-2b4b-48e2-bec4-e84bcac470b4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:17.291475 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.291433    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-envoy" pod "294716ae-2b4b-48e2-bec4-e84bcac470b4" (UID: "294716ae-2b4b-48e2-bec4-e84bcac470b4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:17.291658 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.291631    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-token" pod "12052f5b-f4ad-4863-81b5-1b0063786b04" (UID: "12052f5b-f4ad-4863-81b5-1b0063786b04"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:17.291872 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.291844    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/12052f5b-f4ad-4863-81b5-1b0063786b04-kube-api-access-f965g" pod "12052f5b-f4ad-4863-81b5-1b0063786b04" (UID: "12052f5b-f4ad-4863-81b5-1b0063786b04"). InnerVolumeSpecName "kube-api-access-f965g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:17.292183 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.292156    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-token" pod "294716ae-2b4b-48e2-bec4-e84bcac470b4" (UID: "294716ae-2b4b-48e2-bec4-e84bcac470b4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:17.292425 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.292399    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-envoy" pod "12052f5b-f4ad-4863-81b5-1b0063786b04" (UID: "12052f5b-f4ad-4863-81b5-1b0063786b04"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:17.292554 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.292536    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-podinfo" pod "12052f5b-f4ad-4863-81b5-1b0063786b04" (UID: "12052f5b-f4ad-4863-81b5-1b0063786b04"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:49:17.292803 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.292787    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/294716ae-2b4b-48e2-bec4-e84bcac470b4-kube-api-access-22hqr" pod "294716ae-2b4b-48e2-bec4-e84bcac470b4" (UID: "294716ae-2b4b-48e2-bec4-e84bcac470b4"). InnerVolumeSpecName "kube-api-access-22hqr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:17.293829 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.293803    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-podinfo" pod "294716ae-2b4b-48e2-bec4-e84bcac470b4" (UID: "294716ae-2b4b-48e2-bec4-e84bcac470b4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:49:17.391267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.391210    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.391267 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.391266    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.391465 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.391276    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.391465 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.391286    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f965g\" (UniqueName: \"kubernetes.io/projected/12052f5b-f4ad-4863-81b5-1b0063786b04-kube-api-access-f965g\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.391465 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.391295    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22hqr\" (UniqueName: \"kubernetes.io/projected/294716ae-2b4b-48e2-bec4-e84bcac470b4-kube-api-access-22hqr\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.391465 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.391305    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.391465 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.391314    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/294716ae-2b4b-48e2-bec4-e84bcac470b4-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.391465 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.391324    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.391465 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.391332    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/12052f5b-f4ad-4863-81b5-1b0063786b04-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.542731 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.542696    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:49:17.593722 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.593691    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-envoy\") pod \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") "
Oct 31 00:49:17.593903 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.593731    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istiod-ca-cert\") pod \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") "
Oct 31 00:49:17.593903 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.593779    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-kube-api-access-xjgxw\" (UniqueName: \"kubernetes.io/projected/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-kube-api-access-xjgxw\") pod \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") "
Oct 31 00:49:17.593903 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.593833    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-data\") pod \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") "
Oct 31 00:49:17.593903 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.593886    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-credential-socket\") pod \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") "
Oct 31 00:49:17.594117 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.593954    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-workload-certs\") pod \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") "
Oct 31 00:49:17.594117 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.594052    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-podinfo\") pod \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") "
Oct 31 00:49:17.594117 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.594099    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-token\" (UniqueName: \"kubernetes.io/projected/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-token\") pod \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") "
Oct 31 00:49:17.594301 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.594140    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-workload-socket\") pod \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\" (UID: \"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e\") "
Oct 31 00:49:17.594346 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.594323    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-credential-socket" pod "8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" (UID: "8594dbaf-9e69-4e69-a7f9-a8e699cabb9e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:17.594415 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.594349    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istiod-ca-cert" pod "8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" (UID: "8594dbaf-9e69-4e69-a7f9-a8e699cabb9e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:49:17.594538 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.594469    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-data" pod "8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" (UID: "8594dbaf-9e69-4e69-a7f9-a8e699cabb9e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:17.594601 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.594563    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-workload-socket" pod "8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" (UID: "8594dbaf-9e69-4e69-a7f9-a8e699cabb9e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:17.594727 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.594686    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-workload-certs" pod "8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" (UID: "8594dbaf-9e69-4e69-a7f9-a8e699cabb9e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:17.594851 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.594823    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.594851 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.594843    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.594947 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.594858    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.594947 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.594871    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.596447 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.596426    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-envoy" pod "8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" (UID: "8594dbaf-9e69-4e69-a7f9-a8e699cabb9e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:17.596867 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.596848    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-podinfo" pod "8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" (UID: "8594dbaf-9e69-4e69-a7f9-a8e699cabb9e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:49:17.596934 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.596894    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-token" pod "8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" (UID: "8594dbaf-9e69-4e69-a7f9-a8e699cabb9e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:17.596934 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.596922    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-kube-api-access-xjgxw" pod "8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" (UID: "8594dbaf-9e69-4e69-a7f9-a8e699cabb9e"). InnerVolumeSpecName "kube-api-access-xjgxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:17.696447 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.696409    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.696447 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.696444    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.696447 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.696453    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.696675 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.696462    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjgxw\" (UniqueName: \"kubernetes.io/projected/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-kube-api-access-xjgxw\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.696675 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.696471    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:17.980900 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.980856    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"]
Oct 31 00:49:17.981138 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.981088    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4" podUID="d477e0c1-fc81-4087-a694-3a2e41433050" containerName="istio-proxy" containerID="cri-o://eede84a6cba49b580c460ba0e4cedb013881c8700c2a8415f0a3a1a9a38e3c2a" gracePeriod=30
Oct 31 00:49:17.985022 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.984990    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"]
Oct 31 00:49:17.985213 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.985191    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l" podUID="2048516f-a2f0-4e39-934b-719cde0e7619" containerName="istio-proxy" containerID="cri-o://1827ceae3e3bf57d32c7250daa9b99b42b344a07037acb8bfa0be00dc7600cc2" gracePeriod=30
Oct 31 00:49:17.996320 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.995041    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"]
Oct 31 00:49:17.996320 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:17.995386    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2" podUID="188b4a57-26c1-44ef-bf79-6e2897f45e2a" containerName="istio-proxy" containerID="cri-o://66a4ab003afc60fa76026582f8d6df33c24d61266d11c8e2888c754237a10452" gracePeriod=30
Oct 31 00:49:18.098749 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:18.098710    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"
Oct 31 00:49:18.099296 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:18.098714    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k" event={"ID":"8594dbaf-9e69-4e69-a7f9-a8e699cabb9e","Type":"ContainerDied","Data":"6f7b45c27bd451aac732ca58577db7d2214e8b67fc2f52f734c762948281ecbd"}
Oct 31 00:49:18.099296 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:18.098875    5946 scope.go:122] "RemoveContainer" containerID="9e425a7badde2e081277d512acbf61654216f0bbe4a003ae560c657dbc938f69"
Oct 31 00:49:18.104683 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:18.103876    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm" event={"ID":"294716ae-2b4b-48e2-bec4-e84bcac470b4","Type":"ContainerDied","Data":"198ef368bf49093e5916699400e1e7d0471c0c10428ae3860753af61186c816f"}
Oct 31 00:49:18.104683 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:18.103987    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"
Oct 31 00:49:18.108969 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:18.108710    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl" event={"ID":"12052f5b-f4ad-4863-81b5-1b0063786b04","Type":"ContainerDied","Data":"32fb620bca6d67650f7da3c062cb57babe965efe4349b0328fcccbdab303599f"}
Oct 31 00:49:18.108969 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:18.108748    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"
Oct 31 00:49:18.113119 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:18.113100    5946 scope.go:122] "RemoveContainer" containerID="bf48909405741b26bbb8fcdffb6ebb73422ae1cb4aaf8584f7dbc97b6ad8f93d"
Oct 31 00:49:18.126365 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:18.126346    5946 scope.go:122] "RemoveContainer" containerID="f47872931c70ce7dc283e1a56b02a33896695f4211f805cf592b44b17beb7895"
Oct 31 00:49:18.166185 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:18.166104    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"]
Oct 31 00:49:18.170654 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:18.170622    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-bt2gm"]
Oct 31 00:49:18.181140 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:18.181112    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"]
Oct 31 00:49:18.188012 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:18.187989    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-c5p8k"]
Oct 31 00:49:18.202207 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:18.202175    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"]
Oct 31 00:49:18.203976 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:18.203952    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w4-5c2a03-openshift-default-686489c6b5-z9bbl"]
Oct 31 00:49:19.057402 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:19.057376    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="12052f5b-f4ad-4863-81b5-1b0063786b04" path="/var/lib/kubelet/pods/12052f5b-f4ad-4863-81b5-1b0063786b04/volumes"
Oct 31 00:49:19.057840 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:19.057826    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="294716ae-2b4b-48e2-bec4-e84bcac470b4" path="/var/lib/kubelet/pods/294716ae-2b4b-48e2-bec4-e84bcac470b4/volumes"
Oct 31 00:49:19.058246 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:19.058232    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" path="/var/lib/kubelet/pods/8594dbaf-9e69-4e69-a7f9-a8e699cabb9e/volumes"
Oct 31 00:49:19.486908 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:19.486820    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:49:20.626392 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:20.626362    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bdb48889c-shvsr"]
Oct 31 00:49:20.626801 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:20.626569    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-7bdb48889c-shvsr" podUID="239cad73-43bb-4cb2-8d24-c0867308a622" containerName="manager" containerID="cri-o://3fa18814bc78b1db3239462c4eb7ff9ef9937f5699120dd42b8e15fd78591f65" gracePeriod=30
Oct 31 00:49:20.814621 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:20.812430    5946 patch_prober.go:29] interesting pod/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Oct 31 00:49:20.814621 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:20.812496    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4" podUID="d477e0c1-fc81-4087-a694-3a2e41433050" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Oct 31 00:49:20.898880 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:20.898858    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bdb48889c-shvsr"
Oct 31 00:49:21.042560 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.042528    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/239cad73-43bb-4cb2-8d24-c0867308a622-kube-api-access-5clvs\" (UniqueName: \"kubernetes.io/projected/239cad73-43bb-4cb2-8d24-c0867308a622-kube-api-access-5clvs\") pod \"239cad73-43bb-4cb2-8d24-c0867308a622\" (UID: \"239cad73-43bb-4cb2-8d24-c0867308a622\") "
Oct 31 00:49:21.042744 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.042582    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/239cad73-43bb-4cb2-8d24-c0867308a622-webhook-cert\" (UniqueName: \"kubernetes.io/secret/239cad73-43bb-4cb2-8d24-c0867308a622-webhook-cert\") pod \"239cad73-43bb-4cb2-8d24-c0867308a622\" (UID: \"239cad73-43bb-4cb2-8d24-c0867308a622\") "
Oct 31 00:49:21.042744 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.042710    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/239cad73-43bb-4cb2-8d24-c0867308a622-metrics-certs\" (UniqueName: \"kubernetes.io/secret/239cad73-43bb-4cb2-8d24-c0867308a622-metrics-certs\") pod \"239cad73-43bb-4cb2-8d24-c0867308a622\" (UID: \"239cad73-43bb-4cb2-8d24-c0867308a622\") "
Oct 31 00:49:21.044646 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.044610    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/239cad73-43bb-4cb2-8d24-c0867308a622-metrics-certs" pod "239cad73-43bb-4cb2-8d24-c0867308a622" (UID: "239cad73-43bb-4cb2-8d24-c0867308a622"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:49:21.044760 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.044644    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/239cad73-43bb-4cb2-8d24-c0867308a622-webhook-cert" pod "239cad73-43bb-4cb2-8d24-c0867308a622" (UID: "239cad73-43bb-4cb2-8d24-c0867308a622"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:49:21.044760 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.044674    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/239cad73-43bb-4cb2-8d24-c0867308a622-kube-api-access-5clvs" pod "239cad73-43bb-4cb2-8d24-c0867308a622" (UID: "239cad73-43bb-4cb2-8d24-c0867308a622"). InnerVolumeSpecName "kube-api-access-5clvs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:21.130954 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.130879    5946 generic.go:356] "Generic (PLEG): container finished" podID="239cad73-43bb-4cb2-8d24-c0867308a622" containerID="3fa18814bc78b1db3239462c4eb7ff9ef9937f5699120dd42b8e15fd78591f65" exitCode=0
Oct 31 00:49:21.130954 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.130933    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bdb48889c-shvsr" event={"ID":"239cad73-43bb-4cb2-8d24-c0867308a622","Type":"ContainerDied","Data":"3fa18814bc78b1db3239462c4eb7ff9ef9937f5699120dd42b8e15fd78591f65"}
Oct 31 00:49:21.130954 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.130942    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bdb48889c-shvsr"
Oct 31 00:49:21.131176 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.130996    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bdb48889c-shvsr" event={"ID":"239cad73-43bb-4cb2-8d24-c0867308a622","Type":"ContainerDied","Data":"2862c827f936656797fd06aa3b778a5dfb98e6a80afa82c3ae364029fc314a9e"}
Oct 31 00:49:21.131176 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.131019    5946 scope.go:122] "RemoveContainer" containerID="3fa18814bc78b1db3239462c4eb7ff9ef9937f5699120dd42b8e15fd78591f65"
Oct 31 00:49:21.140392 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.140368    5946 scope.go:122] "RemoveContainer" containerID="3fa18814bc78b1db3239462c4eb7ff9ef9937f5699120dd42b8e15fd78591f65"
Oct 31 00:49:21.140663 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:49:21.140640    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3fa18814bc78b1db3239462c4eb7ff9ef9937f5699120dd42b8e15fd78591f65\": container with ID starting with 3fa18814bc78b1db3239462c4eb7ff9ef9937f5699120dd42b8e15fd78591f65 not found: ID does not exist" containerID="3fa18814bc78b1db3239462c4eb7ff9ef9937f5699120dd42b8e15fd78591f65"
Oct 31 00:49:21.140790 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.140669    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3fa18814bc78b1db3239462c4eb7ff9ef9937f5699120dd42b8e15fd78591f65"} err="failed to get container status \"3fa18814bc78b1db3239462c4eb7ff9ef9937f5699120dd42b8e15fd78591f65\": rpc error: code = NotFound desc = could not find container \"3fa18814bc78b1db3239462c4eb7ff9ef9937f5699120dd42b8e15fd78591f65\": container with ID starting with 3fa18814bc78b1db3239462c4eb7ff9ef9937f5699120dd42b8e15fd78591f65 not found: ID does not exist"
Oct 31 00:49:21.144828 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.144808    5946 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/239cad73-43bb-4cb2-8d24-c0867308a622-metrics-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:21.144828 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.144829    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5clvs\" (UniqueName: \"kubernetes.io/projected/239cad73-43bb-4cb2-8d24-c0867308a622-kube-api-access-5clvs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:21.145016 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.144839    5946 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/239cad73-43bb-4cb2-8d24-c0867308a622-webhook-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:21.154750 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.154731    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bdb48889c-shvsr"]
Oct 31 00:49:21.160399 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.160376    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bdb48889c-shvsr"]
Oct 31 00:49:21.836611 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.836575    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bdb48889c-rchq7"]
Oct 31 00:49:21.837128 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837113    5946 cpu_manager.go:414] "containerMap: removing container" podUID="6990c602-9395-451f-ae35-8a351c5aacf7" containerName="istio-proxy"
Oct 31 00:49:21.837176 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837129    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6990c602-9395-451f-ae35-8a351c5aacf7" containerName="istio-proxy"
Oct 31 00:49:21.837176 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837141    5946 cpu_manager.go:414] "containerMap: removing container" podUID="fafaee93-015a-4a0b-bee3-115fc381d2e8" containerName="istio-proxy"
Oct 31 00:49:21.837176 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837146    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fafaee93-015a-4a0b-bee3-115fc381d2e8" containerName="istio-proxy"
Oct 31 00:49:21.837176 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837152    5946 cpu_manager.go:414] "containerMap: removing container" podUID="ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" containerName="main"
Oct 31 00:49:21.837176 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837157    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" containerName="main"
Oct 31 00:49:21.837176 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837165    5946 cpu_manager.go:414] "containerMap: removing container" podUID="fc8f1228-2303-4afe-a4cc-831825f95a18" containerName="istio-proxy"
Oct 31 00:49:21.837176 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837172    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc8f1228-2303-4afe-a4cc-831825f95a18" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837183    5946 cpu_manager.go:414] "containerMap: removing container" podUID="30197b12-e066-43b4-b920-c1757b9516ce" containerName="payload-pre-processing"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837188    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="30197b12-e066-43b4-b920-c1757b9516ce" containerName="payload-pre-processing"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837200    5946 cpu_manager.go:414] "containerMap: removing container" podUID="294716ae-2b4b-48e2-bec4-e84bcac470b4" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837204    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="294716ae-2b4b-48e2-bec4-e84bcac470b4" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837231    5946 cpu_manager.go:414] "containerMap: removing container" podUID="50175a7b-1e0d-4398-bacb-afffae46b712" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837235    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="50175a7b-1e0d-4398-bacb-afffae46b712" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837247    5946 cpu_manager.go:414] "containerMap: removing container" podUID="fc8f1228-2303-4afe-a4cc-831825f95a18" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837254    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="fc8f1228-2303-4afe-a4cc-831825f95a18" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837265    5946 cpu_manager.go:414] "containerMap: removing container" podUID="294716ae-2b4b-48e2-bec4-e84bcac470b4" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837271    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="294716ae-2b4b-48e2-bec4-e84bcac470b4" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837277    5946 cpu_manager.go:414] "containerMap: removing container" podUID="afc79d7c-316a-4546-afdb-06f3b6958755" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837282    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="afc79d7c-316a-4546-afdb-06f3b6958755" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837292    5946 cpu_manager.go:414] "containerMap: removing container" podUID="95983973-b5ea-4f87-a3f5-62f5c9850747" containerName="maas-api"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837297    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="95983973-b5ea-4f87-a3f5-62f5c9850747" containerName="maas-api"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837304    5946 cpu_manager.go:414] "containerMap: removing container" podUID="a1fecfeb-15bf-4365-a76f-915eda6b56a0" containerName="maas-api"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837309    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="a1fecfeb-15bf-4365-a76f-915eda6b56a0" containerName="maas-api"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837315    5946 cpu_manager.go:414] "containerMap: removing container" podUID="12052f5b-f4ad-4863-81b5-1b0063786b04" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837321    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="12052f5b-f4ad-4863-81b5-1b0063786b04" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837333    5946 cpu_manager.go:414] "containerMap: removing container" podUID="8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837338    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837348    5946 cpu_manager.go:414] "containerMap: removing container" podUID="f284a1af-11d1-42bf-b051-a534bed8b400" containerName="payload-pre-processing"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837352    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="f284a1af-11d1-42bf-b051-a534bed8b400" containerName="payload-pre-processing"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837359    5946 cpu_manager.go:414] "containerMap: removing container" podUID="daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837363    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837369    5946 cpu_manager.go:414] "containerMap: removing container" podUID="1626bf4d-1329-4475-85a5-3939af3db878" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837373    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="1626bf4d-1329-4475-85a5-3939af3db878" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837383    5946 cpu_manager.go:414] "containerMap: removing container" podUID="bed92ef5-059c-49d2-832f-f0af407f26f6" containerName="maas-api"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837387    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="bed92ef5-059c-49d2-832f-f0af407f26f6" containerName="maas-api"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837394    5946 cpu_manager.go:414] "containerMap: removing container" podUID="0324c9b7-a909-4a11-bab2-689600a09b88" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837401    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="0324c9b7-a909-4a11-bab2-689600a09b88" containerName="istio-proxy"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837413    5946 cpu_manager.go:414] "containerMap: removing container" podUID="c6595fa5-8566-4e13-8d16-d818383d84d0" containerName="maas-api"
Oct 31 00:49:21.837408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837418    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="c6595fa5-8566-4e13-8d16-d818383d84d0" containerName="maas-api"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837426    5946 cpu_manager.go:414] "containerMap: removing container" podUID="d5c3e93a-655f-4a76-85ba-71a904a5dad2" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837430    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d5c3e93a-655f-4a76-85ba-71a904a5dad2" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837437    5946 cpu_manager.go:414] "containerMap: removing container" podUID="53825390-1f0f-4b49-9e59-b224c39aaf62" containerName="maas-api"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837441    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="53825390-1f0f-4b49-9e59-b224c39aaf62" containerName="maas-api"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837448    5946 cpu_manager.go:414] "containerMap: removing container" podUID="b097de73-6eef-4c19-88b4-77315c8b84fe" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837452    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b097de73-6eef-4c19-88b4-77315c8b84fe" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837459    5946 cpu_manager.go:414] "containerMap: removing container" podUID="239cad73-43bb-4cb2-8d24-c0867308a622" containerName="manager"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837463    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="239cad73-43bb-4cb2-8d24-c0867308a622" containerName="manager"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837470    5946 cpu_manager.go:414] "containerMap: removing container" podUID="26b5a389-67d4-4e8c-8353-a16770fe838c" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837474    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="26b5a389-67d4-4e8c-8353-a16770fe838c" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837486    5946 cpu_manager.go:414] "containerMap: removing container" podUID="b77a849b-33f4-4a27-aaf5-45475b017feb" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837492    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="b77a849b-33f4-4a27-aaf5-45475b017feb" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837499    5946 cpu_manager.go:414] "containerMap: removing container" podUID="8e9eecae-26a9-4cba-96c0-6e926d854027" containerName="main"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837503    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="8e9eecae-26a9-4cba-96c0-6e926d854027" containerName="main"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837512    5946 cpu_manager.go:414] "containerMap: removing container" podUID="6f1f21c9-c572-4c8c-8368-ff74ff058804" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837516    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6f1f21c9-c572-4c8c-8368-ff74ff058804" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837524    5946 cpu_manager.go:414] "containerMap: removing container" podUID="411306d4-6572-4b06-950c-2f9fdf30a713" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837529    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="411306d4-6572-4b06-950c-2f9fdf30a713" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837598    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc8f1228-2303-4afe-a4cc-831825f95a18" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837606    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="294716ae-2b4b-48e2-bec4-e84bcac470b4" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837612    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="afc79d7c-316a-4546-afdb-06f3b6958755" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837620    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="95983973-b5ea-4f87-a3f5-62f5c9850747" containerName="maas-api"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837627    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="a1fecfeb-15bf-4365-a76f-915eda6b56a0" containerName="maas-api"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837633    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="12052f5b-f4ad-4863-81b5-1b0063786b04" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837642    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="8594dbaf-9e69-4e69-a7f9-a8e699cabb9e" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837650    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="f284a1af-11d1-42bf-b051-a534bed8b400" containerName="payload-pre-processing"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837655    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="daf51b9c-dab4-45bb-91d4-7cfb9fe15b0c" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837661    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="1626bf4d-1329-4475-85a5-3939af3db878" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837665    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="bed92ef5-059c-49d2-832f-f0af407f26f6" containerName="maas-api"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837671    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="0324c9b7-a909-4a11-bab2-689600a09b88" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837677    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="c6595fa5-8566-4e13-8d16-d818383d84d0" containerName="maas-api"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837683    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="d5c3e93a-655f-4a76-85ba-71a904a5dad2" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837689    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="53825390-1f0f-4b49-9e59-b224c39aaf62" containerName="maas-api"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837694    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="b097de73-6eef-4c19-88b4-77315c8b84fe" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837699    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="239cad73-43bb-4cb2-8d24-c0867308a622" containerName="manager"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837704    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="26b5a389-67d4-4e8c-8353-a16770fe838c" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837710    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="b77a849b-33f4-4a27-aaf5-45475b017feb" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837717    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="8e9eecae-26a9-4cba-96c0-6e926d854027" containerName="main"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837726    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="6990c602-9395-451f-ae35-8a351c5aacf7" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837732    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="6f1f21c9-c572-4c8c-8368-ff74ff058804" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837737    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="411306d4-6572-4b06-950c-2f9fdf30a713" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837743    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="6990c602-9395-451f-ae35-8a351c5aacf7" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837748    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="fafaee93-015a-4a0b-bee3-115fc381d2e8" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837754    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="ad5db0b6-de09-4ba1-b5f4-6fe953615ecc" containerName="main"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837760    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="30197b12-e066-43b4-b920-c1757b9516ce" containerName="payload-pre-processing"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837765    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="294716ae-2b4b-48e2-bec4-e84bcac470b4" containerName="istio-proxy"
Oct 31 00:49:21.838337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.837771    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="50175a7b-1e0d-4398-bacb-afffae46b712" containerName="istio-proxy"
Oct 31 00:49:21.842688 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.842668    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bdb48889c-rchq7"
Oct 31 00:49:21.849472 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.849450    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 31 00:49:21.849472 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.849466    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 31 00:49:21.849795 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.849503    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 31 00:49:21.849795 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.849534    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-k4bz4\""
Oct 31 00:49:21.852000 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.851959    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bdb48889c-rchq7"]
Oct 31 00:49:21.953330 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.953290    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6m52\" (UniqueName: \"kubernetes.io/projected/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-kube-api-access-j6m52\") pod \"maas-controller-7bdb48889c-rchq7\" (UID: \"ef97b2f2-bc3e-4158-b37c-555739ac3f9d\") " pod="opendatahub/maas-controller-7bdb48889c-rchq7"
Oct 31 00:49:21.953504 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.953347    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-metrics-certs\") pod \"maas-controller-7bdb48889c-rchq7\" (UID: \"ef97b2f2-bc3e-4158-b37c-555739ac3f9d\") " pod="opendatahub/maas-controller-7bdb48889c-rchq7"
Oct 31 00:49:21.953504 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:21.953437    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-webhook-cert\") pod \"maas-controller-7bdb48889c-rchq7\" (UID: \"ef97b2f2-bc3e-4158-b37c-555739ac3f9d\") " pod="opendatahub/maas-controller-7bdb48889c-rchq7"
Oct 31 00:49:22.054288 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:22.054241    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6m52\" (UniqueName: \"kubernetes.io/projected/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-kube-api-access-j6m52\") pod \"maas-controller-7bdb48889c-rchq7\" (UID: \"ef97b2f2-bc3e-4158-b37c-555739ac3f9d\") " pod="opendatahub/maas-controller-7bdb48889c-rchq7"
Oct 31 00:49:22.054477 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:22.054324    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-metrics-certs\") pod \"maas-controller-7bdb48889c-rchq7\" (UID: \"ef97b2f2-bc3e-4158-b37c-555739ac3f9d\") " pod="opendatahub/maas-controller-7bdb48889c-rchq7"
Oct 31 00:49:22.054477 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:22.054353    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-webhook-cert\") pod \"maas-controller-7bdb48889c-rchq7\" (UID: \"ef97b2f2-bc3e-4158-b37c-555739ac3f9d\") " pod="opendatahub/maas-controller-7bdb48889c-rchq7"
Oct 31 00:49:22.056844 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:22.056820    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-metrics-certs\") pod \"maas-controller-7bdb48889c-rchq7\" (UID: \"ef97b2f2-bc3e-4158-b37c-555739ac3f9d\") " pod="opendatahub/maas-controller-7bdb48889c-rchq7"
Oct 31 00:49:22.056939 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:22.056865    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-webhook-cert\") pod \"maas-controller-7bdb48889c-rchq7\" (UID: \"ef97b2f2-bc3e-4158-b37c-555739ac3f9d\") " pod="opendatahub/maas-controller-7bdb48889c-rchq7"
Oct 31 00:49:22.062093 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:22.062072    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6m52\" (UniqueName: \"kubernetes.io/projected/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-kube-api-access-j6m52\") pod \"maas-controller-7bdb48889c-rchq7\" (UID: \"ef97b2f2-bc3e-4158-b37c-555739ac3f9d\") " pod="opendatahub/maas-controller-7bdb48889c-rchq7"
Oct 31 00:49:22.157387 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:22.157318    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bdb48889c-rchq7"
Oct 31 00:49:22.432443 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:22.432418    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bdb48889c-rchq7"]
Oct 31 00:49:22.434265 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:49:22.434235    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef97b2f2_bc3e_4158_b37c_555739ac3f9d.slice/crio-240706227efce55e46ef92ffb1e409e71eaea314cf5b7c7634b98499e9334016 WatchSource:0}: Error finding container 240706227efce55e46ef92ffb1e409e71eaea314cf5b7c7634b98499e9334016: Status 404 returned error can't find the container with id 240706227efce55e46ef92ffb1e409e71eaea314cf5b7c7634b98499e9334016
Oct 31 00:49:23.062799 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.062768    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="239cad73-43bb-4cb2-8d24-c0867308a622" path="/var/lib/kubelet/pods/239cad73-43bb-4cb2-8d24-c0867308a622/volumes"
Oct 31 00:49:23.160670 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.156485    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bdb48889c-rchq7" event={"ID":"ef97b2f2-bc3e-4158-b37c-555739ac3f9d","Type":"ContainerStarted","Data":"3e9cc717106984e36436a97f3ea4af363d329e024de03a370ad1c11d44b9b0c4"}
Oct 31 00:49:23.160670 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.156552    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bdb48889c-rchq7" event={"ID":"ef97b2f2-bc3e-4158-b37c-555739ac3f9d","Type":"ContainerStarted","Data":"240706227efce55e46ef92ffb1e409e71eaea314cf5b7c7634b98499e9334016"}
Oct 31 00:49:23.160670 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.157543    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bdb48889c-rchq7"
Oct 31 00:49:23.160670 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.159696    5946 generic.go:356] "Generic (PLEG): container finished" podID="188b4a57-26c1-44ef-bf79-6e2897f45e2a" containerID="66a4ab003afc60fa76026582f8d6df33c24d61266d11c8e2888c754237a10452" exitCode=0
Oct 31 00:49:23.160670 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.159774    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2" event={"ID":"188b4a57-26c1-44ef-bf79-6e2897f45e2a","Type":"ContainerDied","Data":"66a4ab003afc60fa76026582f8d6df33c24d61266d11c8e2888c754237a10452"}
Oct 31 00:49:23.163126 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.162967    5946 generic.go:356] "Generic (PLEG): container finished" podID="2048516f-a2f0-4e39-934b-719cde0e7619" containerID="1827ceae3e3bf57d32c7250daa9b99b42b344a07037acb8bfa0be00dc7600cc2" exitCode=0
Oct 31 00:49:23.163126 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.163050    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l" event={"ID":"2048516f-a2f0-4e39-934b-719cde0e7619","Type":"ContainerDied","Data":"1827ceae3e3bf57d32c7250daa9b99b42b344a07037acb8bfa0be00dc7600cc2"}
Oct 31 00:49:23.165498 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.165342    5946 generic.go:356] "Generic (PLEG): container finished" podID="d477e0c1-fc81-4087-a694-3a2e41433050" containerID="eede84a6cba49b580c460ba0e4cedb013881c8700c2a8415f0a3a1a9a38e3c2a" exitCode=0
Oct 31 00:49:23.165498 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.165433    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4" event={"ID":"d477e0c1-fc81-4087-a694-3a2e41433050","Type":"ContainerDied","Data":"eede84a6cba49b580c460ba0e4cedb013881c8700c2a8415f0a3a1a9a38e3c2a"}
Oct 31 00:49:23.180449 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.180384    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-7bdb48889c-rchq7" podStartSLOduration=1.707606818 podStartE2EDuration="2.180364428s" totalImagesPullingTime="472.75761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:49:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:49:23.179651466 +0000 UTC m=+904.252691548" watchObservedRunningTime="2026-10-31 00:49:23.180364428 +0000 UTC m=+904.253404514"
Oct 31 00:49:23.383855 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.383833    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:49:23.422823 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.422755    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:49:23.426079 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.426053    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:49:23.488664 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.488615    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-credential-socket\") pod \"d477e0c1-fc81-4087-a694-3a2e41433050\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") "
Oct 31 00:49:23.488869 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.488699    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-istio-envoy\") pod \"d477e0c1-fc81-4087-a694-3a2e41433050\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") "
Oct 31 00:49:23.488869 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.488786    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-workload-socket\") pod \"d477e0c1-fc81-4087-a694-3a2e41433050\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") "
Oct 31 00:49:23.488869 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.488823    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-istio-data\") pod \"d477e0c1-fc81-4087-a694-3a2e41433050\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") "
Oct 31 00:49:23.489061 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.488910    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-workload-certs\") pod \"d477e0c1-fc81-4087-a694-3a2e41433050\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") "
Oct 31 00:49:23.489061 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.488940    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d477e0c1-fc81-4087-a694-3a2e41433050-istio-token\" (UniqueName: \"kubernetes.io/projected/d477e0c1-fc81-4087-a694-3a2e41433050-istio-token\") pod \"d477e0c1-fc81-4087-a694-3a2e41433050\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") "
Oct 31 00:49:23.489061 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.488948    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-credential-socket" pod "d477e0c1-fc81-4087-a694-3a2e41433050" (UID: "d477e0c1-fc81-4087-a694-3a2e41433050"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:23.489061 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.488968    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/d477e0c1-fc81-4087-a694-3a2e41433050-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d477e0c1-fc81-4087-a694-3a2e41433050-istio-podinfo\") pod \"d477e0c1-fc81-4087-a694-3a2e41433050\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") "
Oct 31 00:49:23.489061 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.489000    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/d477e0c1-fc81-4087-a694-3a2e41433050-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d477e0c1-fc81-4087-a694-3a2e41433050-istiod-ca-cert\") pod \"d477e0c1-fc81-4087-a694-3a2e41433050\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") "
Oct 31 00:49:23.489368 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.489063    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/d477e0c1-fc81-4087-a694-3a2e41433050-kube-api-access-r4vt8\" (UniqueName: \"kubernetes.io/projected/d477e0c1-fc81-4087-a694-3a2e41433050-kube-api-access-r4vt8\") pod \"d477e0c1-fc81-4087-a694-3a2e41433050\" (UID: \"d477e0c1-fc81-4087-a694-3a2e41433050\") "
Oct 31 00:49:23.489368 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.489166    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-istio-data" pod "d477e0c1-fc81-4087-a694-3a2e41433050" (UID: "d477e0c1-fc81-4087-a694-3a2e41433050"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:23.489479 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.489463    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.489538 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.489481    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.489752 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.489707    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-workload-certs" pod "d477e0c1-fc81-4087-a694-3a2e41433050" (UID: "d477e0c1-fc81-4087-a694-3a2e41433050"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:23.489846 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.489749    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-workload-socket" pod "d477e0c1-fc81-4087-a694-3a2e41433050" (UID: "d477e0c1-fc81-4087-a694-3a2e41433050"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:23.490028 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.490007    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d477e0c1-fc81-4087-a694-3a2e41433050-istiod-ca-cert" pod "d477e0c1-fc81-4087-a694-3a2e41433050" (UID: "d477e0c1-fc81-4087-a694-3a2e41433050"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:49:23.492739 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.492711    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d477e0c1-fc81-4087-a694-3a2e41433050-istio-token" pod "d477e0c1-fc81-4087-a694-3a2e41433050" (UID: "d477e0c1-fc81-4087-a694-3a2e41433050"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:23.492739 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.492722    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-istio-envoy" pod "d477e0c1-fc81-4087-a694-3a2e41433050" (UID: "d477e0c1-fc81-4087-a694-3a2e41433050"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:23.492962 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.492883    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d477e0c1-fc81-4087-a694-3a2e41433050-kube-api-access-r4vt8" pod "d477e0c1-fc81-4087-a694-3a2e41433050" (UID: "d477e0c1-fc81-4087-a694-3a2e41433050"). InnerVolumeSpecName "kube-api-access-r4vt8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:23.493121 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.493105    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d477e0c1-fc81-4087-a694-3a2e41433050-istio-podinfo" pod "d477e0c1-fc81-4087-a694-3a2e41433050" (UID: "d477e0c1-fc81-4087-a694-3a2e41433050"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:49:23.589927 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.589892    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-envoy\") pod \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") "
Oct 31 00:49:23.590134 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.589935    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/2048516f-a2f0-4e39-934b-719cde0e7619-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2048516f-a2f0-4e39-934b-719cde0e7619-istiod-ca-cert\") pod \"2048516f-a2f0-4e39-934b-719cde0e7619\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") "
Oct 31 00:49:23.590134 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.589965    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2048516f-a2f0-4e39-934b-719cde0e7619-kube-api-access-h2wlp\" (UniqueName: \"kubernetes.io/projected/2048516f-a2f0-4e39-934b-719cde0e7619-kube-api-access-h2wlp\") pod \"2048516f-a2f0-4e39-934b-719cde0e7619\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") "
Oct 31 00:49:23.590134 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.590012    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istiod-ca-cert\") pod \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") "
Oct 31 00:49:23.590715 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.590400    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2048516f-a2f0-4e39-934b-719cde0e7619-istiod-ca-cert" pod "2048516f-a2f0-4e39-934b-719cde0e7619" (UID: "2048516f-a2f0-4e39-934b-719cde0e7619"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:49:23.590715 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.590465    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-workload-certs\") pod \"2048516f-a2f0-4e39-934b-719cde0e7619\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") "
Oct 31 00:49:23.590715 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.590541    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-credential-socket\") pod \"2048516f-a2f0-4e39-934b-719cde0e7619\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") "
Oct 31 00:49:23.590715 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.590673    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-workload-certs" pod "2048516f-a2f0-4e39-934b-719cde0e7619" (UID: "2048516f-a2f0-4e39-934b-719cde0e7619"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:23.591025 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.590717    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istiod-ca-cert" pod "188b4a57-26c1-44ef-bf79-6e2897f45e2a" (UID: "188b4a57-26c1-44ef-bf79-6e2897f45e2a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:49:23.591025 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.590895    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-credential-socket" pod "2048516f-a2f0-4e39-934b-719cde0e7619" (UID: "2048516f-a2f0-4e39-934b-719cde0e7619"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.591160    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-token\" (UniqueName: \"kubernetes.io/projected/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-token\") pod \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") "
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.591252    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-istio-data\") pod \"2048516f-a2f0-4e39-934b-719cde0e7619\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") "
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.591301    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-workload-socket\") pod \"2048516f-a2f0-4e39-934b-719cde0e7619\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") "
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.591342    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-istio-envoy\") pod \"2048516f-a2f0-4e39-934b-719cde0e7619\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") "
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.591370    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-workload-socket\") pod \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") "
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.591406    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-credential-socket\") pod \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") "
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.591453    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/188b4a57-26c1-44ef-bf79-6e2897f45e2a-kube-api-access-6x7cb\" (UniqueName: \"kubernetes.io/projected/188b4a57-26c1-44ef-bf79-6e2897f45e2a-kube-api-access-6x7cb\") pod \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") "
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.591500    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-podinfo\") pod \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") "
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.591557    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-istio-data" pod "2048516f-a2f0-4e39-934b-719cde0e7619" (UID: "2048516f-a2f0-4e39-934b-719cde0e7619"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.591567    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-data\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-data\") pod \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") "
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.591640    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/downward-api/2048516f-a2f0-4e39-934b-719cde0e7619-istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2048516f-a2f0-4e39-934b-719cde0e7619-istio-podinfo\") pod \"2048516f-a2f0-4e39-934b-719cde0e7619\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") "
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.591675    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-workload-certs\") pod \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\" (UID: \"188b4a57-26c1-44ef-bf79-6e2897f45e2a\") "
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.591769    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/2048516f-a2f0-4e39-934b-719cde0e7619-istio-token\" (UniqueName: \"kubernetes.io/projected/2048516f-a2f0-4e39-934b-719cde0e7619-istio-token\") pod \"2048516f-a2f0-4e39-934b-719cde0e7619\" (UID: \"2048516f-a2f0-4e39-934b-719cde0e7619\") "
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.592259    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2048516f-a2f0-4e39-934b-719cde0e7619-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.592282    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.592296    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.592309    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.592323    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.592341    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.592354    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.592370    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d477e0c1-fc81-4087-a694-3a2e41433050-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.592383    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d477e0c1-fc81-4087-a694-3a2e41433050-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.592397    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d477e0c1-fc81-4087-a694-3a2e41433050-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.592420    5946 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d477e0c1-fc81-4087-a694-3a2e41433050-istiod-ca-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.592435    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4vt8\" (UniqueName: \"kubernetes.io/projected/d477e0c1-fc81-4087-a694-3a2e41433050-kube-api-access-r4vt8\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.592460    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-workload-socket" pod "188b4a57-26c1-44ef-bf79-6e2897f45e2a" (UID: "188b4a57-26c1-44ef-bf79-6e2897f45e2a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.592753    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-workload-certs" pod "188b4a57-26c1-44ef-bf79-6e2897f45e2a" (UID: "188b4a57-26c1-44ef-bf79-6e2897f45e2a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:23.592960 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.592842    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-workload-socket" pod "2048516f-a2f0-4e39-934b-719cde0e7619" (UID: "2048516f-a2f0-4e39-934b-719cde0e7619"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:23.594497 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.592984    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-credential-socket" pod "188b4a57-26c1-44ef-bf79-6e2897f45e2a" (UID: "188b4a57-26c1-44ef-bf79-6e2897f45e2a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:23.594717 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.594628    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-envoy" pod "188b4a57-26c1-44ef-bf79-6e2897f45e2a" (UID: "188b4a57-26c1-44ef-bf79-6e2897f45e2a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:23.594717 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.594684    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2048516f-a2f0-4e39-934b-719cde0e7619-kube-api-access-h2wlp" pod "2048516f-a2f0-4e39-934b-719cde0e7619" (UID: "2048516f-a2f0-4e39-934b-719cde0e7619"). InnerVolumeSpecName "kube-api-access-h2wlp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:23.594717 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.594692    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-data" pod "188b4a57-26c1-44ef-bf79-6e2897f45e2a" (UID: "188b4a57-26c1-44ef-bf79-6e2897f45e2a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:23.595055 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.595022    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-token" pod "188b4a57-26c1-44ef-bf79-6e2897f45e2a" (UID: "188b4a57-26c1-44ef-bf79-6e2897f45e2a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:23.595512 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.595480    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-istio-envoy" pod "2048516f-a2f0-4e39-934b-719cde0e7619" (UID: "2048516f-a2f0-4e39-934b-719cde0e7619"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:49:23.596004 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.595972    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/188b4a57-26c1-44ef-bf79-6e2897f45e2a-kube-api-access-6x7cb" pod "188b4a57-26c1-44ef-bf79-6e2897f45e2a" (UID: "188b4a57-26c1-44ef-bf79-6e2897f45e2a"). InnerVolumeSpecName "kube-api-access-6x7cb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:23.596990 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.596970    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2048516f-a2f0-4e39-934b-719cde0e7619-istio-token" pod "2048516f-a2f0-4e39-934b-719cde0e7619" (UID: "2048516f-a2f0-4e39-934b-719cde0e7619"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:23.597091 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.597053    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2048516f-a2f0-4e39-934b-719cde0e7619-istio-podinfo" pod "2048516f-a2f0-4e39-934b-719cde0e7619" (UID: "2048516f-a2f0-4e39-934b-719cde0e7619"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:49:23.597176 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.597153    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-podinfo" pod "188b4a57-26c1-44ef-bf79-6e2897f45e2a" (UID: "188b4a57-26c1-44ef-bf79-6e2897f45e2a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Oct 31 00:49:23.696782 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.696701    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.696782 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.696733    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2048516f-a2f0-4e39-934b-719cde0e7619-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.696782 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.696747    5946 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-workload-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.696782 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.696760    5946 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-credential-socket\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.697571 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.697536    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6x7cb\" (UniqueName: \"kubernetes.io/projected/188b4a57-26c1-44ef-bf79-6e2897f45e2a-kube-api-access-6x7cb\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.697692 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.697571    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.697692 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.697588    5946 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-data\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.697692 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.697600    5946 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2048516f-a2f0-4e39-934b-719cde0e7619-istio-podinfo\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.697692 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.697613    5946 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-workload-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.697692 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.697626    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2048516f-a2f0-4e39-934b-719cde0e7619-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.697692 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.697642    5946 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-envoy\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.697692 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.697655    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2wlp\" (UniqueName: \"kubernetes.io/projected/2048516f-a2f0-4e39-934b-719cde0e7619-kube-api-access-h2wlp\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:23.697692 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:23.697668    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/188b4a57-26c1-44ef-bf79-6e2897f45e2a-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:24.219065 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:24.214629    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2" event={"ID":"188b4a57-26c1-44ef-bf79-6e2897f45e2a","Type":"ContainerDied","Data":"3c6fb0dd5c1802466369055ca8fe193644e851050cdc52f7ad3adc7c496eacce"}
Oct 31 00:49:24.219065 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:24.214703    5946 scope.go:122] "RemoveContainer" containerID="66a4ab003afc60fa76026582f8d6df33c24d61266d11c8e2888c754237a10452"
Oct 31 00:49:24.219065 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:24.214804    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"
Oct 31 00:49:24.226696 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:24.226663    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l" event={"ID":"2048516f-a2f0-4e39-934b-719cde0e7619","Type":"ContainerDied","Data":"4b55e50b961b3f2aabc498b8f00692b21af7144302fd139c4004ab447192c13a"}
Oct 31 00:49:24.226827 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:24.226793    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"
Oct 31 00:49:24.232689 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:24.232598    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"
Oct 31 00:49:24.232689 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:24.232662    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4" event={"ID":"d477e0c1-fc81-4087-a694-3a2e41433050","Type":"ContainerDied","Data":"8ef10ccbc27e248587dda390fe3188101000788ce071264722db188d01cfeba8"}
Oct 31 00:49:24.285258 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:24.280909    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"]
Oct 31 00:49:24.311473 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:24.300861    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-zvhv2"]
Oct 31 00:49:24.311473 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:24.302122    5946 scope.go:122] "RemoveContainer" containerID="1827ceae3e3bf57d32c7250daa9b99b42b344a07037acb8bfa0be00dc7600cc2"
Oct 31 00:49:24.326021 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:24.325996    5946 scope.go:122] "RemoveContainer" containerID="eede84a6cba49b580c460ba0e4cedb013881c8700c2a8415f0a3a1a9a38e3c2a"
Oct 31 00:49:24.326721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:24.326699    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"]
Oct 31 00:49:24.329511 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:24.329490    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-294h4"]
Oct 31 00:49:24.376349 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:24.376269    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"]
Oct 31 00:49:24.397241 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:24.395342    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w2-b433e6-openshift-default-755cb85cc5-ggn6l"]
Oct 31 00:49:25.114705 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:25.114669    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="188b4a57-26c1-44ef-bf79-6e2897f45e2a" path="/var/lib/kubelet/pods/188b4a57-26c1-44ef-bf79-6e2897f45e2a/volumes"
Oct 31 00:49:25.115725 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:25.115700    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="2048516f-a2f0-4e39-934b-719cde0e7619" path="/var/lib/kubelet/pods/2048516f-a2f0-4e39-934b-719cde0e7619/volumes"
Oct 31 00:49:25.116737 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:25.116708    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="d477e0c1-fc81-4087-a694-3a2e41433050" path="/var/lib/kubelet/pods/d477e0c1-fc81-4087-a694-3a2e41433050/volumes"
Oct 31 00:49:25.200646 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:25.196605    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-zrxbz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:49:25.200646 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:25.196677    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-zrxbz" podUID="806ab069-e9d3-404e-a334-cba5e5d2225b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:49:35.291130 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:35.291053    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bdb48889c-rchq7"
Oct 31 00:49:41.382578 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:49:41.382537    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:49:52.854796 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:52.854761    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bdb48889c-rchq7"]
Oct 31 00:49:52.855293 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:52.854960    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="opendatahub/maas-controller-7bdb48889c-rchq7" podUID="ef97b2f2-bc3e-4158-b37c-555739ac3f9d" containerName="manager" containerID="cri-o://3e9cc717106984e36436a97f3ea4af363d329e024de03a370ad1c11d44b9b0c4" gracePeriod=30
Oct 31 00:49:53.113694 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.113633    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bdb48889c-rchq7"
Oct 31 00:49:53.223282 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.223247    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-metrics-certs\") pod \"ef97b2f2-bc3e-4158-b37c-555739ac3f9d\" (UID: \"ef97b2f2-bc3e-4158-b37c-555739ac3f9d\") "
Oct 31 00:49:53.223449 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.223431    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-kube-api-access-j6m52\" (UniqueName: \"kubernetes.io/projected/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-kube-api-access-j6m52\") pod \"ef97b2f2-bc3e-4158-b37c-555739ac3f9d\" (UID: \"ef97b2f2-bc3e-4158-b37c-555739ac3f9d\") "
Oct 31 00:49:53.223496 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.223460    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-webhook-cert\") pod \"ef97b2f2-bc3e-4158-b37c-555739ac3f9d\" (UID: \"ef97b2f2-bc3e-4158-b37c-555739ac3f9d\") "
Oct 31 00:49:53.225407 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.225364    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-metrics-certs" pod "ef97b2f2-bc3e-4158-b37c-555739ac3f9d" (UID: "ef97b2f2-bc3e-4158-b37c-555739ac3f9d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:49:53.225532 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.225446    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-webhook-cert" pod "ef97b2f2-bc3e-4158-b37c-555739ac3f9d" (UID: "ef97b2f2-bc3e-4158-b37c-555739ac3f9d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:49:53.225691 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.225674    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-kube-api-access-j6m52" pod "ef97b2f2-bc3e-4158-b37c-555739ac3f9d" (UID: "ef97b2f2-bc3e-4158-b37c-555739ac3f9d"). InnerVolumeSpecName "kube-api-access-j6m52". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:49:53.325031 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.325001    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j6m52\" (UniqueName: \"kubernetes.io/projected/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-kube-api-access-j6m52\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:53.325031 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.325027    5946 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-webhook-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:53.325031 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.325039    5946 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ef97b2f2-bc3e-4158-b37c-555739ac3f9d-metrics-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:49:53.437496 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.437410    5946 generic.go:356] "Generic (PLEG): container finished" podID="ef97b2f2-bc3e-4158-b37c-555739ac3f9d" containerID="3e9cc717106984e36436a97f3ea4af363d329e024de03a370ad1c11d44b9b0c4" exitCode=0
Oct 31 00:49:53.437496 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.437455    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bdb48889c-rchq7" event={"ID":"ef97b2f2-bc3e-4158-b37c-555739ac3f9d","Type":"ContainerDied","Data":"3e9cc717106984e36436a97f3ea4af363d329e024de03a370ad1c11d44b9b0c4"}
Oct 31 00:49:53.437496 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.437461    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bdb48889c-rchq7"
Oct 31 00:49:53.437496 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.437495    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bdb48889c-rchq7" event={"ID":"ef97b2f2-bc3e-4158-b37c-555739ac3f9d","Type":"ContainerDied","Data":"240706227efce55e46ef92ffb1e409e71eaea314cf5b7c7634b98499e9334016"}
Oct 31 00:49:53.437841 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.437521    5946 scope.go:122] "RemoveContainer" containerID="3e9cc717106984e36436a97f3ea4af363d329e024de03a370ad1c11d44b9b0c4"
Oct 31 00:49:53.447724 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.447706    5946 scope.go:122] "RemoveContainer" containerID="3e9cc717106984e36436a97f3ea4af363d329e024de03a370ad1c11d44b9b0c4"
Oct 31 00:49:53.448011 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:49:53.447991    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e9cc717106984e36436a97f3ea4af363d329e024de03a370ad1c11d44b9b0c4\": container with ID starting with 3e9cc717106984e36436a97f3ea4af363d329e024de03a370ad1c11d44b9b0c4 not found: ID does not exist" containerID="3e9cc717106984e36436a97f3ea4af363d329e024de03a370ad1c11d44b9b0c4"
Oct 31 00:49:53.448070 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.448020    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e9cc717106984e36436a97f3ea4af363d329e024de03a370ad1c11d44b9b0c4"} err="failed to get container status \"3e9cc717106984e36436a97f3ea4af363d329e024de03a370ad1c11d44b9b0c4\": rpc error: code = NotFound desc = could not find container \"3e9cc717106984e36436a97f3ea4af363d329e024de03a370ad1c11d44b9b0c4\": container with ID starting with 3e9cc717106984e36436a97f3ea4af363d329e024de03a370ad1c11d44b9b0c4 not found: ID does not exist"
Oct 31 00:49:53.461136 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.461109    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7bdb48889c-rchq7"]
Oct 31 00:49:53.462775 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:53.462755    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7bdb48889c-rchq7"]
Oct 31 00:49:54.659087 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.659056    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7bdb48889c-wcwl9"]
Oct 31 00:49:54.659640 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.659620    5946 cpu_manager.go:414] "containerMap: removing container" podUID="2048516f-a2f0-4e39-934b-719cde0e7619" containerName="istio-proxy"
Oct 31 00:49:54.659640 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.659639    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="2048516f-a2f0-4e39-934b-719cde0e7619" containerName="istio-proxy"
Oct 31 00:49:54.659640 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.659654    5946 cpu_manager.go:414] "containerMap: removing container" podUID="6990c602-9395-451f-ae35-8a351c5aacf7" containerName="istio-proxy"
Oct 31 00:49:54.659825 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.659661    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="6990c602-9395-451f-ae35-8a351c5aacf7" containerName="istio-proxy"
Oct 31 00:49:54.659825 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.659673    5946 cpu_manager.go:414] "containerMap: removing container" podUID="ef97b2f2-bc3e-4158-b37c-555739ac3f9d" containerName="manager"
Oct 31 00:49:54.659825 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.659680    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="ef97b2f2-bc3e-4158-b37c-555739ac3f9d" containerName="manager"
Oct 31 00:49:54.659825 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.659694    5946 cpu_manager.go:414] "containerMap: removing container" podUID="188b4a57-26c1-44ef-bf79-6e2897f45e2a" containerName="istio-proxy"
Oct 31 00:49:54.659825 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.659698    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="188b4a57-26c1-44ef-bf79-6e2897f45e2a" containerName="istio-proxy"
Oct 31 00:49:54.659825 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.659709    5946 cpu_manager.go:414] "containerMap: removing container" podUID="d477e0c1-fc81-4087-a694-3a2e41433050" containerName="istio-proxy"
Oct 31 00:49:54.659825 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.659713    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="d477e0c1-fc81-4087-a694-3a2e41433050" containerName="istio-proxy"
Oct 31 00:49:54.659825 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.659806    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="2048516f-a2f0-4e39-934b-719cde0e7619" containerName="istio-proxy"
Oct 31 00:49:54.659825 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.659815    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="ef97b2f2-bc3e-4158-b37c-555739ac3f9d" containerName="manager"
Oct 31 00:49:54.659825 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.659823    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="188b4a57-26c1-44ef-bf79-6e2897f45e2a" containerName="istio-proxy"
Oct 31 00:49:54.659825 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.659830    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="d477e0c1-fc81-4087-a694-3a2e41433050" containerName="istio-proxy"
Oct 31 00:49:54.660160 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.659837    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="fc8f1228-2303-4afe-a4cc-831825f95a18" containerName="istio-proxy"
Oct 31 00:49:54.663544 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.663523    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bdb48889c-wcwl9"
Oct 31 00:49:54.670684 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.670662    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Oct 31 00:49:54.671683 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.671663    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Oct 31 00:49:54.671803 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.671728    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-k4bz4\""
Oct 31 00:49:54.671803 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.671751    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Oct 31 00:49:54.673549 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.673128    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bdb48889c-wcwl9"]
Oct 31 00:49:54.742575 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.742523    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2faaf5dc-403b-4a11-9089-71126992092b-metrics-certs\") pod \"maas-controller-7bdb48889c-wcwl9\" (UID: \"2faaf5dc-403b-4a11-9089-71126992092b\") " pod="opendatahub/maas-controller-7bdb48889c-wcwl9"
Oct 31 00:49:54.742575 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.742576    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fvwz7\" (UniqueName: \"kubernetes.io/projected/2faaf5dc-403b-4a11-9089-71126992092b-kube-api-access-fvwz7\") pod \"maas-controller-7bdb48889c-wcwl9\" (UID: \"2faaf5dc-403b-4a11-9089-71126992092b\") " pod="opendatahub/maas-controller-7bdb48889c-wcwl9"
Oct 31 00:49:54.742789 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.742649    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2faaf5dc-403b-4a11-9089-71126992092b-webhook-cert\") pod \"maas-controller-7bdb48889c-wcwl9\" (UID: \"2faaf5dc-403b-4a11-9089-71126992092b\") " pod="opendatahub/maas-controller-7bdb48889c-wcwl9"
Oct 31 00:49:54.843977 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.843942    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2faaf5dc-403b-4a11-9089-71126992092b-webhook-cert\") pod \"maas-controller-7bdb48889c-wcwl9\" (UID: \"2faaf5dc-403b-4a11-9089-71126992092b\") " pod="opendatahub/maas-controller-7bdb48889c-wcwl9"
Oct 31 00:49:54.844148 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.844073    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2faaf5dc-403b-4a11-9089-71126992092b-metrics-certs\") pod \"maas-controller-7bdb48889c-wcwl9\" (UID: \"2faaf5dc-403b-4a11-9089-71126992092b\") " pod="opendatahub/maas-controller-7bdb48889c-wcwl9"
Oct 31 00:49:54.844148 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.844093    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fvwz7\" (UniqueName: \"kubernetes.io/projected/2faaf5dc-403b-4a11-9089-71126992092b-kube-api-access-fvwz7\") pod \"maas-controller-7bdb48889c-wcwl9\" (UID: \"2faaf5dc-403b-4a11-9089-71126992092b\") " pod="opendatahub/maas-controller-7bdb48889c-wcwl9"
Oct 31 00:49:54.846496 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.846466    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2faaf5dc-403b-4a11-9089-71126992092b-metrics-certs\") pod \"maas-controller-7bdb48889c-wcwl9\" (UID: \"2faaf5dc-403b-4a11-9089-71126992092b\") " pod="opendatahub/maas-controller-7bdb48889c-wcwl9"
Oct 31 00:49:54.846621 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.846500    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2faaf5dc-403b-4a11-9089-71126992092b-webhook-cert\") pod \"maas-controller-7bdb48889c-wcwl9\" (UID: \"2faaf5dc-403b-4a11-9089-71126992092b\") " pod="opendatahub/maas-controller-7bdb48889c-wcwl9"
Oct 31 00:49:54.852408 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.852378    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fvwz7\" (UniqueName: \"kubernetes.io/projected/2faaf5dc-403b-4a11-9089-71126992092b-kube-api-access-fvwz7\") pod \"maas-controller-7bdb48889c-wcwl9\" (UID: \"2faaf5dc-403b-4a11-9089-71126992092b\") " pod="opendatahub/maas-controller-7bdb48889c-wcwl9"
Oct 31 00:49:54.979337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:54.979250    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7bdb48889c-wcwl9"
Oct 31 00:49:55.056973 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:55.056937    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="ef97b2f2-bc3e-4158-b37c-555739ac3f9d" path="/var/lib/kubelet/pods/ef97b2f2-bc3e-4158-b37c-555739ac3f9d/volumes"
Oct 31 00:49:55.257766 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:55.257740    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7bdb48889c-wcwl9"]
Oct 31 00:49:55.259862 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:49:55.259828    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2faaf5dc_403b_4a11_9089_71126992092b.slice/crio-be92877cf2a841f8f829c2da0d17b3370ff8a7563d13ceeaae65980b54b20b58 WatchSource:0}: Error finding container be92877cf2a841f8f829c2da0d17b3370ff8a7563d13ceeaae65980b54b20b58: Status 404 returned error can't find the container with id be92877cf2a841f8f829c2da0d17b3370ff8a7563d13ceeaae65980b54b20b58
Oct 31 00:49:55.456925 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:55.456882    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bdb48889c-wcwl9" event={"ID":"2faaf5dc-403b-4a11-9089-71126992092b","Type":"ContainerStarted","Data":"be92877cf2a841f8f829c2da0d17b3370ff8a7563d13ceeaae65980b54b20b58"}
Oct 31 00:49:56.464723 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:56.464687    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7bdb48889c-wcwl9" event={"ID":"2faaf5dc-403b-4a11-9089-71126992092b","Type":"ContainerStarted","Data":"2a24ed4b093be773a504cfc89c6c663fc12f00efe202dce057c92fd1057c5294"}
Oct 31 00:49:56.465108 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:56.464866    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7bdb48889c-wcwl9"
Oct 31 00:49:56.483822 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:49:56.483771    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="opendatahub/maas-controller-7bdb48889c-wcwl9" podStartSLOduration=1.992587736 podStartE2EDuration="2.483756607s" totalImagesPullingTime="491.168871ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:49:56.481455577 +0000 UTC m=+937.554495659" watchObservedRunningTime="2026-10-31 00:49:56.483756607 +0000 UTC m=+937.556796689"
Oct 31 00:50:07.473520 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:50:07.473491    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7bdb48889c-wcwl9"
Oct 31 00:50:11.380771 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:50:11.380728    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:50:23.026187 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:50:23.026147    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk"]
Oct 31 00:50:23.028912 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:50:23.028888    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-sub-655741d9-767xk"]
Oct 31 00:50:23.054448 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:50:23.054412    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="bb38541e-5383-4f91-a21e-27b83c11b0b9" path="/var/lib/kubelet/pods/bb38541e-5383-4f91-a21e-27b83c11b0b9/volumes"
Oct 31 00:50:29.685207 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:50:29.685166    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:50:41.443848 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:50:41.443802    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:50:47.880140 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:50:47.880105    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:50:51.796245 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:50:51.795299    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:51:06.698904 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:51:06.698812    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:51:11.293339 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:51:11.293302    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-k62w7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:51:11.293951 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:51:11.293916    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7" podUID="b670c3de-1e2e-47cf-af19-2a1669471c5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:51:11.415619 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:51:11.415579    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:51:19.556818 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:51:19.556784    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:51:20.904341 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:51:20.904317    5946 scope.go:122] "RemoveContainer" containerID="879bc2c1751168c8d87189215f18960db5276a429304cb550016ce08c53c3c50"
Oct 31 00:51:41.380689 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:51:41.380653    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:51:44.048894 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:51:44.048864    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:51:54.082062 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:51:54.082032    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:51:59.690040 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:51:59.690009    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:52:11.381285 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:52:11.381248    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:52:14.862543 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:52:14.862514    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:52:18.885446 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:52:18.885406    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:52:20.928685 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:52:20.928652    5946 scope.go:122] "RemoveContainer" containerID="d8f84680d06bc6db4ec70f7c5712493555dd7561736893be700bc3650520e348"
Oct 31 00:52:33.273967 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:52:33.273883    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:52:38.905422 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:52:38.905391    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:52:41.379998 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:52:41.379964    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:52:52.063878 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:52:52.063841    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:52:56.052243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:52:56.046206    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:52:56.291775 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:52:56.291298    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-k62w7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:52:56.291775 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:52:56.291368    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-k62w7" podUID="b670c3de-1e2e-47cf-af19-2a1669471c5a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:53:09.905121 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:53:09.905087    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:53:11.380317 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:53:11.380283    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:53:20.568188 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:53:20.568155    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:53:25.093243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:53:25.092244    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:53:41.380749 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:53:41.380712    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:53:41.774692 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:53:41.774614    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:53:44.956943 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:53:44.956910    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:53:51.984978 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:53:51.984941    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:53:54.450243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:53:54.448340    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-jbqxw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 00:53:54.450243 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:53:54.448445    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw" podUID="45bc1cee-bd0f-45be-a614-7d08c7fbf55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 00:54:09.256911 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.256824    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"]
Oct 31 00:54:09.257487 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.257048    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj" podUID="e3725d6f-6a2d-4d05-86e7-104990c62ff8" containerName="discovery" containerID="cri-o://61e59266c63977c1f12ffcb0313c30eadb9a5d035ebcf62751b75ede0f1a04f2" gracePeriod=30
Oct 31 00:54:09.516721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.516654    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:54:09.569742 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.569711    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-csr-dns-cert\") pod \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") "
Oct 31 00:54:09.569919 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.569759    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-token\" (UniqueName: \"kubernetes.io/projected/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-token\") pod \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") "
Oct 31 00:54:09.569919 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.569866    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e3725d6f-6a2d-4d05-86e7-104990c62ff8-kube-api-access-x2bdh\" (UniqueName: \"kubernetes.io/projected/e3725d6f-6a2d-4d05-86e7-104990c62ff8-kube-api-access-x2bdh\") pod \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") "
Oct 31 00:54:09.569919 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.569903    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-cacerts\" (UniqueName: \"kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-cacerts\") pod \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") "
Oct 31 00:54:09.570106 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.569962    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-csr-ca-configmap\") pod \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") "
Oct 31 00:54:09.570106 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.569997    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-kubeconfig\") pod \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") "
Oct 31 00:54:09.570106 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.570035    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/empty-dir/e3725d6f-6a2d-4d05-86e7-104990c62ff8-local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3725d6f-6a2d-4d05-86e7-104990c62ff8-local-certs\") pod \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\" (UID: \"e3725d6f-6a2d-4d05-86e7-104990c62ff8\") "
Oct 31 00:54:09.570544 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.570512    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-csr-ca-configmap" pod "e3725d6f-6a2d-4d05-86e7-104990c62ff8" (UID: "e3725d6f-6a2d-4d05-86e7-104990c62ff8"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:54:09.572479 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.572450    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-csr-dns-cert" pod "e3725d6f-6a2d-4d05-86e7-104990c62ff8" (UID: "e3725d6f-6a2d-4d05-86e7-104990c62ff8"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:54:09.572479 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.572470    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-cacerts" pod "e3725d6f-6a2d-4d05-86e7-104990c62ff8" (UID: "e3725d6f-6a2d-4d05-86e7-104990c62ff8"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:54:09.572479 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.572458    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3725d6f-6a2d-4d05-86e7-104990c62ff8-kube-api-access-x2bdh" pod "e3725d6f-6a2d-4d05-86e7-104990c62ff8" (UID: "e3725d6f-6a2d-4d05-86e7-104990c62ff8"). InnerVolumeSpecName "kube-api-access-x2bdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:54:09.572719 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.572684    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-token" pod "e3725d6f-6a2d-4d05-86e7-104990c62ff8" (UID: "e3725d6f-6a2d-4d05-86e7-104990c62ff8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:54:09.572789 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.572743    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-kubeconfig" pod "e3725d6f-6a2d-4d05-86e7-104990c62ff8" (UID: "e3725d6f-6a2d-4d05-86e7-104990c62ff8"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:54:09.573731 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.573694    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3725d6f-6a2d-4d05-86e7-104990c62ff8-local-certs" pod "e3725d6f-6a2d-4d05-86e7-104990c62ff8" (UID: "e3725d6f-6a2d-4d05-86e7-104990c62ff8"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Oct 31 00:54:09.671690 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.671656    5946 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-cacerts\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:09.671690 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.671692    5946 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-csr-ca-configmap\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:09.671889 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.671707    5946 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-kubeconfig\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:09.671889 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.671720    5946 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3725d6f-6a2d-4d05-86e7-104990c62ff8-local-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:09.671889 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.671733    5946 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-csr-dns-cert\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:09.671889 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.671745    5946 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3725d6f-6a2d-4d05-86e7-104990c62ff8-istio-token\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:09.671889 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.671758    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x2bdh\" (UniqueName: \"kubernetes.io/projected/e3725d6f-6a2d-4d05-86e7-104990c62ff8-kube-api-access-x2bdh\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:54:09.960503 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.960470    5946 generic.go:356] "Generic (PLEG): container finished" podID="e3725d6f-6a2d-4d05-86e7-104990c62ff8" containerID="61e59266c63977c1f12ffcb0313c30eadb9a5d035ebcf62751b75ede0f1a04f2" exitCode=0
Oct 31 00:54:09.960676 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.960522    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"
Oct 31 00:54:09.960676 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.960558    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj" event={"ID":"e3725d6f-6a2d-4d05-86e7-104990c62ff8","Type":"ContainerDied","Data":"61e59266c63977c1f12ffcb0313c30eadb9a5d035ebcf62751b75ede0f1a04f2"}
Oct 31 00:54:09.960676 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.960640    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj" event={"ID":"e3725d6f-6a2d-4d05-86e7-104990c62ff8","Type":"ContainerDied","Data":"b80bf411a73fa2b5b7b20f22c50038169d4c1a6148464caf417f22b6d4601638"}
Oct 31 00:54:09.960676 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.960669    5946 scope.go:122] "RemoveContainer" containerID="61e59266c63977c1f12ffcb0313c30eadb9a5d035ebcf62751b75ede0f1a04f2"
Oct 31 00:54:09.970644 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.970624    5946 scope.go:122] "RemoveContainer" containerID="61e59266c63977c1f12ffcb0313c30eadb9a5d035ebcf62751b75ede0f1a04f2"
Oct 31 00:54:09.970924 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:54:09.970902    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61e59266c63977c1f12ffcb0313c30eadb9a5d035ebcf62751b75ede0f1a04f2\": container with ID starting with 61e59266c63977c1f12ffcb0313c30eadb9a5d035ebcf62751b75ede0f1a04f2 not found: ID does not exist" containerID="61e59266c63977c1f12ffcb0313c30eadb9a5d035ebcf62751b75ede0f1a04f2"
Oct 31 00:54:09.971000 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.970935    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61e59266c63977c1f12ffcb0313c30eadb9a5d035ebcf62751b75ede0f1a04f2"} err="failed to get container status \"61e59266c63977c1f12ffcb0313c30eadb9a5d035ebcf62751b75ede0f1a04f2\": rpc error: code = NotFound desc = could not find container \"61e59266c63977c1f12ffcb0313c30eadb9a5d035ebcf62751b75ede0f1a04f2\": container with ID starting with 61e59266c63977c1f12ffcb0313c30eadb9a5d035ebcf62751b75ede0f1a04f2 not found: ID does not exist"
Oct 31 00:54:09.982416 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.982391    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"]
Oct 31 00:54:09.984883 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:09.984852    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7ddd9cfdc8-278vj"]
Oct 31 00:54:10.477207 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:10.477175    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:54:11.058428 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:11.058390    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e3725d6f-6a2d-4d05-86e7-104990c62ff8" path="/var/lib/kubelet/pods/e3725d6f-6a2d-4d05-86e7-104990c62ff8/volumes"
Oct 31 00:54:11.383203 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:54:11.383103    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:54:20.659911 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:20.659876    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:54:36.478295 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:36.478253    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:54:40.680464 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:40.680424    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:54:41.379961 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:54:41.379928    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:54:50.931464 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:50.931429    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"]
Oct 31 00:54:50.932614 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:50.932590    5946 cpu_manager.go:414] "containerMap: removing container" podUID="e3725d6f-6a2d-4d05-86e7-104990c62ff8" containerName="discovery"
Oct 31 00:54:50.932614 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:50.932613    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e3725d6f-6a2d-4d05-86e7-104990c62ff8" containerName="discovery"
Oct 31 00:54:50.932792 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:50.932724    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="e3725d6f-6a2d-4d05-86e7-104990c62ff8" containerName="discovery"
Oct 31 00:54:50.936281 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:50.936247    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"
Oct 31 00:54:50.944721 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:50.943971    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-fb32d0-serving-cert\""
Oct 31 00:54:50.946926 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:50.946902    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"]
Oct 31 00:54:51.033817 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:51.033783    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkxmh\" (UniqueName: \"kubernetes.io/projected/e30e14ee-af8d-4676-821f-dd7e41356484-kube-api-access-nkxmh\") pod \"maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk\" (UID: \"e30e14ee-af8d-4676-821f-dd7e41356484\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"
Oct 31 00:54:51.034017 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:51.033846    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e30e14ee-af8d-4676-821f-dd7e41356484-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk\" (UID: \"e30e14ee-af8d-4676-821f-dd7e41356484\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"
Oct 31 00:54:51.034017 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:51.033913    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e30e14ee-af8d-4676-821f-dd7e41356484-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk\" (UID: \"e30e14ee-af8d-4676-821f-dd7e41356484\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"
Oct 31 00:54:51.034017 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:51.033984    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e30e14ee-af8d-4676-821f-dd7e41356484-metrics-certs\") pod \"maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk\" (UID: \"e30e14ee-af8d-4676-821f-dd7e41356484\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"
Oct 31 00:54:51.135751 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:51.135705    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e30e14ee-af8d-4676-821f-dd7e41356484-metrics-certs\") pod \"maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk\" (UID: \"e30e14ee-af8d-4676-821f-dd7e41356484\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"
Oct 31 00:54:51.135946 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:51.135869    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkxmh\" (UniqueName: \"kubernetes.io/projected/e30e14ee-af8d-4676-821f-dd7e41356484-kube-api-access-nkxmh\") pod \"maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk\" (UID: \"e30e14ee-af8d-4676-821f-dd7e41356484\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"
Oct 31 00:54:51.137559 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:51.137530    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e30e14ee-af8d-4676-821f-dd7e41356484-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk\" (UID: \"e30e14ee-af8d-4676-821f-dd7e41356484\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"
Oct 31 00:54:51.137845 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:51.137816    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e30e14ee-af8d-4676-821f-dd7e41356484-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk\" (UID: \"e30e14ee-af8d-4676-821f-dd7e41356484\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"
Oct 31 00:54:51.138341 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:51.138315    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e30e14ee-af8d-4676-821f-dd7e41356484-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk\" (UID: \"e30e14ee-af8d-4676-821f-dd7e41356484\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"
Oct 31 00:54:51.139752 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:51.139729    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e30e14ee-af8d-4676-821f-dd7e41356484-metrics-certs\") pod \"maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk\" (UID: \"e30e14ee-af8d-4676-821f-dd7e41356484\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"
Oct 31 00:54:51.140424 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:51.140403    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e30e14ee-af8d-4676-821f-dd7e41356484-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk\" (UID: \"e30e14ee-af8d-4676-821f-dd7e41356484\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"
Oct 31 00:54:51.149256 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:51.149205    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkxmh\" (UniqueName: \"kubernetes.io/projected/e30e14ee-af8d-4676-821f-dd7e41356484-kube-api-access-nkxmh\") pod \"maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk\" (UID: \"e30e14ee-af8d-4676-821f-dd7e41356484\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"
Oct 31 00:54:51.260081 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:51.260001    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"
Oct 31 00:54:51.538334 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:51.538166    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"]
Oct 31 00:54:51.541649 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:54:51.541618    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode30e14ee_af8d_4676_821f_dd7e41356484.slice/crio-21773f5e972b2b18253e37a47e8f782c3a3fc70feb1b4cbbda11e3c5f716eab0 WatchSource:0}: Error finding container 21773f5e972b2b18253e37a47e8f782c3a3fc70feb1b4cbbda11e3c5f716eab0: Status 404 returned error can't find the container with id 21773f5e972b2b18253e37a47e8f782c3a3fc70feb1b4cbbda11e3c5f716eab0
Oct 31 00:54:51.543516 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:51.543494    5946 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 00:54:52.198722 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:52.198688    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk" event={"ID":"e30e14ee-af8d-4676-821f-dd7e41356484","Type":"ContainerStarted","Data":"eae7fd566ddaf69269404bc48fa3b73c25e30c9e3d93b39df0d0ea76b8a1eb87"}
Oct 31 00:54:52.199213 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:52.198745    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk" event={"ID":"e30e14ee-af8d-4676-821f-dd7e41356484","Type":"ContainerStarted","Data":"21773f5e972b2b18253e37a47e8f782c3a3fc70feb1b4cbbda11e3c5f716eab0"}
Oct 31 00:54:52.199213 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:52.198782    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"
Oct 31 00:54:52.226706 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:52.226651    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk" podStartSLOduration=1.783471255 podStartE2EDuration="2.226635536s" totalImagesPullingTime="443.164281ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:54:52.224654814 +0000 UTC m=+1233.297694895" watchObservedRunningTime="2026-10-31 00:54:52.226635536 +0000 UTC m=+1233.299675618"
Oct 31 00:54:53.091954 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:53.091920    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:54:58.209505 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:54:58.209473    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"
Oct 31 00:55:04.895927 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:04.895888    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:55:11.381429 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:55:11.381387    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:55:19.759202 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:19.759164    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:55:41.382432 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:55:41.382343    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:55:43.980333 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:43.980283    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:55:53.618423 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:53.618388    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"]
Oct 31 00:55:53.619080 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:53.618643    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk" podUID="e30e14ee-af8d-4676-821f-dd7e41356484" containerName="maas-api" containerID="cri-o://eae7fd566ddaf69269404bc48fa3b73c25e30c9e3d93b39df0d0ea76b8a1eb87" gracePeriod=30
Oct 31 00:55:54.085849 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.085826    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"
Oct 31 00:55:54.202912 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.202815    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/e30e14ee-af8d-4676-821f-dd7e41356484-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e30e14ee-af8d-4676-821f-dd7e41356484-openshift-service-ca\") pod \"e30e14ee-af8d-4676-821f-dd7e41356484\" (UID: \"e30e14ee-af8d-4676-821f-dd7e41356484\") "
Oct 31 00:55:54.202912 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.202879    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e30e14ee-af8d-4676-821f-dd7e41356484-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e30e14ee-af8d-4676-821f-dd7e41356484-maas-api-tls\") pod \"e30e14ee-af8d-4676-821f-dd7e41356484\" (UID: \"e30e14ee-af8d-4676-821f-dd7e41356484\") "
Oct 31 00:55:54.203150 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.203033    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/e30e14ee-af8d-4676-821f-dd7e41356484-kube-api-access-nkxmh\" (UniqueName: \"kubernetes.io/projected/e30e14ee-af8d-4676-821f-dd7e41356484-kube-api-access-nkxmh\") pod \"e30e14ee-af8d-4676-821f-dd7e41356484\" (UID: \"e30e14ee-af8d-4676-821f-dd7e41356484\") "
Oct 31 00:55:54.203150 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.203114    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/e30e14ee-af8d-4676-821f-dd7e41356484-metrics-certs\" (UniqueName: \"kubernetes.io/secret/e30e14ee-af8d-4676-821f-dd7e41356484-metrics-certs\") pod \"e30e14ee-af8d-4676-821f-dd7e41356484\" (UID: \"e30e14ee-af8d-4676-821f-dd7e41356484\") "
Oct 31 00:55:54.203296 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.203170    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e30e14ee-af8d-4676-821f-dd7e41356484-openshift-service-ca" pod "e30e14ee-af8d-4676-821f-dd7e41356484" (UID: "e30e14ee-af8d-4676-821f-dd7e41356484"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:55:54.203564 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.203516    5946 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e30e14ee-af8d-4676-821f-dd7e41356484-openshift-service-ca\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:54.205129 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.205106    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e30e14ee-af8d-4676-821f-dd7e41356484-metrics-certs" pod "e30e14ee-af8d-4676-821f-dd7e41356484" (UID: "e30e14ee-af8d-4676-821f-dd7e41356484"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:55:54.205268 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.205136    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e30e14ee-af8d-4676-821f-dd7e41356484-kube-api-access-nkxmh" pod "e30e14ee-af8d-4676-821f-dd7e41356484" (UID: "e30e14ee-af8d-4676-821f-dd7e41356484"). InnerVolumeSpecName "kube-api-access-nkxmh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:55:54.205268 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.205199    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e30e14ee-af8d-4676-821f-dd7e41356484-maas-api-tls" pod "e30e14ee-af8d-4676-821f-dd7e41356484" (UID: "e30e14ee-af8d-4676-821f-dd7e41356484"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:55:54.304879 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.304851    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkxmh\" (UniqueName: \"kubernetes.io/projected/e30e14ee-af8d-4676-821f-dd7e41356484-kube-api-access-nkxmh\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:54.304879 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.304876    5946 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/e30e14ee-af8d-4676-821f-dd7e41356484-metrics-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:54.304879 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.304886    5946 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e30e14ee-af8d-4676-821f-dd7e41356484-maas-api-tls\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:55:54.528619 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.528533    5946 generic.go:356] "Generic (PLEG): container finished" podID="e30e14ee-af8d-4676-821f-dd7e41356484" containerID="eae7fd566ddaf69269404bc48fa3b73c25e30c9e3d93b39df0d0ea76b8a1eb87" exitCode=0
Oct 31 00:55:54.528619 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.528578    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"
Oct 31 00:55:54.528619 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.528594    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk" event={"ID":"e30e14ee-af8d-4676-821f-dd7e41356484","Type":"ContainerDied","Data":"eae7fd566ddaf69269404bc48fa3b73c25e30c9e3d93b39df0d0ea76b8a1eb87"}
Oct 31 00:55:54.528891 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.528640    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk" event={"ID":"e30e14ee-af8d-4676-821f-dd7e41356484","Type":"ContainerDied","Data":"21773f5e972b2b18253e37a47e8f782c3a3fc70feb1b4cbbda11e3c5f716eab0"}
Oct 31 00:55:54.528891 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.528674    5946 scope.go:122] "RemoveContainer" containerID="eae7fd566ddaf69269404bc48fa3b73c25e30c9e3d93b39df0d0ea76b8a1eb87"
Oct 31 00:55:54.538804 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.538788    5946 scope.go:122] "RemoveContainer" containerID="eae7fd566ddaf69269404bc48fa3b73c25e30c9e3d93b39df0d0ea76b8a1eb87"
Oct 31 00:55:54.539099 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:55:54.539080    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eae7fd566ddaf69269404bc48fa3b73c25e30c9e3d93b39df0d0ea76b8a1eb87\": container with ID starting with eae7fd566ddaf69269404bc48fa3b73c25e30c9e3d93b39df0d0ea76b8a1eb87 not found: ID does not exist" containerID="eae7fd566ddaf69269404bc48fa3b73c25e30c9e3d93b39df0d0ea76b8a1eb87"
Oct 31 00:55:54.539150 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.539108    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eae7fd566ddaf69269404bc48fa3b73c25e30c9e3d93b39df0d0ea76b8a1eb87"} err="failed to get container status \"eae7fd566ddaf69269404bc48fa3b73c25e30c9e3d93b39df0d0ea76b8a1eb87\": rpc error: code = NotFound desc = could not find container \"eae7fd566ddaf69269404bc48fa3b73c25e30c9e3d93b39df0d0ea76b8a1eb87\": container with ID starting with eae7fd566ddaf69269404bc48fa3b73c25e30c9e3d93b39df0d0ea76b8a1eb87 not found: ID does not exist"
Oct 31 00:55:54.552566 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.552530    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"]
Oct 31 00:55:54.558931 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:54.558902    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-fb32d0-79ffdf84d7-s8rrk"]
Oct 31 00:55:55.054564 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:55.054524    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="e30e14ee-af8d-4676-821f-dd7e41356484" path="/var/lib/kubelet/pods/e30e14ee-af8d-4676-821f-dd7e41356484/volumes"
Oct 31 00:55:55.484531 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:55:55.484440    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:56:11.382204 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:56:11.382166    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:56:12.561245 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:56:12.561193    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:56:16.375984 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:56:16.375948    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:56:41.381212 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:56:41.381172    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:57:11.380806 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:57:11.380723    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:57:40.786343 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:57:40.786309    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:57:41.385121 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:57:41.385075    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:57:55.946931 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:57:55.946897    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:57:59.911847 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:57:59.911807    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:58:11.380845 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:58:11.380802    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:58:14.901247 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:14.901198    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:58:21.017929 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.017893    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"]
Oct 31 00:58:21.018764 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.018608    5946 cpu_manager.go:414] "containerMap: removing container" podUID="e30e14ee-af8d-4676-821f-dd7e41356484" containerName="maas-api"
Oct 31 00:58:21.018963 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.018936    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="e30e14ee-af8d-4676-821f-dd7e41356484" containerName="maas-api"
Oct 31 00:58:21.019109 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.019096    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="e30e14ee-af8d-4676-821f-dd7e41356484" containerName="maas-api"
Oct 31 00:58:21.022498 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.022479    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"
Oct 31 00:58:21.033697 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.033671    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-worker-single-main-1919c8-serving-cert\""
Oct 31 00:58:21.037625 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.037597    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"]
Oct 31 00:58:21.134640 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.134608    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w7cg\" (UniqueName: \"kubernetes.io/projected/86864f83-4c85-41b3-9faa-f09c7f2a3af0-kube-api-access-4w7cg\") pod \"maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr\" (UID: \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"
Oct 31 00:58:21.134823 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.134668    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86864f83-4c85-41b3-9faa-f09c7f2a3af0-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr\" (UID: \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"
Oct 31 00:58:21.134823 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.134795    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86864f83-4c85-41b3-9faa-f09c7f2a3af0-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr\" (UID: \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"
Oct 31 00:58:21.134899 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.134827    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86864f83-4c85-41b3-9faa-f09c7f2a3af0-metrics-certs\") pod \"maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr\" (UID: \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"
Oct 31 00:58:21.235744 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.235703    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w7cg\" (UniqueName: \"kubernetes.io/projected/86864f83-4c85-41b3-9faa-f09c7f2a3af0-kube-api-access-4w7cg\") pod \"maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr\" (UID: \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"
Oct 31 00:58:21.235958 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.235753    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86864f83-4c85-41b3-9faa-f09c7f2a3af0-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr\" (UID: \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"
Oct 31 00:58:21.235958 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.235786    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86864f83-4c85-41b3-9faa-f09c7f2a3af0-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr\" (UID: \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"
Oct 31 00:58:21.235958 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.235804    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86864f83-4c85-41b3-9faa-f09c7f2a3af0-metrics-certs\") pod \"maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr\" (UID: \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"
Oct 31 00:58:21.236946 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.236912    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86864f83-4c85-41b3-9faa-f09c7f2a3af0-openshift-service-ca\") pod \"maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr\" (UID: \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"
Oct 31 00:58:21.238201 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.238174    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86864f83-4c85-41b3-9faa-f09c7f2a3af0-maas-api-tls\") pod \"maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr\" (UID: \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"
Oct 31 00:58:21.238337 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.238318    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86864f83-4c85-41b3-9faa-f09c7f2a3af0-metrics-certs\") pod \"maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr\" (UID: \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"
Oct 31 00:58:21.244389 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.244371    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w7cg\" (UniqueName: \"kubernetes.io/projected/86864f83-4c85-41b3-9faa-f09c7f2a3af0-kube-api-access-4w7cg\") pod \"maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr\" (UID: \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\") " pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"
Oct 31 00:58:21.343193 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.343159    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"
Oct 31 00:58:21.626123 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:21.626013    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"]
Oct 31 00:58:21.629045 ip-10-0-143-7 kubenswrapper[5946]: W1031 00:58:21.629017    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86864f83_4c85_41b3_9faa_f09c7f2a3af0.slice/crio-f40162de59698ff836df06a0fa7e2448521b9819fff60b792a5c715b982debfd WatchSource:0}: Error finding container f40162de59698ff836df06a0fa7e2448521b9819fff60b792a5c715b982debfd: Status 404 returned error can't find the container with id f40162de59698ff836df06a0fa7e2448521b9819fff60b792a5c715b982debfd
Oct 31 00:58:22.326077 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:22.326050    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr" event={"ID":"86864f83-4c85-41b3-9faa-f09c7f2a3af0","Type":"ContainerStarted","Data":"f40162de59698ff836df06a0fa7e2448521b9819fff60b792a5c715b982debfd"}
Oct 31 00:58:23.332748 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:23.332710    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr" event={"ID":"86864f83-4c85-41b3-9faa-f09c7f2a3af0","Type":"ContainerStarted","Data":"44afd2398ef99f534fc7b7f100dffc3964aa9055227a9b7e31295aa95e8de526"}
Oct 31 00:58:23.333257 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:23.332773    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"
Oct 31 00:58:23.351830 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:23.351777    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr" podStartSLOduration=2.7176596809999998 podStartE2EDuration="3.351763671s" totalImagesPullingTime="634.10399ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 00:58:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 00:58:23.35119246 +0000 UTC m=+1444.424232578" watchObservedRunningTime="2026-10-31 00:58:23.351763671 +0000 UTC m=+1444.424803752"
Oct 31 00:58:23.704687 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:23.704604    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:58:29.343249 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:29.343210    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"
Oct 31 00:58:38.408733 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:38.408702    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:58:41.381805 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:58:41.381692    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:58:54.912044 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:58:54.912006    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:59:11.380511 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:59:11.380475    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:59:19.495112 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:19.495077    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:59:29.779124 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:29.779090    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"]
Oct 31 00:59:29.779688 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:29.779320    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr" podUID="86864f83-4c85-41b3-9faa-f09c7f2a3af0" containerName="maas-api" containerID="cri-o://44afd2398ef99f534fc7b7f100dffc3964aa9055227a9b7e31295aa95e8de526" gracePeriod=30
Oct 31 00:59:30.032200 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.032136    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"
Oct 31 00:59:30.160498 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.160463    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/86864f83-4c85-41b3-9faa-f09c7f2a3af0-metrics-certs\" (UniqueName: \"kubernetes.io/secret/86864f83-4c85-41b3-9faa-f09c7f2a3af0-metrics-certs\") pod \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\" (UID: \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\") "
Oct 31 00:59:30.160678 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.160515    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/86864f83-4c85-41b3-9faa-f09c7f2a3af0-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86864f83-4c85-41b3-9faa-f09c7f2a3af0-maas-api-tls\") pod \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\" (UID: \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\") "
Oct 31 00:59:30.160736 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.160680    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/86864f83-4c85-41b3-9faa-f09c7f2a3af0-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86864f83-4c85-41b3-9faa-f09c7f2a3af0-openshift-service-ca\") pod \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\" (UID: \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\") "
Oct 31 00:59:30.160791 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.160754    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/86864f83-4c85-41b3-9faa-f09c7f2a3af0-kube-api-access-4w7cg\" (UniqueName: \"kubernetes.io/projected/86864f83-4c85-41b3-9faa-f09c7f2a3af0-kube-api-access-4w7cg\") pod \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\" (UID: \"86864f83-4c85-41b3-9faa-f09c7f2a3af0\") "
Oct 31 00:59:30.161068 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.161040    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86864f83-4c85-41b3-9faa-f09c7f2a3af0-openshift-service-ca" pod "86864f83-4c85-41b3-9faa-f09c7f2a3af0" (UID: "86864f83-4c85-41b3-9faa-f09c7f2a3af0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 00:59:30.162720 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.162692    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86864f83-4c85-41b3-9faa-f09c7f2a3af0-maas-api-tls" pod "86864f83-4c85-41b3-9faa-f09c7f2a3af0" (UID: "86864f83-4c85-41b3-9faa-f09c7f2a3af0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:59:30.162817 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.162724    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86864f83-4c85-41b3-9faa-f09c7f2a3af0-metrics-certs" pod "86864f83-4c85-41b3-9faa-f09c7f2a3af0" (UID: "86864f83-4c85-41b3-9faa-f09c7f2a3af0"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 00:59:30.162817 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.162745    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86864f83-4c85-41b3-9faa-f09c7f2a3af0-kube-api-access-4w7cg" pod "86864f83-4c85-41b3-9faa-f09c7f2a3af0" (UID: "86864f83-4c85-41b3-9faa-f09c7f2a3af0"). InnerVolumeSpecName "kube-api-access-4w7cg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 00:59:30.262469 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.262438    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w7cg\" (UniqueName: \"kubernetes.io/projected/86864f83-4c85-41b3-9faa-f09c7f2a3af0-kube-api-access-4w7cg\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:59:30.262469 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.262464    5946 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/86864f83-4c85-41b3-9faa-f09c7f2a3af0-metrics-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:59:30.262469 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.262475    5946 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/86864f83-4c85-41b3-9faa-f09c7f2a3af0-maas-api-tls\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:59:30.262718 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.262484    5946 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/86864f83-4c85-41b3-9faa-f09c7f2a3af0-openshift-service-ca\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 00:59:30.696131 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.696098    5946 generic.go:356] "Generic (PLEG): container finished" podID="86864f83-4c85-41b3-9faa-f09c7f2a3af0" containerID="44afd2398ef99f534fc7b7f100dffc3964aa9055227a9b7e31295aa95e8de526" exitCode=0
Oct 31 00:59:30.696316 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.696149    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"
Oct 31 00:59:30.696316 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.696183    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr" event={"ID":"86864f83-4c85-41b3-9faa-f09c7f2a3af0","Type":"ContainerDied","Data":"44afd2398ef99f534fc7b7f100dffc3964aa9055227a9b7e31295aa95e8de526"}
Oct 31 00:59:30.696316 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.696248    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr" event={"ID":"86864f83-4c85-41b3-9faa-f09c7f2a3af0","Type":"ContainerDied","Data":"f40162de59698ff836df06a0fa7e2448521b9819fff60b792a5c715b982debfd"}
Oct 31 00:59:30.696316 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.696271    5946 scope.go:122] "RemoveContainer" containerID="44afd2398ef99f534fc7b7f100dffc3964aa9055227a9b7e31295aa95e8de526"
Oct 31 00:59:30.706525 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.706491    5946 scope.go:122] "RemoveContainer" containerID="44afd2398ef99f534fc7b7f100dffc3964aa9055227a9b7e31295aa95e8de526"
Oct 31 00:59:30.706766 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:59:30.706749    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"44afd2398ef99f534fc7b7f100dffc3964aa9055227a9b7e31295aa95e8de526\": container with ID starting with 44afd2398ef99f534fc7b7f100dffc3964aa9055227a9b7e31295aa95e8de526 not found: ID does not exist" containerID="44afd2398ef99f534fc7b7f100dffc3964aa9055227a9b7e31295aa95e8de526"
Oct 31 00:59:30.706829 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.706778    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"44afd2398ef99f534fc7b7f100dffc3964aa9055227a9b7e31295aa95e8de526"} err="failed to get container status \"44afd2398ef99f534fc7b7f100dffc3964aa9055227a9b7e31295aa95e8de526\": rpc error: code = NotFound desc = could not find container \"44afd2398ef99f534fc7b7f100dffc3964aa9055227a9b7e31295aa95e8de526\": container with ID starting with 44afd2398ef99f534fc7b7f100dffc3964aa9055227a9b7e31295aa95e8de526 not found: ID does not exist"
Oct 31 00:59:30.719555 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.719525    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"]
Oct 31 00:59:30.720925 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:30.720907    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-worker-single-main-1919c8-849f56dd89-f5kzr"]
Oct 31 00:59:31.055358 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:31.055318    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="86864f83-4c85-41b3-9faa-f09c7f2a3af0" path="/var/lib/kubelet/pods/86864f83-4c85-41b3-9faa-f09c7f2a3af0/volumes"
Oct 31 00:59:31.787679 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:31.787646    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 00:59:41.379971 ip-10-0-143-7 kubenswrapper[5946]: E1031 00:59:41.379935    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 00:59:43.384773 ip-10-0-143-7 kubenswrapper[5946]: I1031 00:59:43.384736    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 01:00:01.480863 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:00:01.480775    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 01:00:11.380893 ip-10-0-143-7 kubenswrapper[5946]: E1031 01:00:11.380849    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 01:00:16.110939 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:00:16.110909    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 01:00:28.564891 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:00:28.564859    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 01:00:35.129914 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:00:35.129879    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 01:00:40.674700 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:00:40.674664    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 01:00:41.426647 ip-10-0-143-7 kubenswrapper[5946]: E1031 01:00:41.426609    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 01:00:45.689185 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:00:45.689146    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 01:01:01.083689 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:01.083653    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 01:01:02.323356 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.323324    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"]
Oct 31 01:01:02.323952 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.323933    5946 cpu_manager.go:414] "containerMap: removing container" podUID="86864f83-4c85-41b3-9faa-f09c7f2a3af0" containerName="maas-api"
Oct 31 01:01:02.323996 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.323956    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="86864f83-4c85-41b3-9faa-f09c7f2a3af0" containerName="maas-api"
Oct 31 01:01:02.324085 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.324074    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="86864f83-4c85-41b3-9faa-f09c7f2a3af0" containerName="maas-api"
Oct 31 01:01:02.327904 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.327885    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"
Oct 31 01:01:02.340119 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.340091    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"]
Oct 31 01:01:02.378033 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.377993    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00ef8afe-cc0f-4872-adbc-66140c1c80ba-maas-api-tls\") pod \"maas-api-97ff44f5b-xxrkd\" (UID: \"00ef8afe-cc0f-4872-adbc-66140c1c80ba\") " pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"
Oct 31 01:01:02.378206 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.378055    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00ef8afe-cc0f-4872-adbc-66140c1c80ba-metrics-certs\") pod \"maas-api-97ff44f5b-xxrkd\" (UID: \"00ef8afe-cc0f-4872-adbc-66140c1c80ba\") " pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"
Oct 31 01:01:02.378206 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.378152    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l2lf\" (UniqueName: \"kubernetes.io/projected/00ef8afe-cc0f-4872-adbc-66140c1c80ba-kube-api-access-9l2lf\") pod \"maas-api-97ff44f5b-xxrkd\" (UID: \"00ef8afe-cc0f-4872-adbc-66140c1c80ba\") " pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"
Oct 31 01:01:02.378325 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.378240    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00ef8afe-cc0f-4872-adbc-66140c1c80ba-openshift-service-ca\") pod \"maas-api-97ff44f5b-xxrkd\" (UID: \"00ef8afe-cc0f-4872-adbc-66140c1c80ba\") " pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"
Oct 31 01:01:02.479266 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.479234    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00ef8afe-cc0f-4872-adbc-66140c1c80ba-metrics-certs\") pod \"maas-api-97ff44f5b-xxrkd\" (UID: \"00ef8afe-cc0f-4872-adbc-66140c1c80ba\") " pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"
Oct 31 01:01:02.479442 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.479284    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l2lf\" (UniqueName: \"kubernetes.io/projected/00ef8afe-cc0f-4872-adbc-66140c1c80ba-kube-api-access-9l2lf\") pod \"maas-api-97ff44f5b-xxrkd\" (UID: \"00ef8afe-cc0f-4872-adbc-66140c1c80ba\") " pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"
Oct 31 01:01:02.479442 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.479332    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00ef8afe-cc0f-4872-adbc-66140c1c80ba-openshift-service-ca\") pod \"maas-api-97ff44f5b-xxrkd\" (UID: \"00ef8afe-cc0f-4872-adbc-66140c1c80ba\") " pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"
Oct 31 01:01:02.479442 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.479428    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00ef8afe-cc0f-4872-adbc-66140c1c80ba-maas-api-tls\") pod \"maas-api-97ff44f5b-xxrkd\" (UID: \"00ef8afe-cc0f-4872-adbc-66140c1c80ba\") " pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"
Oct 31 01:01:02.480099 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.480071    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/00ef8afe-cc0f-4872-adbc-66140c1c80ba-openshift-service-ca\") pod \"maas-api-97ff44f5b-xxrkd\" (UID: \"00ef8afe-cc0f-4872-adbc-66140c1c80ba\") " pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"
Oct 31 01:01:02.481834 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.481813    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/00ef8afe-cc0f-4872-adbc-66140c1c80ba-maas-api-tls\") pod \"maas-api-97ff44f5b-xxrkd\" (UID: \"00ef8afe-cc0f-4872-adbc-66140c1c80ba\") " pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"
Oct 31 01:01:02.482052 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.482030    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/00ef8afe-cc0f-4872-adbc-66140c1c80ba-metrics-certs\") pod \"maas-api-97ff44f5b-xxrkd\" (UID: \"00ef8afe-cc0f-4872-adbc-66140c1c80ba\") " pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"
Oct 31 01:01:02.486360 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.486340    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l2lf\" (UniqueName: \"kubernetes.io/projected/00ef8afe-cc0f-4872-adbc-66140c1c80ba-kube-api-access-9l2lf\") pod \"maas-api-97ff44f5b-xxrkd\" (UID: \"00ef8afe-cc0f-4872-adbc-66140c1c80ba\") " pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"
Oct 31 01:01:02.648450 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.648366    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"
Oct 31 01:01:02.930505 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.930482    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"]
Oct 31 01:01:02.933160 ip-10-0-143-7 kubenswrapper[5946]: W1031 01:01:02.933132    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ef8afe_cc0f_4872_adbc_66140c1c80ba.slice/crio-f9811f97d23f61dac377705400ae7e78a547064177e7c0da9175c407bdb6a616 WatchSource:0}: Error finding container f9811f97d23f61dac377705400ae7e78a547064177e7c0da9175c407bdb6a616: Status 404 returned error can't find the container with id f9811f97d23f61dac377705400ae7e78a547064177e7c0da9175c407bdb6a616
Oct 31 01:01:02.934739 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:02.934720    5946 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Oct 31 01:01:03.325800 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:03.325769    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd" event={"ID":"00ef8afe-cc0f-4872-adbc-66140c1c80ba","Type":"ContainerStarted","Data":"f9811f97d23f61dac377705400ae7e78a547064177e7c0da9175c407bdb6a616"}
Oct 31 01:01:04.332041 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:04.332004    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd" event={"ID":"00ef8afe-cc0f-4872-adbc-66140c1c80ba","Type":"ContainerStarted","Data":"66fc4e875e8980fbf7f249c0cf3b8570ca2a29bb0a2abf616da5488787616019"}
Oct 31 01:01:04.332503 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:04.332065    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"
Oct 31 01:01:04.349822 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:04.349776    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd" podStartSLOduration=1.8953877019999998 podStartE2EDuration="2.349763169s" totalImagesPullingTime="454.375467ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:01:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:01:04.349413564 +0000 UTC m=+1605.422453646" watchObservedRunningTime="2026-10-31 01:01:04.349763169 +0000 UTC m=+1605.422803250"
Oct 31 01:01:10.346641 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:10.346607    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-97ff44f5b-xxrkd"
Oct 31 01:01:10.398782 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:10.398751    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"]
Oct 31 01:01:10.398970 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:10.398947    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s" podUID="5890f0ad-07a5-465e-b7ce-6174aeaba417" containerName="maas-api" containerID="cri-o://acff457b4a0c5234c0a61c27740d3da164226fad4a922cd264be73674f8767f0" gracePeriod=30
Oct 31 01:01:11.381911 ip-10-0-143-7 kubenswrapper[5946]: E1031 01:01:11.381879    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 01:01:11.653467 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:11.653444    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"
Oct 31 01:01:11.780673 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:11.780638    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5890f0ad-07a5-465e-b7ce-6174aeaba417-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5890f0ad-07a5-465e-b7ce-6174aeaba417-openshift-service-ca\") pod \"5890f0ad-07a5-465e-b7ce-6174aeaba417\" (UID: \"5890f0ad-07a5-465e-b7ce-6174aeaba417\") "
Oct 31 01:01:11.780871 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:11.780724    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5890f0ad-07a5-465e-b7ce-6174aeaba417-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5890f0ad-07a5-465e-b7ce-6174aeaba417-maas-api-tls\") pod \"5890f0ad-07a5-465e-b7ce-6174aeaba417\" (UID: \"5890f0ad-07a5-465e-b7ce-6174aeaba417\") "
Oct 31 01:01:11.780871 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:11.780769    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5890f0ad-07a5-465e-b7ce-6174aeaba417-kube-api-access-kzdmm\" (UniqueName: \"kubernetes.io/projected/5890f0ad-07a5-465e-b7ce-6174aeaba417-kube-api-access-kzdmm\") pod \"5890f0ad-07a5-465e-b7ce-6174aeaba417\" (UID: \"5890f0ad-07a5-465e-b7ce-6174aeaba417\") "
Oct 31 01:01:11.780871 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:11.780820    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5890f0ad-07a5-465e-b7ce-6174aeaba417-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5890f0ad-07a5-465e-b7ce-6174aeaba417-metrics-certs\") pod \"5890f0ad-07a5-465e-b7ce-6174aeaba417\" (UID: \"5890f0ad-07a5-465e-b7ce-6174aeaba417\") "
Oct 31 01:01:11.781057 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:11.781027    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5890f0ad-07a5-465e-b7ce-6174aeaba417-openshift-service-ca" pod "5890f0ad-07a5-465e-b7ce-6174aeaba417" (UID: "5890f0ad-07a5-465e-b7ce-6174aeaba417"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 01:01:11.783007 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:11.782957    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5890f0ad-07a5-465e-b7ce-6174aeaba417-maas-api-tls" pod "5890f0ad-07a5-465e-b7ce-6174aeaba417" (UID: "5890f0ad-07a5-465e-b7ce-6174aeaba417"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:01:11.783435 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:11.783406    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5890f0ad-07a5-465e-b7ce-6174aeaba417-kube-api-access-kzdmm" pod "5890f0ad-07a5-465e-b7ce-6174aeaba417" (UID: "5890f0ad-07a5-465e-b7ce-6174aeaba417"). InnerVolumeSpecName "kube-api-access-kzdmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:01:11.783722 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:11.783690    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5890f0ad-07a5-465e-b7ce-6174aeaba417-metrics-certs" pod "5890f0ad-07a5-465e-b7ce-6174aeaba417" (UID: "5890f0ad-07a5-465e-b7ce-6174aeaba417"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:01:11.881968 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:11.881933    5946 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5890f0ad-07a5-465e-b7ce-6174aeaba417-metrics-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:11.881968 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:11.881963    5946 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5890f0ad-07a5-465e-b7ce-6174aeaba417-openshift-service-ca\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:11.881968 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:11.881973    5946 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5890f0ad-07a5-465e-b7ce-6174aeaba417-maas-api-tls\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:11.882199 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:11.881982    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzdmm\" (UniqueName: \"kubernetes.io/projected/5890f0ad-07a5-465e-b7ce-6174aeaba417-kube-api-access-kzdmm\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:12.377348 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:12.377312    5946 generic.go:356] "Generic (PLEG): container finished" podID="5890f0ad-07a5-465e-b7ce-6174aeaba417" containerID="acff457b4a0c5234c0a61c27740d3da164226fad4a922cd264be73674f8767f0" exitCode=0
Oct 31 01:01:12.377552 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:12.377371    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"
Oct 31 01:01:12.377552 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:12.377390    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s" event={"ID":"5890f0ad-07a5-465e-b7ce-6174aeaba417","Type":"ContainerDied","Data":"acff457b4a0c5234c0a61c27740d3da164226fad4a922cd264be73674f8767f0"}
Oct 31 01:01:12.377552 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:12.377452    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s" event={"ID":"5890f0ad-07a5-465e-b7ce-6174aeaba417","Type":"ContainerDied","Data":"f065e199fbb571f0314bbb394719e3d018a2c4959d88a426f88e9717d91a998a"}
Oct 31 01:01:12.377552 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:12.377483    5946 scope.go:122] "RemoveContainer" containerID="acff457b4a0c5234c0a61c27740d3da164226fad4a922cd264be73674f8767f0"
Oct 31 01:01:12.388167 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:12.388154    5946 scope.go:122] "RemoveContainer" containerID="acff457b4a0c5234c0a61c27740d3da164226fad4a922cd264be73674f8767f0"
Oct 31 01:01:12.388583 ip-10-0-143-7 kubenswrapper[5946]: E1031 01:01:12.388456    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acff457b4a0c5234c0a61c27740d3da164226fad4a922cd264be73674f8767f0\": container with ID starting with acff457b4a0c5234c0a61c27740d3da164226fad4a922cd264be73674f8767f0 not found: ID does not exist" containerID="acff457b4a0c5234c0a61c27740d3da164226fad4a922cd264be73674f8767f0"
Oct 31 01:01:12.388583 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:12.388494    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acff457b4a0c5234c0a61c27740d3da164226fad4a922cd264be73674f8767f0"} err="failed to get container status \"acff457b4a0c5234c0a61c27740d3da164226fad4a922cd264be73674f8767f0\": rpc error: code = NotFound desc = could not find container \"acff457b4a0c5234c0a61c27740d3da164226fad4a922cd264be73674f8767f0\": container with ID starting with acff457b4a0c5234c0a61c27740d3da164226fad4a922cd264be73674f8767f0 not found: ID does not exist"
Oct 31 01:01:12.401916 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:12.401893    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"]
Oct 31 01:01:12.405689 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:12.405665    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-f8cb46844-2jx8s"]
Oct 31 01:01:13.055674 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:13.055642    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5890f0ad-07a5-465e-b7ce-6174aeaba417" path="/var/lib/kubelet/pods/5890f0ad-07a5-465e-b7ce-6174aeaba417/volumes"
Oct 31 01:01:14.113488 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.113453    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"]
Oct 31 01:01:14.114196 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.114175    5946 cpu_manager.go:414] "containerMap: removing container" podUID="5890f0ad-07a5-465e-b7ce-6174aeaba417" containerName="maas-api"
Oct 31 01:01:14.114287 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.114199    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5890f0ad-07a5-465e-b7ce-6174aeaba417" containerName="maas-api"
Oct 31 01:01:14.114403 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.114388    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="5890f0ad-07a5-465e-b7ce-6174aeaba417" containerName="maas-api"
Oct 31 01:01:14.119285 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.119262    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"
Oct 31 01:01:14.131140 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.131114    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"]
Oct 31 01:01:14.131292 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.131256    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-7e1e1fc6-serving-cert\""
Oct 31 01:01:14.208812 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.208774    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2t98\" (UniqueName: \"kubernetes.io/projected/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-kube-api-access-s2t98\") pod \"maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8\" (UID: \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"
Oct 31 01:01:14.208975 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.208912    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-openshift-service-ca\") pod \"maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8\" (UID: \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"
Oct 31 01:01:14.208975 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.208936    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-metrics-certs\") pod \"maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8\" (UID: \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"
Oct 31 01:01:14.209050 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.209000    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-maas-api-tls\") pod \"maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8\" (UID: \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"
Oct 31 01:01:14.309691 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.309660    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2t98\" (UniqueName: \"kubernetes.io/projected/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-kube-api-access-s2t98\") pod \"maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8\" (UID: \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"
Oct 31 01:01:14.309882 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.309740    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-openshift-service-ca\") pod \"maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8\" (UID: \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"
Oct 31 01:01:14.309882 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.309761    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-metrics-certs\") pod \"maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8\" (UID: \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"
Oct 31 01:01:14.309882 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.309826    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-maas-api-tls\") pod \"maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8\" (UID: \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"
Oct 31 01:01:14.310533 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.310508    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-openshift-service-ca\") pod \"maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8\" (UID: \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"
Oct 31 01:01:14.313156 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.313127    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-maas-api-tls\") pod \"maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8\" (UID: \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"
Oct 31 01:01:14.313289 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.313241    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-metrics-certs\") pod \"maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8\" (UID: \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"
Oct 31 01:01:14.322102 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.322079    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2t98\" (UniqueName: \"kubernetes.io/projected/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-kube-api-access-s2t98\") pod \"maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8\" (UID: \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"
Oct 31 01:01:14.436116 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.436028    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"
Oct 31 01:01:14.711959 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:14.711933    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"]
Oct 31 01:01:14.714736 ip-10-0-143-7 kubenswrapper[5946]: W1031 01:01:14.714705    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf9f20cb_3e7b_40dd_a037_7b8707b40b65.slice/crio-cbe96e19d7600adf4d9d49e0c011d03d265f9cc341aacf59faaf2c1563db516a WatchSource:0}: Error finding container cbe96e19d7600adf4d9d49e0c011d03d265f9cc341aacf59faaf2c1563db516a: Status 404 returned error can't find the container with id cbe96e19d7600adf4d9d49e0c011d03d265f9cc341aacf59faaf2c1563db516a
Oct 31 01:01:15.396601 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:15.396569    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8" event={"ID":"cf9f20cb-3e7b-40dd-a037-7b8707b40b65","Type":"ContainerStarted","Data":"87c1e859c5e6f6c627dd8115d16954c5db99d2a4bcd13e4b0757205dfec92c4f"}
Oct 31 01:01:15.397095 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:15.396628    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8" event={"ID":"cf9f20cb-3e7b-40dd-a037-7b8707b40b65","Type":"ContainerStarted","Data":"cbe96e19d7600adf4d9d49e0c011d03d265f9cc341aacf59faaf2c1563db516a"}
Oct 31 01:01:15.397095 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:15.396697    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"
Oct 31 01:01:15.415398 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:15.415350    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8" podStartSLOduration=0.920254156 podStartE2EDuration="1.41533679s" totalImagesPullingTime="495.082634ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:01:15.41349282 +0000 UTC m=+1616.486532901" watchObservedRunningTime="2026-10-31 01:01:15.41533679 +0000 UTC m=+1616.488376872"
Oct 31 01:01:16.004239 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:16.004180    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 01:01:21.407180 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:21.407153    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"
Oct 31 01:01:34.768456 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:34.768372    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"]
Oct 31 01:01:34.768892 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:34.768719    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8" podUID="cf9f20cb-3e7b-40dd-a037-7b8707b40b65" containerName="maas-api" containerID="cri-o://87c1e859c5e6f6c627dd8115d16954c5db99d2a4bcd13e4b0757205dfec92c4f" gracePeriod=30
Oct 31 01:01:35.032778 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.032720    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"
Oct 31 01:01:35.130929 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.130895    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-openshift-service-ca\") pod \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\" (UID: \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\") "
Oct 31 01:01:35.131116 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.131036    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-kube-api-access-s2t98\" (UniqueName: \"kubernetes.io/projected/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-kube-api-access-s2t98\") pod \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\" (UID: \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\") "
Oct 31 01:01:35.131116 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.131075    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-metrics-certs\") pod \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\" (UID: \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\") "
Oct 31 01:01:35.131256 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.131129    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-maas-api-tls\") pod \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\" (UID: \"cf9f20cb-3e7b-40dd-a037-7b8707b40b65\") "
Oct 31 01:01:35.131307 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.131260    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-openshift-service-ca" pod "cf9f20cb-3e7b-40dd-a037-7b8707b40b65" (UID: "cf9f20cb-3e7b-40dd-a037-7b8707b40b65"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 01:01:35.131484 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.131467    5946 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-openshift-service-ca\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:35.133129 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.133103    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-kube-api-access-s2t98" pod "cf9f20cb-3e7b-40dd-a037-7b8707b40b65" (UID: "cf9f20cb-3e7b-40dd-a037-7b8707b40b65"). InnerVolumeSpecName "kube-api-access-s2t98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:01:35.133333 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.133300    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-metrics-certs" pod "cf9f20cb-3e7b-40dd-a037-7b8707b40b65" (UID: "cf9f20cb-3e7b-40dd-a037-7b8707b40b65"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:01:35.133333 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.133325    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-maas-api-tls" pod "cf9f20cb-3e7b-40dd-a037-7b8707b40b65" (UID: "cf9f20cb-3e7b-40dd-a037-7b8707b40b65"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:01:35.232234 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.232189    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2t98\" (UniqueName: \"kubernetes.io/projected/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-kube-api-access-s2t98\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:35.232379 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.232245    5946 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-metrics-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:35.232379 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.232260    5946 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cf9f20cb-3e7b-40dd-a037-7b8707b40b65-maas-api-tls\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 01:01:35.510604 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.510568    5946 generic.go:356] "Generic (PLEG): container finished" podID="cf9f20cb-3e7b-40dd-a037-7b8707b40b65" containerID="87c1e859c5e6f6c627dd8115d16954c5db99d2a4bcd13e4b0757205dfec92c4f" exitCode=0
Oct 31 01:01:35.510785 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.510614    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"
Oct 31 01:01:35.510785 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.510653    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8" event={"ID":"cf9f20cb-3e7b-40dd-a037-7b8707b40b65","Type":"ContainerDied","Data":"87c1e859c5e6f6c627dd8115d16954c5db99d2a4bcd13e4b0757205dfec92c4f"}
Oct 31 01:01:35.510785 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.510707    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8" event={"ID":"cf9f20cb-3e7b-40dd-a037-7b8707b40b65","Type":"ContainerDied","Data":"cbe96e19d7600adf4d9d49e0c011d03d265f9cc341aacf59faaf2c1563db516a"}
Oct 31 01:01:35.510785 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.510730    5946 scope.go:122] "RemoveContainer" containerID="87c1e859c5e6f6c627dd8115d16954c5db99d2a4bcd13e4b0757205dfec92c4f"
Oct 31 01:01:35.520477 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.520453    5946 scope.go:122] "RemoveContainer" containerID="87c1e859c5e6f6c627dd8115d16954c5db99d2a4bcd13e4b0757205dfec92c4f"
Oct 31 01:01:35.520831 ip-10-0-143-7 kubenswrapper[5946]: E1031 01:01:35.520813    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"87c1e859c5e6f6c627dd8115d16954c5db99d2a4bcd13e4b0757205dfec92c4f\": container with ID starting with 87c1e859c5e6f6c627dd8115d16954c5db99d2a4bcd13e4b0757205dfec92c4f not found: ID does not exist" containerID="87c1e859c5e6f6c627dd8115d16954c5db99d2a4bcd13e4b0757205dfec92c4f"
Oct 31 01:01:35.520906 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.520843    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"87c1e859c5e6f6c627dd8115d16954c5db99d2a4bcd13e4b0757205dfec92c4f"} err="failed to get container status \"87c1e859c5e6f6c627dd8115d16954c5db99d2a4bcd13e4b0757205dfec92c4f\": rpc error: code = NotFound desc = could not find container \"87c1e859c5e6f6c627dd8115d16954c5db99d2a4bcd13e4b0757205dfec92c4f\": container with ID starting with 87c1e859c5e6f6c627dd8115d16954c5db99d2a4bcd13e4b0757205dfec92c4f not found: ID does not exist"
Oct 31 01:01:35.531758 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.531731    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"]
Oct 31 01:01:35.537474 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:35.537454    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-7e1e1fc6-57856f4c45-xccw8"]
Oct 31 01:01:36.389271 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:36.389237    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 01:01:37.054603 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:37.054571    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="cf9f20cb-3e7b-40dd-a037-7b8707b40b65" path="/var/lib/kubelet/pods/cf9f20cb-3e7b-40dd-a037-7b8707b40b65/volumes"
Oct 31 01:01:41.381163 ip-10-0-143-7 kubenswrapper[5946]: E1031 01:01:41.381119    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 01:01:46.014969 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.014922    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"]
Oct 31 01:01:46.016125 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.016100    5946 cpu_manager.go:414] "containerMap: removing container" podUID="cf9f20cb-3e7b-40dd-a037-7b8707b40b65" containerName="maas-api"
Oct 31 01:01:46.016254 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.016128    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="cf9f20cb-3e7b-40dd-a037-7b8707b40b65" containerName="maas-api"
Oct 31 01:01:46.016529 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.016508    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="cf9f20cb-3e7b-40dd-a037-7b8707b40b65" containerName="maas-api"
Oct 31 01:01:46.030070 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.029828    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"]
Oct 31 01:01:46.030070 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.030034    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"
Oct 31 01:01:46.037306 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.037278    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-authcfg-http-7c2222-serving-cert\""
Oct 31 01:01:46.144591 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.144560    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b7d2d42-bba4-419e-9714-584ef9e7bd90-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp\" (UID: \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"
Oct 31 01:01:46.144762 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.144625    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jn9q\" (UniqueName: \"kubernetes.io/projected/5b7d2d42-bba4-419e-9714-584ef9e7bd90-kube-api-access-6jn9q\") pod \"maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp\" (UID: \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"
Oct 31 01:01:46.144877 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.144856    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b7d2d42-bba4-419e-9714-584ef9e7bd90-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp\" (UID: \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"
Oct 31 01:01:46.145131 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.145101    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7d2d42-bba4-419e-9714-584ef9e7bd90-metrics-certs\") pod \"maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp\" (UID: \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"
Oct 31 01:01:46.246466 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.246425    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b7d2d42-bba4-419e-9714-584ef9e7bd90-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp\" (UID: \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"
Oct 31 01:01:46.246666 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.246508    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jn9q\" (UniqueName: \"kubernetes.io/projected/5b7d2d42-bba4-419e-9714-584ef9e7bd90-kube-api-access-6jn9q\") pod \"maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp\" (UID: \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"
Oct 31 01:01:46.246666 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.246578    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b7d2d42-bba4-419e-9714-584ef9e7bd90-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp\" (UID: \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"
Oct 31 01:01:46.246666 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.246632    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7d2d42-bba4-419e-9714-584ef9e7bd90-metrics-certs\") pod \"maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp\" (UID: \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"
Oct 31 01:01:46.247739 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.247708    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b7d2d42-bba4-419e-9714-584ef9e7bd90-openshift-service-ca\") pod \"maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp\" (UID: \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"
Oct 31 01:01:46.249377 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.249347    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b7d2d42-bba4-419e-9714-584ef9e7bd90-maas-api-tls\") pod \"maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp\" (UID: \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"
Oct 31 01:01:46.249529 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.249502    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7d2d42-bba4-419e-9714-584ef9e7bd90-metrics-certs\") pod \"maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp\" (UID: \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"
Oct 31 01:01:46.259207 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.259176    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jn9q\" (UniqueName: \"kubernetes.io/projected/5b7d2d42-bba4-419e-9714-584ef9e7bd90-kube-api-access-6jn9q\") pod \"maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp\" (UID: \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\") " pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"
Oct 31 01:01:46.345614 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.345584    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"
Oct 31 01:01:46.621837 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:46.621801    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"]
Oct 31 01:01:46.624129 ip-10-0-143-7 kubenswrapper[5946]: W1031 01:01:46.624100    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b7d2d42_bba4_419e_9714_584ef9e7bd90.slice/crio-21cd32cf5a03b862c0b9ad1c283814b4580c54f5af097003775b323d2114113d WatchSource:0}: Error finding container 21cd32cf5a03b862c0b9ad1c283814b4580c54f5af097003775b323d2114113d: Status 404 returned error can't find the container with id 21cd32cf5a03b862c0b9ad1c283814b4580c54f5af097003775b323d2114113d
Oct 31 01:01:47.572228 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:47.572178    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp" event={"ID":"5b7d2d42-bba4-419e-9714-584ef9e7bd90","Type":"ContainerStarted","Data":"ff5e90a5b31ad7b63a4a9b4cc56e0a7932360a12a04e2afd0f2925c6a79ee410"}
Oct 31 01:01:47.572640 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:47.572256    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp" event={"ID":"5b7d2d42-bba4-419e-9714-584ef9e7bd90","Type":"ContainerStarted","Data":"21cd32cf5a03b862c0b9ad1c283814b4580c54f5af097003775b323d2114113d"}
Oct 31 01:01:47.572640 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:47.572390    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"
Oct 31 01:01:47.592898 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:47.592838    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp" podStartSLOduration=2.066298018 podStartE2EDuration="2.592823188s" totalImagesPullingTime="526.52517ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-10-31 01:01:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:01:47.591900475 +0000 UTC m=+1648.664940558" watchObservedRunningTime="2026-10-31 01:01:47.592823188 +0000 UTC m=+1648.665863269"
Oct 31 01:01:48.292507 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:48.292452    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 01:01:53.584353 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:01:53.584327    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"
Oct 31 01:02:11.381203 ip-10-0-143-7 kubenswrapper[5946]: E1031 01:02:11.381167    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 01:02:41.380898 ip-10-0-143-7 kubenswrapper[5946]: E1031 01:02:41.380862    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 01:03:11.380780 ip-10-0-143-7 kubenswrapper[5946]: E1031 01:03:11.380735    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 01:03:35.260751 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:35.260718    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"]
Oct 31 01:03:35.261996 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:35.261947    5946 kuberuntime_container.go:898] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp" podUID="5b7d2d42-bba4-419e-9714-584ef9e7bd90" containerName="maas-api" containerID="cri-o://ff5e90a5b31ad7b63a4a9b4cc56e0a7932360a12a04e2afd0f2925c6a79ee410" gracePeriod=30
Oct 31 01:03:35.531782 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:35.531756    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"
Oct 31 01:03:35.601252 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:35.601188    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5b7d2d42-bba4-419e-9714-584ef9e7bd90-metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7d2d42-bba4-419e-9714-584ef9e7bd90-metrics-certs\") pod \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\" (UID: \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\") "
Oct 31 01:03:35.601444 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:35.601348    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/configmap/5b7d2d42-bba4-419e-9714-584ef9e7bd90-openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b7d2d42-bba4-419e-9714-584ef9e7bd90-openshift-service-ca\") pod \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\" (UID: \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\") "
Oct 31 01:03:35.601518 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:35.601445    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/secret/5b7d2d42-bba4-419e-9714-584ef9e7bd90-maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b7d2d42-bba4-419e-9714-584ef9e7bd90-maas-api-tls\") pod \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\" (UID: \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\") "
Oct 31 01:03:35.601518 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:35.601479    5946 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kubernetes.io/projected/5b7d2d42-bba4-419e-9714-584ef9e7bd90-kube-api-access-6jn9q\" (UniqueName: \"kubernetes.io/projected/5b7d2d42-bba4-419e-9714-584ef9e7bd90-kube-api-access-6jn9q\") pod \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\" (UID: \"5b7d2d42-bba4-419e-9714-584ef9e7bd90\") "
Oct 31 01:03:35.601768 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:35.601717    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5b7d2d42-bba4-419e-9714-584ef9e7bd90-openshift-service-ca" pod "5b7d2d42-bba4-419e-9714-584ef9e7bd90" (UID: "5b7d2d42-bba4-419e-9714-584ef9e7bd90"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Oct 31 01:03:35.601904 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:35.601851    5946 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5b7d2d42-bba4-419e-9714-584ef9e7bd90-openshift-service-ca\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 01:03:35.603456 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:35.603427    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b7d2d42-bba4-419e-9714-584ef9e7bd90-maas-api-tls" pod "5b7d2d42-bba4-419e-9714-584ef9e7bd90" (UID: "5b7d2d42-bba4-419e-9714-584ef9e7bd90"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:03:35.603759 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:35.603739    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5b7d2d42-bba4-419e-9714-584ef9e7bd90-metrics-certs" pod "5b7d2d42-bba4-419e-9714-584ef9e7bd90" (UID: "5b7d2d42-bba4-419e-9714-584ef9e7bd90"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Oct 31 01:03:35.603839 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:35.603786    5946 operation_generator.go:780] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5b7d2d42-bba4-419e-9714-584ef9e7bd90-kube-api-access-6jn9q" pod "5b7d2d42-bba4-419e-9714-584ef9e7bd90" (UID: "5b7d2d42-bba4-419e-9714-584ef9e7bd90"). InnerVolumeSpecName "kube-api-access-6jn9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Oct 31 01:03:35.702905 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:35.702869    5946 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5b7d2d42-bba4-419e-9714-584ef9e7bd90-maas-api-tls\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 01:03:35.702905 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:35.702899    5946 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jn9q\" (UniqueName: \"kubernetes.io/projected/5b7d2d42-bba4-419e-9714-584ef9e7bd90-kube-api-access-6jn9q\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 01:03:35.703107 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:35.702911    5946 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b7d2d42-bba4-419e-9714-584ef9e7bd90-metrics-certs\") on node \"ip-10-0-143-7.us-east-2.compute.internal\" DevicePath \"\""
Oct 31 01:03:36.145290 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:36.145254    5946 generic.go:356] "Generic (PLEG): container finished" podID="5b7d2d42-bba4-419e-9714-584ef9e7bd90" containerID="ff5e90a5b31ad7b63a4a9b4cc56e0a7932360a12a04e2afd0f2925c6a79ee410" exitCode=0
Oct 31 01:03:36.145461 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:36.145299    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp" event={"ID":"5b7d2d42-bba4-419e-9714-584ef9e7bd90","Type":"ContainerDied","Data":"ff5e90a5b31ad7b63a4a9b4cc56e0a7932360a12a04e2afd0f2925c6a79ee410"}
Oct 31 01:03:36.145461 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:36.145349    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp" event={"ID":"5b7d2d42-bba4-419e-9714-584ef9e7bd90","Type":"ContainerDied","Data":"21cd32cf5a03b862c0b9ad1c283814b4580c54f5af097003775b323d2114113d"}
Oct 31 01:03:36.145461 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:36.145354    5946 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"
Oct 31 01:03:36.145461 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:36.145372    5946 scope.go:122] "RemoveContainer" containerID="ff5e90a5b31ad7b63a4a9b4cc56e0a7932360a12a04e2afd0f2925c6a79ee410"
Oct 31 01:03:36.155058 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:36.155041    5946 scope.go:122] "RemoveContainer" containerID="ff5e90a5b31ad7b63a4a9b4cc56e0a7932360a12a04e2afd0f2925c6a79ee410"
Oct 31 01:03:36.155353 ip-10-0-143-7 kubenswrapper[5946]: E1031 01:03:36.155333    5946 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff5e90a5b31ad7b63a4a9b4cc56e0a7932360a12a04e2afd0f2925c6a79ee410\": container with ID starting with ff5e90a5b31ad7b63a4a9b4cc56e0a7932360a12a04e2afd0f2925c6a79ee410 not found: ID does not exist" containerID="ff5e90a5b31ad7b63a4a9b4cc56e0a7932360a12a04e2afd0f2925c6a79ee410"
Oct 31 01:03:36.155430 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:36.155364    5946 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff5e90a5b31ad7b63a4a9b4cc56e0a7932360a12a04e2afd0f2925c6a79ee410"} err="failed to get container status \"ff5e90a5b31ad7b63a4a9b4cc56e0a7932360a12a04e2afd0f2925c6a79ee410\": rpc error: code = NotFound desc = could not find container \"ff5e90a5b31ad7b63a4a9b4cc56e0a7932360a12a04e2afd0f2925c6a79ee410\": container with ID starting with ff5e90a5b31ad7b63a4a9b4cc56e0a7932360a12a04e2afd0f2925c6a79ee410 not found: ID does not exist"
Oct 31 01:03:36.180004 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:36.179974    5946 kubelet.go:2624] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"]
Oct 31 01:03:36.185101 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:36.185078    5946 kubelet.go:2618] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-authcfg-http-7c2222-6c98b99c74-s7gqp"]
Oct 31 01:03:36.995799 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:36.995769    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 01:03:37.054553 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:37.054521    5946 kubelet_volumes.go:161] "Cleaned up orphaned pod volumes dir" podUID="5b7d2d42-bba4-419e-9714-584ef9e7bd90" path="/var/lib/kubelet/pods/5b7d2d42-bba4-419e-9714-584ef9e7bd90/volumes"
Oct 31 01:03:41.379697 ip-10-0-143-7 kubenswrapper[5946]: E1031 01:03:41.379655    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 01:03:44.164729 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:44.164693    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 01:03:49.679122 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:03:49.679092    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 01:04:05.163657 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:05.163614    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 01:04:09.472244 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:09.457354    5946 patch_prober.go:29] interesting pod/maas-default-gateway-openshift-default-6f54779779-jbqxw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Oct 31 01:04:09.472244 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:09.457498    5946 prober.go:122] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-6f54779779-jbqxw" podUID="45bc1cee-bd0f-45be-a614-7d08c7fbf55a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.64:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Oct 31 01:04:11.380793 ip-10-0-143-7 kubenswrapper[5946]: E1031 01:04:11.380752    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 01:04:32.063434 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:32.063340    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-7c9b87d574-2lttl"]
Oct 31 01:04:41.380976 ip-10-0-143-7 kubenswrapper[5946]: E1031 01:04:41.380939    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 01:04:44.253058 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:44.253022    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-wvk8t_cc2b3624-0ae1-4df1-89b6-bb3cc89456dc/manager/0.log"
Oct 31 01:04:44.908882 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:44.908849    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bdb48889c-wcwl9_2faaf5dc-403b-4a11-9089-71126992092b/manager/0.log"
Oct 31 01:04:45.097334 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:45.097306    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-xznzv_eaa04487-3728-4fec-8172-db47ecdabb6a/server/0.log"
Oct 31 01:04:45.287878 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:45.287773    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-k8s5d_ee494b65-1e45-4bcc-9a65-6ae58977f697/manager/0.log"
Oct 31 01:04:46.467442 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:46.467408    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-97ff44f5b-xxrkd_00ef8afe-cc0f-4872-adbc-66140c1c80ba/maas-api/0.log"
Oct 31 01:04:49.849086 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:49.849055    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-vkhpd_f58965a7-39ae-47d5-bf97-9ba80c44fe39/kuadrant-console-plugin/0.log"
Oct 31 01:04:50.282114 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:50.282041    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-2lttl_6e123d48-5cf0-4805-9563-9f2d0a85d61a/limitador/0.log"
Oct 31 01:04:51.630905 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:51.630867    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b544748f5-62f46_bd37a6d5-9adf-425b-aa93-77574694247e/kube-auth-proxy/0.log"
Oct 31 01:04:52.957520 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:52.957488    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f54779779-jbqxw_45bc1cee-bd0f-45be-a614-7d08c7fbf55a/istio-proxy/0.log"
Oct 31 01:04:53.133935 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:53.133899    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f54779779-k62w7_b670c3de-1e2e-47cf-af19-2a1669471c5a/istio-proxy/0.log"
Oct 31 01:04:53.680410 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:53.680379    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f54779779-zrxbz_806ab069-e9d3-404e-a334-cba5e5d2225b/istio-proxy/0.log"
Oct 31 01:04:55.482795 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:55.482760    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr_a744bfbf-fecf-436e-9bf6-d15f6964214a/main/0.log"
Oct 31 01:04:55.827654 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:55.827629    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-qzg9d_71306bfa-d4b5-481f-a5e4-27ed52cf328c/main/0.log"
Oct 31 01:04:56.004087 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:56.004054    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-zc8dd_3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597/main/0.log"
Oct 31 01:04:56.341301 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:56.341277    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-9ldtx_d1862797-b83c-47a9-8baa-17278e8fe9a7/main/0.log"
Oct 31 01:04:56.508372 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:04:56.508320    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l_3604cdc5-119f-483a-984d-314258d993ec/main/0.log"
Oct 31 01:05:06.931841 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:05:06.931806    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-wvk8t_cc2b3624-0ae1-4df1-89b6-bb3cc89456dc/manager/0.log"
Oct 31 01:05:07.555572 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:05:07.555531    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bdb48889c-wcwl9_2faaf5dc-403b-4a11-9089-71126992092b/manager/0.log"
Oct 31 01:05:07.780104 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:05:07.780078    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-xznzv_eaa04487-3728-4fec-8172-db47ecdabb6a/server/0.log"
Oct 31 01:05:07.994131 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:05:07.994041    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-k8s5d_ee494b65-1e45-4bcc-9a65-6ae58977f697/manager/0.log"
Oct 31 01:05:09.063894 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:05:09.063864    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-97ff44f5b-xxrkd_00ef8afe-cc0f-4872-adbc-66140c1c80ba/maas-api/0.log"
Oct 31 01:05:11.380679 ip-10-0-143-7 kubenswrapper[5946]: E1031 01:05:11.380638    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 01:05:12.227500 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:05:12.227476    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-vkhpd_f58965a7-39ae-47d5-bf97-9ba80c44fe39/kuadrant-console-plugin/0.log"
Oct 31 01:05:12.658538 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:05:12.658512    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-2lttl_6e123d48-5cf0-4805-9563-9f2d0a85d61a/limitador/0.log"
Oct 31 01:05:13.890406 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:05:13.890371    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b544748f5-62f46_bd37a6d5-9adf-425b-aa93-77574694247e/kube-auth-proxy/0.log"
Oct 31 01:05:15.268189 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:05:15.268151    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f54779779-jbqxw_45bc1cee-bd0f-45be-a614-7d08c7fbf55a/istio-proxy/0.log"
Oct 31 01:05:15.484382 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:05:15.484351    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f54779779-k62w7_b670c3de-1e2e-47cf-af19-2a1669471c5a/istio-proxy/0.log"
Oct 31 01:05:16.114150 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:05:16.114120    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f54779779-zrxbz_806ab069-e9d3-404e-a334-cba5e5d2225b/istio-proxy/0.log"
Oct 31 01:05:17.426552 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:05:17.426519    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-cbd4f5586-bv5pr_a744bfbf-fecf-436e-9bf6-d15f6964214a/main/0.log"
Oct 31 01:05:17.805579 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:05:17.805553    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-67bf594cd6-qzg9d_71306bfa-d4b5-481f-a5e4-27ed52cf328c/main/0.log"
Oct 31 01:05:17.993944 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:05:17.993913    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-69b588897d-zc8dd_3a9b8c8a-c0f9-47ea-9059-6f9da1c5b597/main/0.log"
Oct 31 01:05:18.359719 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:05:18.359684    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_echo-simulator-kserve-64b6f8f96c-9ldtx_d1862797-b83c-47a9-8baa-17278e8fe9a7/main/0.log"
Oct 31 01:05:18.563341 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:05:18.563309    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-84b4ff656c-lpt6l_3604cdc5-119f-483a-984d-314258d993ec/main/0.log"
Oct 31 01:05:41.381484 ip-10-0-143-7 kubenswrapper[5946]: E1031 01:05:41.381450    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 01:05:56.389680 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:05:56.389643    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bdb48889c-wcwl9_2faaf5dc-403b-4a11-9089-71126992092b/manager/0.log"
Oct 31 01:05:56.649491 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:05:56.649404    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bdb48889c-wcwl9_2faaf5dc-403b-4a11-9089-71126992092b/manager/0.log"
Oct 31 01:06:11.380960 ip-10-0-143-7 kubenswrapper[5946]: E1031 01:06:11.380875    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 01:06:41.380527 ip-10-0-143-7 kubenswrapper[5946]: E1031 01:06:41.380481    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 01:06:43.201366 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:43.201327    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bdb48889c-wcwl9_2faaf5dc-403b-4a11-9089-71126992092b/manager/0.log"
Oct 31 01:06:43.464858 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:43.464775    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bdb48889c-wcwl9_2faaf5dc-403b-4a11-9089-71126992092b/manager/0.log"
Oct 31 01:06:48.045983 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:48.045947    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zdznl_90fdba20-20ae-405d-bd58-0756cc1fdcad/global-pull-secret-syncer/0.log"
Oct 31 01:06:48.268207 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:48.268175    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p2ntf_7aeaf9eb-7ac2-4d0a-aeb5-2a0c08a1dc01/konnectivity-agent/0.log"
Oct 31 01:06:48.350882 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:48.350800    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-7.us-east-2.compute.internal_b5ed8cacd37cfc52fe028fc738a55eb8/haproxy/0.log"
Oct 31 01:06:55.788806 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:55.788773    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66c4fb575d-vkhpd_f58965a7-39ae-47d5-bf97-9ba80c44fe39/kuadrant-console-plugin/0.log"
Oct 31 01:06:55.904044 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:55.904012    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-7c9b87d574-2lttl_6e123d48-5cf0-4805-9563-9f2d0a85d61a/limitador/0.log"
Oct 31 01:06:57.391096 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:57.391071    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fb00c00-f1b2-4c6e-abc3-30ee49786633/alertmanager/0.log"
Oct 31 01:06:57.412109 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:57.412079    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fb00c00-f1b2-4c6e-abc3-30ee49786633/config-reloader/0.log"
Oct 31 01:06:57.432955 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:57.432935    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fb00c00-f1b2-4c6e-abc3-30ee49786633/kube-rbac-proxy-web/0.log"
Oct 31 01:06:57.453619 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:57.453600    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fb00c00-f1b2-4c6e-abc3-30ee49786633/kube-rbac-proxy/0.log"
Oct 31 01:06:57.474570 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:57.474549    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fb00c00-f1b2-4c6e-abc3-30ee49786633/kube-rbac-proxy-metric/0.log"
Oct 31 01:06:57.497973 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:57.497952    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fb00c00-f1b2-4c6e-abc3-30ee49786633/prom-label-proxy/0.log"
Oct 31 01:06:57.518690 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:57.518671    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fb00c00-f1b2-4c6e-abc3-30ee49786633/init-config-reloader/0.log"
Oct 31 01:06:57.596454 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:57.596422    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-dtd6n_6af6f8e7-3e6c-4e48-9944-fa06042a5e57/kube-state-metrics/0.log"
Oct 31 01:06:57.611489 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:57.611463    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-dtd6n_6af6f8e7-3e6c-4e48-9944-fa06042a5e57/kube-rbac-proxy-main/0.log"
Oct 31 01:06:57.631900 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:57.631877    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-5dc8d7d89b-dtd6n_6af6f8e7-3e6c-4e48-9944-fa06042a5e57/kube-rbac-proxy-self/0.log"
Oct 31 01:06:57.688650 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:57.688579    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-77f4f76594-67n7t_c68937ea-3c3b-46d1-9646-a9fa24c89cde/monitoring-plugin/0.log"
Oct 31 01:06:57.715821 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:57.715788    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cxblw_506537b2-c447-4523-95f5-a53bdc768c84/node-exporter/0.log"
Oct 31 01:06:57.735186 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:57.735164    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cxblw_506537b2-c447-4523-95f5-a53bdc768c84/kube-rbac-proxy/0.log"
Oct 31 01:06:57.755626 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:57.755605    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cxblw_506537b2-c447-4523-95f5-a53bdc768c84/init-textfile/0.log"
Oct 31 01:06:57.935632 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:57.935602    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-fmqx8_e4798203-046e-4ad4-842d-a211d905cd74/kube-rbac-proxy-main/0.log"
Oct 31 01:06:57.955998 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:57.955932    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-fmqx8_e4798203-046e-4ad4-842d-a211d905cd74/kube-rbac-proxy-self/0.log"
Oct 31 01:06:57.976479 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:57.976454    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-7bd7489957-fmqx8_e4798203-046e-4ad4-842d-a211d905cd74/openshift-state-metrics/0.log"
Oct 31 01:06:58.021579 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.021553    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f721a015-70c1-4fb5-9bc8-c88e081a9ff5/prometheus/0.log"
Oct 31 01:06:58.057823 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.057794    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f721a015-70c1-4fb5-9bc8-c88e081a9ff5/config-reloader/0.log"
Oct 31 01:06:58.079303 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.079278    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f721a015-70c1-4fb5-9bc8-c88e081a9ff5/thanos-sidecar/0.log"
Oct 31 01:06:58.100669 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.100645    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f721a015-70c1-4fb5-9bc8-c88e081a9ff5/kube-rbac-proxy-web/0.log"
Oct 31 01:06:58.122092 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.122064    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f721a015-70c1-4fb5-9bc8-c88e081a9ff5/kube-rbac-proxy/0.log"
Oct 31 01:06:58.142777 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.142753    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f721a015-70c1-4fb5-9bc8-c88e081a9ff5/kube-rbac-proxy-thanos/0.log"
Oct 31 01:06:58.164162 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.164135    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_f721a015-70c1-4fb5-9bc8-c88e081a9ff5/init-config-reloader/0.log"
Oct 31 01:06:58.195015 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.194989    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-khkq6_cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4/prometheus-operator/0.log"
Oct 31 01:06:58.211830 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.211770    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-9cd89b74c-khkq6_cbc80f90-f288-4fc5-b3fc-6c9dda0dccc4/kube-rbac-proxy/0.log"
Oct 31 01:06:58.262829 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.262803    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bbf6745c4-jmx5v_454d11be-7d7f-483d-bc9d-b067e981a01a/telemeter-client/0.log"
Oct 31 01:06:58.286319 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.286298    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bbf6745c4-jmx5v_454d11be-7d7f-483d-bc9d-b067e981a01a/reload/0.log"
Oct 31 01:06:58.312076 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.312053    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-7bbf6745c4-jmx5v_454d11be-7d7f-483d-bc9d-b067e981a01a/kube-rbac-proxy/0.log"
Oct 31 01:06:58.318486 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.318459    5946 kubelet.go:2608] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"]
Oct 31 01:06:58.319060 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.319040    5946 cpu_manager.go:414] "containerMap: removing container" podUID="5b7d2d42-bba4-419e-9714-584ef9e7bd90" containerName="maas-api"
Oct 31 01:06:58.319060 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.319059    5946 state_mem.go:113] "Deleted CPUSet assignment" logger="CPUManager state memory" podUID="5b7d2d42-bba4-419e-9714-584ef9e7bd90" containerName="maas-api"
Oct 31 01:06:58.319214 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.319201    5946 memory_manager.go:365] "RemoveStaleState removing state" podUID="5b7d2d42-bba4-419e-9714-584ef9e7bd90" containerName="maas-api"
Oct 31 01:06:58.322309 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.322290    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:06:58.328414 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.328395    5946 reflector.go:446] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bd47j\"/\"default-dockercfg-zkc7m\""
Oct 31 01:06:58.329469 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.329448    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bd47j\"/\"kube-root-ca.crt\""
Oct 31 01:06:58.330816 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.330789    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"]
Oct 31 01:06:58.330974 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.330957    5946 reflector.go:446] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bd47j\"/\"openshift-service-ca.crt\""
Oct 31 01:06:58.367113 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.367080    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d69c9c5bf-qglmt_82fa81b0-268b-497e-acc1-ac9eb4a97afb/thanos-query/0.log"
Oct 31 01:06:58.386283 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.386251    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f70e4c76-8d63-4ead-8675-ba98061c134c-podres\") pod \"perf-node-gather-daemonset-t45kn\" (UID: \"f70e4c76-8d63-4ead-8675-ba98061c134c\") " pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:06:58.386447 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.386305    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f70e4c76-8d63-4ead-8675-ba98061c134c-lib-modules\") pod \"perf-node-gather-daemonset-t45kn\" (UID: \"f70e4c76-8d63-4ead-8675-ba98061c134c\") " pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:06:58.386511 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.386440    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkd67\" (UniqueName: \"kubernetes.io/projected/f70e4c76-8d63-4ead-8675-ba98061c134c-kube-api-access-mkd67\") pod \"perf-node-gather-daemonset-t45kn\" (UID: \"f70e4c76-8d63-4ead-8675-ba98061c134c\") " pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:06:58.386511 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.386479    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f70e4c76-8d63-4ead-8675-ba98061c134c-sys\") pod \"perf-node-gather-daemonset-t45kn\" (UID: \"f70e4c76-8d63-4ead-8675-ba98061c134c\") " pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:06:58.386654 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.386638    5946 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f70e4c76-8d63-4ead-8675-ba98061c134c-proc\") pod \"perf-node-gather-daemonset-t45kn\" (UID: \"f70e4c76-8d63-4ead-8675-ba98061c134c\") " pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:06:58.392693 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.392671    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d69c9c5bf-qglmt_82fa81b0-268b-497e-acc1-ac9eb4a97afb/kube-rbac-proxy-web/0.log"
Oct 31 01:06:58.413864 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.413835    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d69c9c5bf-qglmt_82fa81b0-268b-497e-acc1-ac9eb4a97afb/kube-rbac-proxy/0.log"
Oct 31 01:06:58.434264 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.434243    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d69c9c5bf-qglmt_82fa81b0-268b-497e-acc1-ac9eb4a97afb/prom-label-proxy/0.log"
Oct 31 01:06:58.455011 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.454988    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d69c9c5bf-qglmt_82fa81b0-268b-497e-acc1-ac9eb4a97afb/kube-rbac-proxy-rules/0.log"
Oct 31 01:06:58.475528 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.475461    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d69c9c5bf-qglmt_82fa81b0-268b-497e-acc1-ac9eb4a97afb/kube-rbac-proxy-metrics/0.log"
Oct 31 01:06:58.488025 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.488000    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f70e4c76-8d63-4ead-8675-ba98061c134c-proc\") pod \"perf-node-gather-daemonset-t45kn\" (UID: \"f70e4c76-8d63-4ead-8675-ba98061c134c\") " pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:06:58.488145 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.488042    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f70e4c76-8d63-4ead-8675-ba98061c134c-podres\") pod \"perf-node-gather-daemonset-t45kn\" (UID: \"f70e4c76-8d63-4ead-8675-ba98061c134c\") " pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:06:58.488145 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.488072    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f70e4c76-8d63-4ead-8675-ba98061c134c-lib-modules\") pod \"perf-node-gather-daemonset-t45kn\" (UID: \"f70e4c76-8d63-4ead-8675-ba98061c134c\") " pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:06:58.488145 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.488103    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkd67\" (UniqueName: \"kubernetes.io/projected/f70e4c76-8d63-4ead-8675-ba98061c134c-kube-api-access-mkd67\") pod \"perf-node-gather-daemonset-t45kn\" (UID: \"f70e4c76-8d63-4ead-8675-ba98061c134c\") " pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:06:58.488145 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.488113    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f70e4c76-8d63-4ead-8675-ba98061c134c-proc\") pod \"perf-node-gather-daemonset-t45kn\" (UID: \"f70e4c76-8d63-4ead-8675-ba98061c134c\") " pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:06:58.488145 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.488120    5946 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f70e4c76-8d63-4ead-8675-ba98061c134c-sys\") pod \"perf-node-gather-daemonset-t45kn\" (UID: \"f70e4c76-8d63-4ead-8675-ba98061c134c\") " pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:06:58.488397 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.488167    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f70e4c76-8d63-4ead-8675-ba98061c134c-sys\") pod \"perf-node-gather-daemonset-t45kn\" (UID: \"f70e4c76-8d63-4ead-8675-ba98061c134c\") " pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:06:58.488397 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.488196    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f70e4c76-8d63-4ead-8675-ba98061c134c-lib-modules\") pod \"perf-node-gather-daemonset-t45kn\" (UID: \"f70e4c76-8d63-4ead-8675-ba98061c134c\") " pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:06:58.488397 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.488214    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f70e4c76-8d63-4ead-8675-ba98061c134c-podres\") pod \"perf-node-gather-daemonset-t45kn\" (UID: \"f70e4c76-8d63-4ead-8675-ba98061c134c\") " pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:06:58.496013 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.495992    5946 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkd67\" (UniqueName: \"kubernetes.io/projected/f70e4c76-8d63-4ead-8675-ba98061c134c-kube-api-access-mkd67\") pod \"perf-node-gather-daemonset-t45kn\" (UID: \"f70e4c76-8d63-4ead-8675-ba98061c134c\") " pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:06:58.636725 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.636685    5946 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:06:58.911623 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:58.911595    5946 kubelet.go:2615] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"]
Oct 31 01:06:58.913765 ip-10-0-143-7 kubenswrapper[5946]: W1031 01:06:58.913740    5946 manager.go:1172] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf70e4c76_8d63_4ead_8675_ba98061c134c.slice/crio-360670edff4c2246da7f826ffe1ed5ff2a978597178dd57aac6d77c2550a1c2f WatchSource:0}: Error finding container 360670edff4c2246da7f826ffe1ed5ff2a978597178dd57aac6d77c2550a1c2f: Status 404 returned error can't find the container with id 360670edff4c2246da7f826ffe1ed5ff2a978597178dd57aac6d77c2550a1c2f
Oct 31 01:06:59.294196 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:59.294108    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn" event={"ID":"f70e4c76-8d63-4ead-8675-ba98061c134c","Type":"ContainerStarted","Data":"8fb8e8c02fd402395989741ae497132f01d51c7861ee9703b00feb83151294d2"}
Oct 31 01:06:59.294196 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:59.294183    5946 kubelet.go:2639] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn" event={"ID":"f70e4c76-8d63-4ead-8675-ba98061c134c","Type":"ContainerStarted","Data":"360670edff4c2246da7f826ffe1ed5ff2a978597178dd57aac6d77c2550a1c2f"}
Oct 31 01:06:59.294395 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:59.294204    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:06:59.311397 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:06:59.311350    5946 pod_startup_latency_tracker.go:148] "Observed pod startup duration" pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn" podStartSLOduration=1.3113371790000001 podStartE2EDuration="1.311337179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-10-31 01:06:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-10-31 01:06:59.310129718 +0000 UTC m=+1960.383169800" watchObservedRunningTime="2026-10-31 01:06:59.311337179 +0000 UTC m=+1960.384377260"
Oct 31 01:07:02.638102 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:02.638048    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ws48k_7a2e0e44-ffc6-4199-903b-4eae5ad5aefb/dns/0.log"
Oct 31 01:07:02.658338 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:02.658284    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ws48k_7a2e0e44-ffc6-4199-903b-4eae5ad5aefb/kube-rbac-proxy/0.log"
Oct 31 01:07:02.740018 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:02.739990    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-4pvl9_0420aed9-f163-474d-a19f-2db0bfdb32e6/dns-node-resolver/0.log"
Oct 31 01:07:03.505699 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:03.505652    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4pdvd_66f8ebac-f187-49d1-acf8-ec86c904c475/node-ca/0.log"
Oct 31 01:07:05.310572 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:05.310541    5946 kubelet.go:2727] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bd47j/perf-node-gather-daemonset-t45kn"
Oct 31 01:07:05.986841 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:05.986814    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b544748f5-62f46_bd37a6d5-9adf-425b-aa93-77574694247e/kube-auth-proxy/0.log"
Oct 31 01:07:06.195336 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:06.195297    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f54779779-jbqxw_45bc1cee-bd0f-45be-a614-7d08c7fbf55a/istio-proxy/0.log"
Oct 31 01:07:06.223107 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:06.223077    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f54779779-k62w7_b670c3de-1e2e-47cf-af19-2a1669471c5a/istio-proxy/0.log"
Oct 31 01:07:06.314379 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:06.314355    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f54779779-zrxbz_806ab069-e9d3-404e-a334-cba5e5d2225b/istio-proxy/0.log"
Oct 31 01:07:08.042486 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:08.042444    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5sqlr_c9248850-deda-4b75-b652-9f26255812f8/serve-healthcheck-canary/0.log"
Oct 31 01:07:08.869458 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:08.869433    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-szr5z_c55ac10a-0189-4764-b828-098f9ea03f75/kube-rbac-proxy/0.log"
Oct 31 01:07:08.892067 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:08.892041    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-szr5z_c55ac10a-0189-4764-b828-098f9ea03f75/exporter/0.log"
Oct 31 01:07:08.913032 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:08.913005    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-szr5z_c55ac10a-0189-4764-b828-098f9ea03f75/extractor/0.log"
Oct 31 01:07:10.424782 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:10.424754    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b544748f5-62f46_bd37a6d5-9adf-425b-aa93-77574694247e/kube-auth-proxy/0.log"
Oct 31 01:07:10.560385 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:10.560349    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f54779779-jbqxw_45bc1cee-bd0f-45be-a614-7d08c7fbf55a/istio-proxy/0.log"
Oct 31 01:07:10.578929 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:10.578904    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f54779779-k62w7_b670c3de-1e2e-47cf-af19-2a1669471c5a/istio-proxy/0.log"
Oct 31 01:07:10.645659 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:10.645631    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f54779779-zrxbz_806ab069-e9d3-404e-a334-cba5e5d2225b/istio-proxy/0.log"
Oct 31 01:07:11.381729 ip-10-0-143-7 kubenswrapper[5946]: E1031 01:07:11.381690    5946 prober.go:265] "Unable to write all bytes from execInContainer" err="short write" expectedBytes=11141 actualBytes=10240 pod="openshift-insights/insights-runtime-extractor-szr5z" containerName="extractor"
Oct 31 01:07:11.715988 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:11.715908    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-54459f848c-m5949_920e3b17-fdda-4148-87ff-7b3651044974/manager/0.log"
Oct 31 01:07:11.732855 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:11.732834    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub-operator-system_opendatahub-operator-controller-manager-54459f848c-m5949_920e3b17-fdda-4148-87ff-7b3651044974/copy-manifests/0.log"
Oct 31 01:07:12.978129 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:12.978071    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-674cd59dc5-gkhpl_7757dc7e-a800-46fc-99a9-1a4d46231066/jobset-operator/0.log"
Oct 31 01:07:13.603382 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:13.603350    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-776cc66d47-wvk8t_cc2b3624-0ae1-4df1-89b6-bb3cc89456dc/manager/0.log"
Oct 31 01:07:14.171346 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:14.171284    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7bdb48889c-wcwl9_2faaf5dc-403b-4a11-9089-71126992092b/manager/0.log"
Oct 31 01:07:14.189989 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:14.189965    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-b544748f5-62f46_bd37a6d5-9adf-425b-aa93-77574694247e/kube-auth-proxy/0.log"
Oct 31 01:07:14.191264 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:14.191241    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-75bd89fdfc-xznzv_eaa04487-3728-4fec-8172-db47ecdabb6a/server/0.log"
Oct 31 01:07:14.328971 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:14.328924    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f54779779-jbqxw_45bc1cee-bd0f-45be-a614-7d08c7fbf55a/istio-proxy/0.log"
Oct 31 01:07:14.349113 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:14.349081    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f54779779-k62w7_b670c3de-1e2e-47cf-af19-2a1669471c5a/istio-proxy/0.log"
Oct 31 01:07:14.412459 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:14.412408    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-6f54779779-zrxbz_806ab069-e9d3-404e-a334-cba5e5d2225b/istio-proxy/0.log"
Oct 31 01:07:14.618693 ip-10-0-143-7 kubenswrapper[5946]: I1031 01:07:14.618648    5946 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-769875db56-k8s5d_ee494b65-1e45-4bcc-9a65-6ae58977f697/manager/0.log"